evaluation jobs in Calgary
Job offers for evaluation. Find listings updated daily.
-
Remote AI Writing
2 days ago
Calgary, AB, Canada Outlier Full-timeOutlier, a platform owned by Scale AI, seeks English speakers to help train and refine cutting-edge AI systems. This freelance, 1099 role is 100% remote, with flexible hours and a base rate up to $15/hour USD, plus the possibility of bonuses based on project performance.You'll evaluate AI outputs, draft and improve prompts, and contribute across projects...
-
AI Evaluation Test Automation Engineer
2 days ago
Calgary, Alberta, Canada CrowdStrike Inc. Full-timeShape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated, and trusted in production. The position combines test automation with eval-driven...
-
AI Agent Evaluation Engineer
2 days ago
toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada JoinStartup Full-timeDefine conversational AI quality remotely from Canada or the United States using Python, LLM APIs, and rigorous evaluation systems. As Cresta’s mid-level AI Agent Evaluation Engineer, you will own quality measurement for production LLM-based conversational agents. You will combine conversation analysis, annotation, rubric design, and statistical sampling...
-
Finance - AI Model Evaluator
2 days ago
toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada Cim Full-timeWe are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of financial reasoning- a completed or in progress Masters/PhD is preferred. Other related fields...
-
Health Data Analytics
15 hours ago
Calgary, Alberta, Canada University of Calgary Full-timeThe University of Calgary invites applications for a Research Associate in Health Data Analytics & Evaluation within the Physician Learning Program of the Cumming School of Medicine. This 9‑month, full‑time fixed term role may extend based on grant funding.You will manage complex health datasets, perform advanced analyses using R, Stata, and SAS, and...
-
Python Developer-AI Evaluation
2 days ago
toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada Linuxassociation Full-time# Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd., CA Posted October 29, 2026 Via JobLeads### Full Job DescriptionFreelancing Opportunity: We are hiring Senior Software Engineers – Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on...
-
Evaluation Consultant Digital Development
2 days ago
toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada Jobgether Full-timeBring evidence-based evaluation and research expertise to remote assignments supporting international development and digital transformation initiatives across Canada. This Evaluation Consultant role suits experienced professionals contributing to centralized and decentralized evaluations. You will assess strategies, policies, programs, and projects while...
-
Research Scientist in AI Evaluation
2 days ago
toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, winnipeg, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, manitoba, Canada Cohere Inc. Full-timeCohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities. As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques...
-
Digital Health AI Evaluator
2 days ago
edmonton, toronto, montreal, calgary, vancouver, quebec, ottawa, mississauga, moncton, winnipeg, division no. 11, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, peel region, moncton parish, manitoba, Canada Alignerr Corp. Full-timeEvaluate healthcare AI remotely with expertise in telehealth and clinical workflows. Alignerr offers hourly contract assignments on your own schedule. As a Digital Health Strategist, you will assess AI-generated content, recommendations, and workflows for accuracy and clinical relevance. Your experience with remote monitoring, wearables, and digital care...
-
Trust and Safety AI Evaluator
4 days ago
Calgary, AB, Canada Cohere Full-timeUse Trust & Safety judgment to evaluate model outputs for Cohere, working remotely as a part-time independent contractor in Canada or the United States. Written English is essential.This Data Annotation Specialist role focuses on safety evaluation for Large Language Models supporting AI systems. You will recognize risks across user intents, apply detailed...
-
Jackfish Technical Evaluation Engineer
4 days ago
Calgary, AB, Calgary Census Division, AB; Alberta, Canada Alberta Full-timeShape Jackfish asset decisions from Calgary through technical and economic evaluations, production forecasting, and thermal development planning. Canadian Natural is seeking a Thermal Jackfish Exploitation Engineer for a top tier SAGD asset and collaborative professional team. You will prepare evaluations that influence existing and future assets while...
-
Freelance Agent Evaluation Analyst
4 days ago
Calgary, AB, Canada Mindrift Full-time4 days ago Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human...
-
Remote Content Editor for AI Training
2 days ago
Calgary, AB, Canada Outlier Full-timeOutlier, a platform owned and operated by Scale AI, is seeking English-speaking contributors to help train and refine cutting-edge AI systems from anywhere. This freelance/1099 role offers up to $15/hour USD, with weekly payouts and performance-based bonuses. Remote work is 100% remote with flexible hours.You must be authorized to work in your country of...
-
Remote Math Specialist for AI Training
2 days ago
Calgary, AB, Canada Crossing Hurdles Full-timeA referral company is seeking a Mathematics Specialist (Undergraduate/Master’s) to curate advanced mathematics problems for AI training. This remote role involves reviewing AI-generated solutions for quality and logical reasoning. Ideal candidates should have strong problem-solving skills, excellent communication, and be actively pursuing or holding a...
-
Calgary, Alberta, Canada Cuso International Full-timeThis Volunteer Placement is Located in: Lima, PeruStart Date: January 2027Placement Length: 5 monthsLanguage Requirements: Spanish Level 4-AdvancedPlease submit a Spanish Resume and Statement of InterestEligibility: Open to Canadian Citizens and Permanent Residents of Canada onlyThe Volunteer’s Role As the Monitoring, Evaluation and Project Development...
-
British English AI Audio Evaluator
2 days ago
toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada Jobgether Full-timeApply British English expertise to AI audio evaluation from Canada, using careful listening and linguistic analysis in a fully remote freelance arrangement. This British English Voice Expert role supports an AI training project evaluating spoken English quality and authenticity. You will assess pronunciation, regional accents, fluency, tone, and...
-
Calgary, AB, Canada CXG Full-timeTurn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: Flexibility - each in-store visit takes approximately 20 minutes, giving you the...
-
AI Coding Assistant Evaluation Developer
2 days ago
ottawa, toronto, montreal, calgary, vancouver, quebec, edmonton, mississauga, moncton, winnipeg, ontario, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, division no. 11, peel region, moncton parish, manitoba, Canada Lifted, an Upwork Company™ Full-timeEvaluate AI coding assistants through real software projects, using Git, terminal commands, and clear written feedback in a fully remote contract. This contract suits experienced software developers who personally own and maintain a software project in a Git repository. You will use an AI coding assistant to build features, fix bugs, refactor code, or...
-
Quantitative Analyst AI Model Evaluator
2 days ago
victoria, toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, capital regional district, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada DataAnnotation Full-timeBring real-world quantitative experience to remote AI model evaluation, with flexible scheduling and projects selected around your availability. As an Experimentation Analyst and AI Trainer with DataAnnotation, you will test whether AI outputs withstand practical scrutiny. The work suits practitioners from statistics, finance, physics, biology, epidemiology,...
-
Senior AI Model Evaluation Consultant
2 days ago
toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada DataAnnotation Full-timeEvaluate AI models against real business problems using consulting judgment, analytical rigor, and structured written feedback from your own practice. This senior consulting position trains AI models to reason like strategy advisors. You will assess market entry, competitive, operational, and transaction work. Your evaluations examine framing, structure,...