evaluation jobs in Calgary

Job offers for evaluation. Find listings updated daily.

  • Remote AI Writing

    2 days ago


    Calgary, AB, Canada Outlier Full-time

    Outlier, a platform owned by Scale AI, seeks English speakers to help train and refine cutting-edge AI systems. This freelance, 1099 role is 100% remote, with flexible hours and a base rate up to $15/hour USD, plus the possibility of bonuses based on project performance.You'll evaluate AI outputs, draft and improve prompts, and contribute across projects...


  • Calgary, Alberta, Canada CrowdStrike Inc. Full-time

    Shape trusted AI evaluation at CrowdStrike using agent frameworks, LLM APIs, and verification-first test automation. Work on cloud-based cybersecurity systems.As a Software Development Engineer in Test, you will help determine how CrowdStrike AI agents are tested, evaluated, and trusted in production. The position combines test automation with eval-driven...


  • toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada JoinStartup Full-time

    Define conversational AI quality remotely from Canada or the United States using Python, LLM APIs, and rigorous evaluation systems. As Cresta’s mid-level AI Agent Evaluation Engineer, you will own quality measurement for production LLM-based conversational agents. You will combine conversation analysis, annotation, rubric design, and statistical sampling...


  • toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada Cim Full-time

    We are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model. In this role you will need to hold an expert level of financial reasoning- a completed or in progress Masters/PhD is preferred. Other related fields...

  • Health Data Analytics

    15 hours ago


    Calgary, Alberta, Canada University of Calgary Full-time

    The University of Calgary invites applications for a Research Associate in Health Data Analytics & Evaluation within the Physician Learning Program of the Cumming School of Medicine. This 9‑month, full‑time fixed term role may extend based on grant funding.You will manage complex health datasets, perform advanced analyses using R, Stata, and SAS, and...


  • toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada Linuxassociation Full-time

    # Python Developer-AI EvaluationZettaMine Labs Pvt. Ltd. · , CABack to resultsPython Developer-AI EvaluationZettaMine Labs Pvt. Ltd., CA Posted October 29, 2026 Via JobLeads### Full Job DescriptionFreelancing Opportunity: We are hiring Senior Software Engineers – Python / TypeScript (USA) for a short-term AI Engineering and Evaluation project focused on...


  • toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada Jobgether Full-time

    Bring evidence-based evaluation and research expertise to remote assignments supporting international development and digital transformation initiatives across Canada. This Evaluation Consultant role suits experienced professionals contributing to centralized and decentralized evaluations. You will assess strategies, policies, programs, and projects while...


  • toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, winnipeg, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, manitoba, Canada Cohere Inc. Full-time

    Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities. As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques...


  • edmonton, toronto, montreal, calgary, vancouver, quebec, ottawa, mississauga, moncton, winnipeg, division no. 11, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, peel region, moncton parish, manitoba, Canada Alignerr Corp. Full-time

    Evaluate healthcare AI remotely with expertise in telehealth and clinical workflows. Alignerr offers hourly contract assignments on your own schedule. As a Digital Health Strategist, you will assess AI-generated content, recommendations, and workflows for accuracy and clinical relevance. Your experience with remote monitoring, wearables, and digital care...


  • Calgary, AB, Canada Cohere Full-time

    Use Trust & Safety judgment to evaluate model outputs for Cohere, working remotely as a part-time independent contractor in Canada or the United States. Written English is essential.This Data Annotation Specialist role focuses on safety evaluation for Large Language Models supporting AI systems. You will recognize risks across user intents, apply detailed...


  • Calgary, AB, Calgary Census Division, AB; Alberta, Canada Alberta Full-time

    Shape Jackfish asset decisions from Calgary through technical and economic evaluations, production forecasting, and thermal development planning. Canadian Natural is seeking a Thermal Jackfish Exploitation Engineer for a top tier SAGD asset and collaborative professional team. You will prepare evaluations that influence existing and future assets while...


  • Calgary, AB, Canada Mindrift Full-time

    4 days ago Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human...


  • Calgary, AB, Canada Outlier Full-time

    Outlier, a platform owned and operated by Scale AI, is seeking English-speaking contributors to help train and refine cutting-edge AI systems from anywhere. This freelance/1099 role offers up to $15/hour USD, with weekly payouts and performance-based bonuses. Remote work is 100% remote with flexible hours.You must be authorized to work in your country of...


  • Calgary, AB, Canada Crossing Hurdles Full-time

    A referral company is seeking a Mathematics Specialist (Undergraduate/Master’s) to curate advanced mathematics problems for AI training. This remote role involves reviewing AI-generated solutions for quality and logical reasoning. Ideal candidates should have strong problem-solving skills, excellent communication, and be actively pursuing or holding a...


  • Calgary, Alberta, Canada Cuso International Full-time

    This Volunteer Placement is Located in: Lima, PeruStart Date: January 2027Placement Length: 5 monthsLanguage Requirements: Spanish Level 4-AdvancedPlease submit a Spanish Resume and Statement of InterestEligibility: Open to Canadian Citizens and Permanent Residents of Canada onlyThe Volunteer’s Role As the Monitoring, Evaluation and Project Development...


  • toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada Jobgether Full-time

    Apply British English expertise to AI audio evaluation from Canada, using careful listening and linguistic analysis in a fully remote freelance arrangement. This British English Voice Expert role supports an AI training project evaluating spoken English quality and authenticity. You will assess pronunciation, regional accents, fluency, tone, and...


  • Calgary, AB, Canada CXG Full-time

    Turn your passion for luxury into a career opportunity. Explore the world of premium brands and make a lasting impact in fashion, beauty, jewelry, or automobiles. Join CXG, the global leader in customer experience, and work alongside iconic brand names. About the Role: Flexibility - each in-store visit takes approximately 20 minutes, giving you the...


  • ottawa, toronto, montreal, calgary, vancouver, quebec, edmonton, mississauga, moncton, winnipeg, ontario, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, division no. 11, peel region, moncton parish, manitoba, Canada Lifted, an Upwork Company™ Full-time

    Evaluate AI coding assistants through real software projects, using Git, terminal commands, and clear written feedback in a fully remote contract. This contract suits experienced software developers who personally own and maintain a software project in a Git repository. You will use an AI coding assistant to build features, fix bugs, refactor code, or...


  • victoria, toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, capital regional district, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada DataAnnotation Full-time

    Bring real-world quantitative experience to remote AI model evaluation, with flexible scheduling and projects selected around your availability. As an Experimentation Analyst and AI Trainer with DataAnnotation, you will test whether AI outputs withstand practical scrutiny. The work suits practitioners from statistics, finance, physics, biology, epidemiology,...


  • toronto, montreal, calgary, vancouver, quebec, ottawa, edmonton, mississauga, moncton, ontario, quebec, alberta, metro vancouver regional district, capitale nationale, ontario, division no. 11, peel region, moncton parish, Canada DataAnnotation Full-time

    Evaluate AI models against real business problems using consulting judgment, analytical rigor, and structured written feedback from your own practice. This senior consulting position trains AI models to reason like strategy advisors. You will assess market entry, competitive, operational, and transaction work. Your evaluations examine framing, structure,...