Jobs for evaluation engineer-in-training at Toronto

10,000 evaluation engineer-in-training job listings in Canada. Find daily updated positions from leading job boards.

  • L&D Evaluator

    2 days ago


    Toronto, Ontario, Canada Mercor Full-time

    About the roleWe are hiring expert Evaluators in Training / onboarding / L&D to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs.This is a remote, hourly engagement.Requirements (must have)5+ years of relevant...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada DataAnnotation Full-time

    An innovative company is seeking a skilled Software Engineer to help train AI chatbots. This exciting remote role allows you to work on your own schedule while contributing to the development of cutting-edge AI technology. You'll be responsible for creating diverse coding challenges, writing high-quality code snippets, and evaluating AI-generated code for...


  • Toronto, Ontario, Canada DataAnnotation Full-time

    An innovative company is seeking a skilled Software Engineer to help train AI chatbots. This exciting remote role allows you to work on your own schedule while contributing to the development of cutting-edge AI technology. You'll be responsible for creating diverse coding challenges, writing high-quality code snippets, and evaluating AI-generated code for...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Rex.zone Full-time

    A tech company specializing in AI is seeking an AI Trainer based in Canada. The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling. Candidates should have experience with structured evaluation, strong writing skills, and familiarity with AI evaluation workflows. This position offers an hourly...

  • AI Evaluation Engineer

    12 hours ago


    Toronto, Ontario, Canada Zafin Full-time

    Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments. Our portfolio includes Zafin AIOS, an agent orchestration platform for...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Crossing Hurdles Full-time

    A referral company is seeking a Mathematics Specialist (Undergraduate/Master’s) to curate advanced mathematics problems for AI training. This remote role involves reviewing AI-generated solutions for quality and logical reasoning. Ideal candidates should have strong problem-solving skills, excellent communication, and be actively pursuing or holding a...

  • L&D Evaluator

    4 days ago


    Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mercor Full-time

    About the role We are hiring expert Evaluators in Training / onboarding / L&D to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements (must have)5+ years of relevant...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mindrift Full-time

    An innovative tech firm in Canada is looking for contributors with expertise in economics for flexible, part-time AI projects. Ideal candidates hold advanced degrees and have significant experience in accounting. Responsibilities include designing complex tasks for AI systems and engaging in project onboarding. This remote role offers competitive rates,...

  • Software Engineer

    2 days ago


    Toronto, ON, Toronto Census Division, ON; Ontario, Canada Waabi Full-time

    Overview Waabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we\u2019re unlocking the next era of autonomous transportation with technology that\u2019s powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech. With...


  • Toronto, Ontario, Canada Appnovation Technologies Full-time

    About usAppnovation is a global, full-service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver real impact today and serve as foundations for future growth. Bold ambition. Practical action. Endless possibilities.Technology is foundational to all of Appnovation's offerings,...


  • Toronto, Ontario, Canada Mercor Full-time

    1. Role OverviewMercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring...


  • Toronto, Ontario, Canada Waabi Full-time

    Drive innovation as a Software Engineer specializing in evaluation algorithms for autonomous technologies. Leverage your real-world experience in Python and machine learning to enhance system performance metrics. In this vital role, you will develop the necessary tooling and infrastructure for evaluating autonomous system performance. By working closely...


  • Toronto, Ontario, Canada Appnovation Full-time

    About Us Appnovation is a global, full-service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver real impact today and serve as foundations for future growth. Bold ambition. Practical action. Endless possibilities. Technology is foundational to all of Appnovation’s...


  • Toronto, Ontario, Canada Appnovation Full-time

    As a QA / AI Evaluation Engineer, you will join a highly motivated and experienced team in a forward-leaning role that proves the platform actually improves answer quality. You will run evaluations at scale — from small human-UAT batches up to millions of automated evals — statistically measure factual grounding and accuracy lift, and build the metrics...

  • Software Engineer

    5 hours ago


    Toronto, Ontario, Canada Waabi Full-time

    OverviewWaabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we\u2019re unlocking the next era of autonomous transportation with technology that\u2019s powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech.With...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Zafin Full-time €80,000 - €180,000 Temporary

    Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments. Our portfolio includes Zafin AIOS , an agent orchestration platform...


  • Toronto, Canada Anishinabek Employment & Training Services Full-time €60,000 - €70,000 Contract

    The Ontario First Nations Technical Services Corporation (OFNTSC) is a nonprofit organization that provides technical advisory services, training, and capacity development to First Nations communities in Ontario. By offering a wide range of specialized services and expertise, OFNTSC helps to enhance the quality of life, promote self-sufficiency, and foster...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Appnovation Full-time

    As a QA / AI Evaluation Engineer, you will join a highly motivated and experienced team in a forward-leaning role that proves the platform actually improves answer quality. You will run evaluations at scale — from small human-UAT batches up to millions of automated evals — statistically measure factual grounding and accuracy lift, and build the metrics...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mercor Full-time

    1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring...


  • Toronto, Ontario, Canada Obsidian Full-time

    Obsidian is hiring Engineering / Platform professionals to review, assess, and provide structured feedback on domain-specific documents. The role emphasizes quality, accuracy, and adherence to guidelines, suitable for candidates with strong analytical skills and 2+ years of experience.You'll contribute to high-impact evaluation projects and collaborate with...