Jobs for freelance agent evaluation engineer at Toronto

8,171 freelance agent evaluation engineer job listings in Canada. Find daily updated positions from leading job boards.


  • Toronto, ON, Canada Mindrift Full-time

    4 days ago Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human...


  • Toronto, ON, Canada vectorinstitute Full-time $126,000 - $157,000 Contract

    POSITION SUMMARYAs an Applied Machine Learning Scientist, Agent Evaluation and Harness Engineering, you will lead applied research on evaluation, observability, stress-testing, and systematic improvement of AI agents. The role focuses on assessing agent performance and safety across long-horizon, multi-step tasks, and on building methods and tools to help...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mindrift Full-time €45 Temporary

    4 days ago Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada vectorinstitute Full-time €125,800 - €157,300 Temporary

    POSITION SUMMARY As an Applied Machine Learning Scientist, Agent Evaluation and Harness Engineering, you will lead applied research on evaluation, observability, stress-testing, and systematic improvement of AI agents. The role focuses on assessing agent performance and safety across long-horizon, multi-step tasks, and on building methods and tools to help...


  • Toronto, ON, Canada Zafin Full-time $112,708 - $253,593 Contract

    Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments. Our portfolio includes Zafin AIOS, an agent orchestration platform for...


  • Toronto, ON, Canada vectorinstitute Full-time $126,000 - $157,000 Contract

    Vector Institute is seeking an Applied Machine Learning Scientist focused on agent evaluation and harness engineering. You will lead applied research on evaluation, observability, stress-testing, and systematic improvement of AI agents, with emphasis on long-horizon, multi-step tasks and safety across organizational contexts.You will collaborate with Vector...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mindrift Full-time €45 Temporary

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We...


  • Toronto, ON, Canada Twine Full-time

    Join to apply for the AI Engineer – Freelancer role at Twine. Join a project focused on advancing an AI‑powered influencer marketing platform by optimizing and scaling its data pipeline. The primary objective is to enhance the performance, cost‑efficiency, and recall quality of image‑to‑text and embeddings workflows. You will be responsible for...


  • Toronto, ON, Canada Mindrift Full-time

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We...


  • Toronto, Ontario, Canada Zafin Full-time

    Explore an exciting AI Evaluation Engineer role at Zafin in Toronto. Help optimize AI agent solutions to ensure safety, accuracy, and regulatory compliance in the banking industry. In this position, you will facilitate the evaluation of AI agents against established business, performance, and regulatory benchmarks. Your expertise in machine learning and...

  • Data Engineer

    16 hours ago


    Toronto, ON, Canada Obsidian Full-time

    About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Spots are limited and filling quickly on a first come, first...

  • DevOps Engineer

    4 hours ago


    Toronto, Ontario, Canada Mercor Full-time

    About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic infrastructure engineering workflows and model evaluation. Spots are limited and filling quickly on a first...

  • Data Engineer

    2 days ago


    Toronto, ON, Canada Obsidian Full-time $413,000 - $689,000 Contract

    About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Spots are limited and filling quickly on a first come, first...


  • Toronto, ON, Canada Mercor Full-time $193,000 - $248,000 Contract

    Mercor invites skilled Data Engineers to apply for a role evaluating frontier AI coding models. Leverage your data engineering skills while working on groundbreaking AI research projects. In collaboration with a leading AI lab, this opportunity focuses on evaluating and enhancing AI coding models within the Frontier Code Agents project. Data Engineers will...

  • Data Engineer

    3 days ago


    Toronto, ON, Canada Mercor Full-time $193,000 - $248,000 Contract

    About the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Spots are limited and filling quickly on a first come, first...

  • Agent Deployment Engineer Premium

    17 hours ago


    Toronto, Canada Decagon Full-time $150,000 - $200,000 Contract

    About DecagonDecagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences.Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across...

  • Data Engineer

    4 days ago


    Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mercor Full-time

    Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Use frontier AI coding agents to complete and evaluate complex data...


  • Toronto, ON, Canada Obsidian Remote Full-time $227,000 - $324,000 Contract

    Obsidian is seeking contributors to advance frontier AI coding models through structured technical assessments. You will engage with frontier AI coding agents to perform complex data engineering tasks and evaluate model-generated data infra, pipelines, and analytics platforms.The role emphasizes identifying edge cases, scalability issues, and comparing model...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mercor Full-time

    Mercor invites skilled Data Engineers to apply for a role evaluating frontier AI coding models. Leverage your data engineering skills while working on groundbreaking AI research projects. In collaboration with a leading AI lab, this opportunity focuses on evaluating and enhancing AI coding models within the Frontier Code Agents project. Data Engineers will...


  • Toronto, ON, Toronto Census Division, ON; Ontario, Canada vectorinstitute Full-time

    Vector Institute is seeking an Applied Machine Learning Scientist focused on agent evaluation and harness engineering. You will lead applied research on evaluation, observability, stress-testing, and systematic improvement of AI agents, with emphasis on long-horizon, multi-step tasks and safety across organizational contexts. You will collaborate with Vector...