Jobs for freelance agent evaluation engineer at Toronto
8,171 freelance agent evaluation engineer job listings in Canada. Find daily updated positions from leading job boards.
-
Freelance Agent Evaluation Analyst
3 days ago
Toronto, ON, Canada Mindrift Full-time4 days ago Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human...
-
Toronto, ON, Canada vectorinstitute Full-time $126,000 - $157,000 ContractPOSITION SUMMARYAs an Applied Machine Learning Scientist, Agent Evaluation and Harness Engineering, you will lead applied research on evaluation, observability, stress-testing, and systematic improvement of AI agents. The role focuses on assessing agent performance and safety across long-horizon, multi-step tasks, and on building methods and tools to help...
-
Freelance Agent Evaluation Analyst
1 week ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mindrift Full-time €45 Temporary4 days ago Be among the first 25 applicants This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English proficiency. At Mindrift, innovation meets opportunity. We believe in using the power of collective human...
-
Toronto, ON, Toronto Census Division, ON; Ontario, Canada vectorinstitute Full-time €125,800 - €157,300 TemporaryPOSITION SUMMARY As an Applied Machine Learning Scientist, Agent Evaluation and Harness Engineering, you will lead applied research on evaluation, observability, stress-testing, and systematic improvement of AI agents. The role focuses on assessing agent performance and safety across long-horizon, multi-step tasks, and on building methods and tools to help...
-
AI Evaluation Engineer
2 days ago
Toronto, ON, Canada Zafin Full-time $112,708 - $253,593 ContractZafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments. Our portfolio includes Zafin AIOS, an agent orchestration platform for...
-
Applied ML Scientist: Agent Evaluation
16 hours ago
Toronto, ON, Canada vectorinstitute Full-time $126,000 - $157,000 ContractVector Institute is seeking an Applied Machine Learning Scientist focused on agent evaluation and harness engineering. You will lead applied research on evaluation, observability, stress-testing, and systematic improvement of AI agents, with emphasis on long-horizon, multi-step tasks and safety across organizational contexts.You will collaborate with Vector...
-
Freelance AI Evaluation Scenario Writer
5 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mindrift Full-time €45 TemporaryThis opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We...
-
AI Engineer – Freelancer
3 days ago
Toronto, ON, Canada Twine Full-timeJoin to apply for the AI Engineer – Freelancer role at Twine. Join a project focused on advancing an AI‑powered influencer marketing platform by optimizing and scaling its data pipeline. The primary objective is to enhance the performance, cost‑efficiency, and recall quality of image‑to‑text and embeddings workflows. You will be responsible for...
-
Freelance AI Evaluation Scenario Writer
5 days ago
Toronto, ON, Canada Mindrift Full-timeThis opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We...
-
Toronto AI Evaluation Engineer Opening
1 day ago
Toronto, Ontario, Canada Zafin Full-timeExplore an exciting AI Evaluation Engineer role at Zafin in Toronto. Help optimize AI agent solutions to ensure safety, accuracy, and regulatory compliance in the banking industry. In this position, you will facilitate the evaluation of AI agents against established business, performance, and regulatory benchmarks. Your expertise in machine learning and...
-
Data Engineer
16 hours ago
Toronto, ON, Canada Obsidian Full-timeAbout the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Spots are limited and filling quickly on a first come, first...
-
DevOps Engineer
4 hours ago
Toronto, Ontario, Canada Mercor Full-timeAbout the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic infrastructure engineering workflows and model evaluation. Spots are limited and filling quickly on a first...
-
Data Engineer
2 days ago
Toronto, ON, Canada Obsidian Full-time $413,000 - $689,000 ContractAbout the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Spots are limited and filling quickly on a first come, first...
-
Frontier AI Data Engineering Evaluator
3 days ago
Toronto, ON, Canada Mercor Full-time $193,000 - $248,000 ContractMercor invites skilled Data Engineers to apply for a role evaluating frontier AI coding models. Leverage your data engineering skills while working on groundbreaking AI research projects. In collaboration with a leading AI lab, this opportunity focuses on evaluating and enhancing AI coding models within the Frontier Code Agents project. Data Engineers will...
-
Data Engineer
3 days ago
Toronto, ON, Canada Mercor Full-time $193,000 - $248,000 ContractAbout the Role Mercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Spots are limited and filling quickly on a first come, first...
-
Agent Deployment Engineer Premium
17 hours ago
Toronto, Canada Decagon Full-time $150,000 - $200,000 ContractAbout DecagonDecagon is the leading conversational AI platform empowering every brand to deliver concierge customer experiences.Our technology enables industry-defining enterprises like Avis Budget Group, Block’s Cash App and Square, Chime, Oura Health, and Hunter Douglas to deploy AI agents that power personalized, deeply satisfying interactions across...
-
Data Engineer
4 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mercor Full-timeMercor is partnering with a leading AI research lab to support a Frontier Code Agents project. Contributors help evaluate and improve frontier AI coding models through structured technical assessments. The work focuses on realistic data engineering workflows and model evaluation. Use frontier AI coding agents to complete and evaluate complex data...
-
Toronto, ON, Canada Obsidian Remote Full-time $227,000 - $324,000 ContractObsidian is seeking contributors to advance frontier AI coding models through structured technical assessments. You will engage with frontier AI coding agents to perform complex data engineering tasks and evaluate model-generated data infra, pipelines, and analytics platforms.The role emphasizes identifying edge cases, scalability issues, and comparing model...
-
Frontier AI Data Engineering Evaluator
4 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Mercor Full-timeMercor invites skilled Data Engineers to apply for a role evaluating frontier AI coding models. Leverage your data engineering skills while working on groundbreaking AI research projects. In collaboration with a leading AI lab, this opportunity focuses on evaluating and enhancing AI coding models within the Frontier Code Agents project. Data Engineers will...
-
Applied ML Scientist: Agent Evaluation
5 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada vectorinstitute Full-timeVector Institute is seeking an Applied Machine Learning Scientist focused on agent evaluation and harness engineering. You will lead applied research on evaluation, observability, stress-testing, and systematic improvement of AI agents, with emphasis on long-horizon, multi-step tasks and safety across organizational contexts. You will collaborate with Vector...