Jobs for ai evaluation engineer at Toronto

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments. Our portfolio includes Zafin AIOS, an agent orchestration platform for...

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments. Our portfolio includes Zafin AIOS , an agent orchestration platform...

About usAppnovation is a global, full-service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver real impact today and serve as foundations for future growth. Bold ambition. Practical action. Endless possibilities.Technology is foundational to all of Appnovation's offerings,...

As a QA / AI Evaluation Engineer, you will join a highly motivated and experienced team in a forward-leaning role that proves the platform actually improves answer quality. You will run evaluations at scale — from small human-UAT batches up to millions of automated evals — statistically measure factual grounding and accuracy lift, and build the metrics...

About Us Appnovation is a global, full-service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver real impact today and serve as foundations for future growth. Bold ambition. Practical action. Endless possibilities. Technology is foundational to all of Appnovation’s...

As a QA / AI Evaluation Engineer, you will join a highly motivated and experienced team in a forward-leaning role that proves the platform actually improves answer quality. You will run evaluations at scale — from small human-UAT batches up to millions of automated evals — statistically measure factual grounding and accuracy lift, and build the metrics...

About us Appnovation is a global, full-service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver real impact today and serve as foundations for future growth. Bold ambition. Practical action. Endless possibilities. Technology is foundational to all of Appnovation's...

Explore an exciting AI Evaluation Engineer role at Zafin in Toronto. Help optimize AI agent solutions to ensure safety, accuracy, and regulatory compliance in the banking industry. In this position, you will facilitate the evaluation of AI agents against established business, performance, and regulatory benchmarks. Your expertise in machine learning and...

About us Appnovation is a global, full-service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver real impact today and serve as foundations for future growth. Bold ambition. Practical action. Endless possibilities. Technology is foundational to all of Appnovation’s...

Explore an exciting AI Evaluation Engineer role at Zafin in Toronto. Help optimize AI agent solutions to ensure safety, accuracy, and regulatory compliance in the banking industry. In this position, you will facilitate the evaluation of AI agents against established business, performance, and regulatory benchmarks. Your expertise in machine learning and...

About Us Appnovation is a global, full-service digital partner that combines Strategy, Experience & Design, Engineering and Managed Services. We build digital solutions that deliver real impact today and serve as foundations for future growth. Bold ambition. Practical action. Endless possibilities. Technology is foundational to all of Appnovation’s...

Appnovation Technologies in Toronto is seeking a QA / AI Evaluation Engineer to join a forward-leaning team that delivers high-quality AI-assisted solutions.You will run evaluations at scale across large question sets, measure factual grounding and accuracy lift, and build the metrics framework that shows incremental improvement. You will design load tests...

Mercor is seeking expert Evaluators in Engineering/manufacturing/technical operations to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. This is a remote, hourly engagement.Ideal candidates have 5+ years in relevant fields, fluent English, and strong proficiency with MS Office and Google Slides. A Master's degree...

Appnovation Technologies is seeking a QA / AI Evaluation Engineer to join a fast-paced, scale-driven team. You will run evaluations at scale, measure factual grounding and accuracy lift, and build metrics frameworks that show improvement.The role emphasizes automation, CI/CD integration, and collaboration with engineering to reproduce and verify fixes, while...

Appnovation is seeking a QA / AI Evaluation Engineer to join a forward-leaning team. You will run large-scale evaluations, measure factual grounding and accuracy lift, and build a metrics framework to show quality improvements over time.You will design tests, automate regressive suites, and collaborate with engineering to reproduce fixes. Strong Python,...

YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature...

Mercor is seeking expert Evaluators in Engineering/manufacturing/technical operations to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in relevant fields, fluent English, and strong proficiency with MS Office and Google Slides. A Master's...

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...

Mercor invites skilled Data Engineers to apply for a role evaluating frontier AI coding models. Leverage your data engineering skills while working on groundbreaking AI research projects. In collaboration with a leading AI lab, this opportunity focuses on evaluating and enhancing AI coding models within the Frontier Code Agents project. Data Engineers will...

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...