ai evaluation engineer jobs in Toronto

Python AI evaluation engineering for Turing supports preference data, rubric design, and quality-focused model development. This fully remote contract emphasizes clear technical judgment.Turing seeks an engineer experienced with Python pipelines or TypeScript codebases. You will shape evaluation criteria, review preference data, and turn technical findings...

Python AI evaluation engineering for Turing supports preference data, rubric design, and quality-focused model development. This fully remote contract emphasizes clear technical judgment. Turing seeks an engineer experienced with Python pipelines or TypeScript codebases. You will shape evaluation criteria, review preference data, and turn technical...

Evaluate AI-generated code with Python or TypeScript expertise as an independent contractor supporting Turing’s model improvement work. This experienced software engineering role focuses on reviewing coding agents across real-world repositories. You will assess correctness, robustness, maintainability, and agent behavior, then create evaluation signals...

Applied AI Engineer — Evaluation & Reliability The problem you'd own15Rock is a financial intelligence firm. Our research goes in front of institutional investors and gets read line by line — by people looking for the one number that doesn't hold up. Every figure has to reconcile across every table and sentence; every claim has to trace to a live...

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...

Evaluate AI-generated software with Python, JavaScript, and full-stack expertise for Turing's frontier AI research initiatives. This contractor engagement requires partial PST overlap.As a Software Engineering evaluator, you will create datasets for training and benchmarking large language models with researchers. You will curate code, provide precise...

Evaluate AI-generated software with Python, JavaScript, and full-stack expertise for Turing’s frontier AI research initiatives. This contractor engagement requires partial PST overlap. As a Software Engineering evaluator, you will create datasets for training and benchmarking large language models with researchers. You will curate code, provide precise...

Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?About the opportunity:Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video...

Apply advanced physics reasoning remotely to evaluate artificial intelligence outputs and improve large language model performance. Flexible weekly contract hours support focused expert contributions. As a Physics Expert, you will help fine-tune large language models such as ChatGPT. You will design advanced problems, create rigorous solutions, and assess...

Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models.About the opportunity:We are seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange,...

Use advanced mathematical reasoning to evaluate large language models remotely through flexible contract work with Turing. No AI experience is required. This contract suits pursuing or completed PhDs in Mathematics, Applied Math, Statistics, or related fields. You will design problems, develop rigorous solutions, assess AI reasoning, and provide structured...

Turing Enterprises, Inc. is seeking a Software Engineering evaluator to curate datasets for training large language models, focusing on Python backend services and ML infrastructure, with additional work in JavaScript, C/C++, Java, Rust, and Go. You will evaluate AI-generated code for efficiency and reliability, collaborate with researchers, and build...

Workada is seeking meticulous evaluators to review AI outputs across text, images, and video against established criteria. You will assess quality, identify errors, and provide clear justifications to improve system accuracy and consistency.This role suits those with experience in precise written evaluation, UI/UX design, photography, or editorial work....

Turing Enterprises, Inc. is seeking a Software Engineering evaluator to curate datasets for training large language models, focusing on Python backend services and ML infrastructure, with additional work in JavaScript, C/C++, Java, Rust, and Go. You will evaluate AI-generated code for efficiency and reliability, collaborate with researchers, and build...

Outlier helps the world’s most innovative companies improve their AI models by providing human feedback. Are you a strong communicator with fluency in English who would like to lend your expertise to train AI models?About the opportunity:Outlier is looking for talented, detail-oriented English speakers to help train generative AI voice, image, and video...

Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities. As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical...

Cohere is seeking a Senior Research Scientist focused on AI evaluation methods to support our innovative foundation models. This remote or on-site role emphasizes creating evaluation benchmarks and tools that enhance LLM capabilities. As a Senior Research Scientist at Cohere, you will lead the development of next-generation evaluation techniques critical...

Apply advanced chemistry reasoning to evaluate artificial intelligence outputs in a fully remote contract with flexible weekly hours. No artificial intelligence experience is required. As a Chemistry Expert, you will help fine-tune large language models such as ChatGPT using chemistry knowledge. You will design advanced problems, develop rigorous solutions,...

DataAnnotation is seeking an Electrical Engineer to evaluate how frontier AI models handle real electrical and electronics engineering tasks. You will bring years of hardware design, debugging, and shipping experience to teach AI to reason about circuits and physical constraints. You’ll design challenging engineering problems, run them through AI models,...