Jobs for ai evaluation engineer at Ottawa

10,000 ai evaluation engineer job listings in Canada. Find daily updated positions from leading job boards.


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada YO AI Labs Full-time

    YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature...


  • Ottawa, ON, Canada YO AI Labs Full-time

    YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools.You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature...


  • Ottawa, ON, Canada Mercor Full-time

    Mercor is seeking expert Evaluators in Engineering/manufacturing/technical operations to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. This is a remote, hourly engagement.Ideal candidates have 5+ years in relevant fields, fluent English, and strong proficiency with MS Office and Google Slides. A Master's degree...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Mercor Full-time

    Mercor is seeking expert Evaluators in Engineering/manufacturing/technical operations to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in relevant fields, fluent English, and strong proficiency with MS Office and Google Slides. A Master's...


  • Ottawa, ON, Canada Veeva Systems Full-time

    A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Veeva Systems Full-time €85,000 - €225,000 Temporary

    A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Obsidian Full-time

    Obsidian is seeking contributors to advance frontier AI coding models through structured technical assessments. You will engage with frontier AI coding agents to perform complex data engineering tasks and evaluate model-generated data infra, pipelines, and analytics platforms. The role emphasizes identifying edge cases, scalability issues, and comparing...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Mindrift Full-time €45 Temporary

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Mindrift Full-time €45 Temporary

    A leading AI solutions company is looking for an expert to design and evaluate test scenarios for AI agents. The ideal candidate will have a Bachelor's or Master's degree in a relevant field, experience with QA and data analysis, and strong communication skills in English. This is a flexible freelance position that allows working remotely, with rates up to...


  • Ottawa, ON, Canada Obsidian Full-time

    Obsidian is seeking contributors to advance frontier AI coding models through structured technical assessments. You will engage with frontier AI coding agents to perform complex data engineering tasks and evaluate model-generated data infra, pipelines, and analytics platforms.The role emphasizes identifying edge cases, scalability issues, and comparing model...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Mindrift Full-time €38 Temporary

    A technology consultancy offering project-based opportunities seeks automotive engineers for various tasks. Applicants should have a degree in automotive engineering, along with 3+ years of experience, strong Python skills, and proficiency in English. The role involves designing engineering problems, evaluating AI solutions, and validating results. Flexible...


  • Ottawa, ON, Canada Mindrift Full-time

    This opportunity is only for candidates currently residing in the specified country. Your location may affect eligibility and rates. Please submit your resume in English and indicate your level of English. At Mindrift, innovation meets opportunity. We believe in using the power of collective human intelligence to ethically shape the future of AI. What We...


  • Ottawa, ON, Canada Mindrift Full-time

    A leading AI solutions company is looking for an expert to design and evaluate test scenarios for AI agents. The ideal candidate will have a Bachelor's or Master's degree in a relevant field, experience with QA and data analysis, and strong communication skills in English. This is a flexible freelance position that allows working remotely, with rates up to...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Workada Full-time

    Join Workada as a Remote Evaluator for AI Outputs, contributing to improving technology used daily. This full-time position focuses on evaluating various outputs for quality assurance. At Workada, we seek candidates with strong writing skills who can think critically about AI-produced content. The ideal evaluator will assess outputs from AI models against...


  • Ottawa, ON, Canada Mindrift Full-time

    A technology consultancy offering project-based opportunities seeks automotive engineers for various tasks. Applicants should have a degree in automotive engineering, along with 3+ years of experience, strong Python skills, and proficiency in English. The role involves designing engineering problems, evaluating AI solutions, and validating results. Flexible...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada DataAnnotation Full-time

    An innovative company is seeking a skilled Software Engineer to help train AI chatbots. This exciting remote role allows you to work on your own schedule while contributing to the development of cutting-edge AI technology. You'll be responsible for creating diverse coding challenges, writing high-quality code snippets, and evaluating AI-generated code for...


  • Ottawa, ON, Canada Workada Full-time

    Join Workada as a Remote Evaluator for AI Outputs, contributing to improving technology used daily. This full-time position focuses on evaluating various outputs for quality assurance. At Workada, we seek candidates with strong writing skills who can think critically about AI-produced content. The ideal evaluator will assess outputs from AI models against...


  • Ottawa, ON, Canada DataAnnotation Full-time

    An innovative company is seeking a skilled Software Engineer to help train AI chatbots. This exciting remote role allows you to work on your own schedule while contributing to the development of cutting-edge AI technology. You'll be responsible for creating diverse coding challenges, writing high-quality code snippets, and evaluating AI-generated code for...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Mercor Full-time

    About the role We are hiring expert Evaluators in Compliance / regulatory response with financial-services AI to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. Requirements...


  • Ottawa, ON, Ottawa Census Division, ON; Ontario, Canada Mercor Full-time

    Evaluate AI-generated deliverables as an Operations Planning Expert. This remote hourly position involves assessing documents for domain accuracy and rigor. We are looking for a professional with at least five years of experience in operations and capacity planning. Your role will focus on grading AI outputs for quality, requiring deep subject-matter...