ai evaluation engineer jobs in Winnipeg

10,000 ai evaluation engineer job listings in Canada. Find daily updated positions from leading job boards.


  • Winnipeg, Manitoba, Canada Velixo Full-time

    Build AI evaluation systems and cost controls for Velixo Intelligence from anywhere in Canada, with priority for Quebec candidates. Python or TypeScript skills matter. As Velixo’s Applied AI Engineer, you will replace anecdotal quality judgments with evidence for MCP-based ERP querying and governed writebacks. You will build regression suites, instrument...


  • Winnipeg, MB, Winnipeg Census Division, MB; Manitoba, Canada Turing Full-time

    Python AI evaluation engineering for Turing supports preference data, rubric design, and quality-focused model development. This fully remote contract emphasizes clear technical judgment. Turing seeks an engineer experienced with Python pipelines or TypeScript codebases. You will shape evaluation criteria, review preference data, and turn technical...


  • Winnipeg, Manitoba, Canada Turing Full-time

    Python AI evaluation engineering for Turing supports preference data, rubric design, and quality-focused model development. This fully remote contract emphasizes clear technical judgment.Turing seeks an engineer experienced with Python pipelines or TypeScript codebases. You will shape evaluation criteria, review preference data, and turn technical findings...


  • Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-time

    Evaluate AI-generated code with Python or TypeScript expertise as an independent contractor supporting Turing’s model improvement work. This experienced software engineering role focuses on reviewing coding agents across real-world repositories. You will assess correctness, robustness, maintainability, and agent behavior, then create evaluation signals...


  • Winnipeg, Manitoba, Canada G2i Inc. Full-time

    G2i Inc. is seeking a Senior Software Engineer, AI Training, to help evaluate the quality of AI-assisted coding interactions. This is a remote contract role with flexible hours and weekly commitment. You will review how models think like engineers, assess explanations, and provide clear, opinionated feedback. Strong English communication is required; prior...


  • Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-time

    Evaluate AI-generated software with Python, JavaScript, and full-stack expertise for Turing's frontier AI research initiatives. This contractor engagement requires partial PST overlap.As a Software Engineering evaluator, you will create datasets for training and benchmarking large language models with researchers. You will curate code, provide precise...


  • Winnipeg, MB, Winnipeg Census Division, MB; Manitoba, Canada Turing Enterprises, Inc. Full-time

    Evaluate AI-generated software with Python, JavaScript, and full-stack expertise for Turing’s frontier AI research initiatives. This contractor engagement requires partial PST overlap. As a Software Engineering evaluator, you will create datasets for training and benchmarking large language models with researchers. You will curate code, provide precise...


  • Winnipeg, Manitoba, Canada DataAnnotation Full-time

    Elevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world circuit and systems challenges. Apply your design and debugging skills to shape future engineering tools.DataAnnotation seeks a talented Electrical Engineer with a minimum of two years’ experience in circuit or electronics engineering. Your role involves creating...


  • Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-time

    Turing Enterprises, Inc. is seeking a Software Engineering evaluator to curate datasets for training large language models, focusing on Python backend services and ML infrastructure, with additional work in JavaScript, C/C++, Java, Rust, and Go. You will evaluate AI-generated code for efficiency and reliability, collaborate with researchers, and build...

  • AI Software Engineer

    24 hours ago


    Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-time

    Turing Enterprises, Inc. is seeking a Software Engineering Evaluator contractor to help build and refine datasets for training and benchmarking large language models. This role focuses on Python backend work and cross-language code evaluation, with exposure to JavaScript, C/C++, Java, Rust, and Go. You will collaborate with researchers and cross-functional...


  • Winnipeg, Manitoba, Canada Velixo Full-time

    About Velixo Velixo builds Excel-native reporting, planning, and automation for finance teams running Acumatica, Sage Intacct, Business Central, and MYOB. Founded in 2017 and headquartered in Montreal, we serve finance and accounting teams who live in spreadsheets and need their ERP data to be live, trustworthy, and writable.Velixo is an equal opportunity...


  • Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-time

    Python expertise anchors this flexible United States contractor engagement with Turing, focused on evaluating AI-generated code. Build reliable datasets and verification tools. As a Software Engineering evaluator, you will create datasets for training, benchmarking, and advancing large language models. The work emphasizes Python across backend services, data...


  • Winnipeg, Manitoba, Canada Scale AI Full-time

    Outlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models.About the opportunity:We are seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange,...


  • Winnipeg, Manitoba, Canada DataAnnotation Full-time

    Apply HIPAA and healthcare compliance expertise to evaluate AI answers with careful attention to privacy and regulatory risk. As a Healthcare Compliance Specialist, you will assess AI responses against HIPAA, regulatory standards, and healthcare compliance requirements. You will identify improper disclosures, incorrect retention or consent rules, and...


  • Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-time

    Use advanced mathematical reasoning to evaluate large language models remotely through flexible contract work with Turing. No AI experience is required. This contract suits pursuing or completed PhDs in Mathematics, Applied Math, Statistics, or related fields. You will design problems, develop rigorous solutions, assess AI reasoning, and provide structured...


  • Winnipeg, Manitoba, Canada DataAnnotation Full-time

    Use management consulting judgment to evaluate AI models against business problems, with flexible remote project availability through DataAnnotation. Your analysis shapes better business tools. This opportunity suits experienced Management Consultants and Strategy Consultants. You will create client-style briefs, test AI responses, and assess problem...


  • Winnipeg, MB, Canada Sustainable World, Inc. Full-time

    We are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model.In this role you will need to hold an expert level of financial reasoning- a completed or in progress Masters/PhD is preferred. Other related fields...


  • Winnipeg, Manitoba, Canada Scale AI Full-time

    Evaluate generative AI voice models remotely with fluent English, clear communication, and careful attention to conversational quality.Outlier seeks detail-oriented English speakers for freelance work training generative AI voice, image, and video models. You will assess outputs, explain findings, and make clear judgments across several quality dimensions....


  • Winnipeg, Manitoba, Canada Scale AI Full-time

    Use fluent English and careful judgment to evaluate AI voice, image, and video models remotely with flexible freelance hours. Outlier needs clear communicators who can assess generated content with precision.As an English AI Model Evaluator, you will provide human feedback that helps improve generative AI models. You may hold scenario-based conversations...


  • Winnipeg, Manitoba, Canada Intuit, Inc. Full-time

    Workada is seeking meticulous evaluators to review AI outputs across text, images, and video against established criteria. You will assess quality, identify errors, and provide clear justifications to improve system accuracy and consistency.This role suits those with experience in precise written evaluation, UI/UX design, photography, or editorial work....