ai evaluation engineer jobs in Winnipeg
10,000 ai evaluation engineer job listings in Canada. Find daily updated positions from leading job boards.
-
AI Evaluation and Cost Engineer
2 hours ago
Winnipeg, Manitoba, Canada Velixo Full-timeBuild AI evaluation systems and cost controls for Velixo Intelligence from anywhere in Canada, with priority for Quebec candidates. Python or TypeScript skills matter. As Velixo’s Applied AI Engineer, you will replace anecdotal quality judgments with evidence for MCP-based ERP querying and governed writebacks. You will build regression suites, instrument...
-
Python AI Evaluation Engineer
6 days ago
Winnipeg, MB, Winnipeg Census Division, MB; Manitoba, Canada Turing Full-timePython AI evaluation engineering for Turing supports preference data, rubric design, and quality-focused model development. This fully remote contract emphasizes clear technical judgment. Turing seeks an engineer experienced with Python pipelines or TypeScript codebases. You will shape evaluation criteria, review preference data, and turn technical...
-
Python AI Evaluation Engineer
6 days ago
Winnipeg, Manitoba, Canada Turing Full-timePython AI evaluation engineering for Turing supports preference data, rubric design, and quality-focused model development. This fully remote contract emphasizes clear technical judgment.Turing seeks an engineer experienced with Python pipelines or TypeScript codebases. You will shape evaluation criteria, review preference data, and turn technical findings...
-
AI Coding Model Evaluation Engineer
2 hours ago
Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-timeEvaluate AI-generated code with Python or TypeScript expertise as an independent contractor supporting Turing’s model improvement work. This experienced software engineering role focuses on reviewing coding agents across real-world repositories. You will assess correctness, robustness, maintainability, and agent behavior, then create evaluation signals...
-
Senior AI Code Reviewer
2 hours ago
Winnipeg, Manitoba, Canada G2i Inc. Full-timeG2i Inc. is seeking a Senior Software Engineer, AI Training, to help evaluate the quality of AI-assisted coding interactions. This is a remote contract role with flexible hours and weekly commitment. You will review how models think like engineers, assess explanations, and provide clear, opinionated feedback. Strong English communication is required; prior...
-
Software Engineering AI Evaluator
15 hours ago
Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-timeEvaluate AI-generated software with Python, JavaScript, and full-stack expertise for Turing's frontier AI research initiatives. This contractor engagement requires partial PST overlap.As a Software Engineering evaluator, you will create datasets for training and benchmarking large language models with researchers. You will curate code, provide precise...
-
Software Engineering AI Evaluator
5 days ago
Winnipeg, MB, Winnipeg Census Division, MB; Manitoba, Canada Turing Enterprises, Inc. Full-timeEvaluate AI-generated software with Python, JavaScript, and full-stack expertise for Turing’s frontier AI research initiatives. This contractor engagement requires partial PST overlap. As a Software Engineering evaluator, you will create datasets for training and benchmarking large language models with researchers. You will curate code, provide precise...
-
Electrical Engineer for AI Evaluation
5 days ago
Winnipeg, Manitoba, Canada DataAnnotation Full-timeElevate AI advancement at DataAnnotation as an Electrical Engineer, focusing on real-world circuit and systems challenges. Apply your design and debugging skills to shape future engineering tools.DataAnnotation seeks a talented Electrical Engineer with a minimum of two years’ experience in circuit or electronics engineering. Your role involves creating...
-
Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-timeTuring Enterprises, Inc. is seeking a Software Engineering evaluator to curate datasets for training large language models, focusing on Python backend services and ML infrastructure, with additional work in JavaScript, C/C++, Java, Rust, and Go. You will evaluate AI-generated code for efficiency and reliability, collaborate with researchers, and build...
-
AI Software Engineer
24 hours ago
Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-timeTuring Enterprises, Inc. is seeking a Software Engineering Evaluator contractor to help build and refine datasets for training and benchmarking large language models. This role focuses on Python backend work and cross-language code evaluation, with exposure to JavaScript, C/C++, Java, Rust, and Go. You will collaborate with researchers and cross-functional...
-
Remote Applied AI Engineer: Evaluation
6 days ago
Winnipeg, Manitoba, Canada Velixo Full-timeAbout Velixo Velixo builds Excel-native reporting, planning, and automation for finance teams running Acumatica, Sage Intacct, Business Central, and MYOB. Founded in 2017 and headquartered in Montreal, we serve finance and accounting teams who live in spreadsheets and need their ERP data to be live, trustworthy, and writable.Velixo is an equal opportunity...
-
Python AI Code Evaluator
2 hours ago
Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-timePython expertise anchors this flexible United States contractor engagement with Turing, focused on evaluating AI-generated code. Build reliable datasets and verification tools. As a Software Engineering evaluator, you will create datasets for training, benchmarking, and advancing large language models. The work emphasizes Python across backend services, data...
-
Remote Multimodal AI Evaluator
2 hours ago
Winnipeg, Manitoba, Canada Scale AI Full-timeOutlier is an AI training platform owned and operated by Scale AI. Outlier Experts work on a variety of projects, from generating training data to evaluating the performance of models.About the opportunity:We are seeking detail-oriented English speakers to review AI-generated media. Roleplay live conversations with an AI voice model and score each exchange,...
-
Healthcare Compliance AI Evaluator
2 hours ago
Winnipeg, Manitoba, Canada DataAnnotation Full-timeApply HIPAA and healthcare compliance expertise to evaluate AI answers with careful attention to privacy and regulatory risk. As a Healthcare Compliance Specialist, you will assess AI responses against HIPAA, regulatory standards, and healthcare compliance requirements. You will identify improper disclosures, incorrect retention or consent rules, and...
-
Mathematics AI Evaluation Expert
3 hours ago
Winnipeg, Manitoba, Canada Turing Enterprises, Inc. Full-timeUse advanced mathematical reasoning to evaluate large language models remotely through flexible contract work with Turing. No AI experience is required. This contract suits pursuing or completed PhDs in Mathematics, Applied Math, Statistics, or related fields. You will design problems, develop rigorous solutions, assess AI reasoning, and provide structured...
-
Management Consultant AI Evaluator
4 hours ago
Winnipeg, Manitoba, Canada DataAnnotation Full-timeUse management consulting judgment to evaluate AI models against business problems, with flexible remote project availability through DataAnnotation. Your analysis shapes better business tools. This opportunity suits experienced Management Consultants and Strategy Consultants. You will create client-style briefs, test AI responses, and assess problem...
-
Finance - AI Model Evaluator
15 hours ago
Winnipeg, MB, Canada Sustainable World, Inc. Full-timeWe are looking for a Finance - AI Model Evaluator to help train AI models. You will measure the progress of these AI chatbots, evaluate their logic, and solve problems to improve the quality of each model.In this role you will need to hold an expert level of financial reasoning- a completed or in progress Masters/PhD is preferred. Other related fields...
-
Generative AI Voice Evaluator
15 hours ago
Winnipeg, Manitoba, Canada Scale AI Full-timeEvaluate generative AI voice models remotely with fluent English, clear communication, and careful attention to conversational quality.Outlier seeks detail-oriented English speakers for freelance work training generative AI voice, image, and video models. You will assess outputs, explain findings, and make clear judgments across several quality dimensions....
-
English AI Model Evaluator
15 hours ago
Winnipeg, Manitoba, Canada Scale AI Full-timeUse fluent English and careful judgment to evaluate AI voice, image, and video models remotely with flexible freelance hours. Outlier needs clear communicators who can assess generated content with precision.As an English AI Model Evaluator, you will provide human feedback that helps improve generative AI models. You may hold scenario-based conversations...
-
Bilingual AI Quality Evaluator
15 hours ago
Winnipeg, Manitoba, Canada Intuit, Inc. Full-timeWorkada is seeking meticulous evaluators to review AI outputs across text, images, and video against established criteria. You will assess quality, identify errors, and provide clear justifications to improve system accuracy and consistency.This role suits those with experience in precise written evaluation, UI/UX design, photography, or editorial work....