Jobs for ai evaluation engineer at Calgary

YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools. You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature...

YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools.You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature...

Mercor is seeking expert Evaluators in Engineering/manufacturing/technical operations to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. This is a remote, hourly engagement.Ideal candidates have 5+ years in relevant fields, fluent English, and strong proficiency with MS Office and Google Slides. A Master's degree...

Mercor is seeking expert Evaluators in Engineering/manufacturing/technical operations to review AI-generated documents, spreadsheets, and slide decks for accuracy and domain quality. This is a remote, hourly engagement. Ideal candidates have 5+ years in relevant fields, fluent English, and strong proficiency with MS Office and Google Slides. A Master's...

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...

Obsidian is seeking a contractor to join a frontier AI coding project. You will use frontier AI coding agents to perform and evaluate complex ML engineering tasks, focusing on realistic workflows, model training, and deployment considerations. Candidates should have 2+ years in ML engineering, experience deploying ML systems, and familiarity with tools...

Join our team as a Cybersecurity Evaluator, focusing on AI-generated work assessments. This remote role demands excellence in Cybersecurity and IT GRC evaluation skills.We are looking for an experienced Evaluator with over five years in Cybersecurity or IT GRC. This position requires native fluency in English and expertise in Microsoft Office and Google...

Obsidian is seeking contributors to advance frontier AI coding models through structured technical assessments. You will engage with frontier AI coding agents to perform complex data engineering tasks and evaluate model-generated data infra, pipelines, and analytics platforms. The role emphasizes identifying edge cases, scalability issues, and comparing...

Become an integral part of Prolific's AI team as a fluent Hindi speaker. Help train AI models by completing tasks that require legal language expertise from home. Prolific is on the lookout for fluent Hindi speakers to join its Expert Network, focusing on the training and assessment of AI models. Candidates must demonstrate advanced Hindi proficiency along...

Join our team as a Cybersecurity Evaluator, focusing on AI-generated work assessments. This remote role demands excellence in Cybersecurity and IT GRC evaluation skills. We are looking for an experienced Evaluator with over five years in Cybersecurity or IT GRC. This position requires native fluency in English and expertise in Microsoft Office and Google...

About the role We are hiring expert Evaluators in Compliance / regulatory response with financial-services AI to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs. This is a remote, hourly engagement. ...

An innovative company is seeking a skilled Software Engineer to help train AI chatbots. This exciting remote role allows you to work on your own schedule while contributing to the development of cutting-edge AI technology. You'll be responsible for creating diverse coding challenges, writing high-quality code snippets, and evaluating AI-generated code for...

A tech company specializing in AI is seeking an AI Trainer based in Canada. The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling. Candidates should have experience with structured evaluation, strong writing skills, and familiarity with AI evaluation workflows. This position offers an hourly...

An innovative company is seeking a physics expert to train AI models in a flexible remote role. You will engage with AI chatbots by providing complex physics problems and assessing their logic and performance. This position allows you to work on your own schedule and choose projects that interest you. Ideal candidates will have a strong background in...

A referral company is seeking a Mathematics Specialist (Undergraduate/Master’s) to curate advanced mathematics problems for AI training. This remote role involves reviewing AI-generated solutions for quality and logical reasoning. Ideal candidates should have strong problem-solving skills, excellent communication, and be actively pursuing or holding a...

An innovative tech firm in Canada is looking for contributors with expertise in economics for flexible, part-time AI projects. Ideal candidates hold advanced degrees and have significant experience in accounting. Responsibilities include designing complex tasks for AI systems and engaging in project onboarding. This remote role offers competitive rates,...

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...

Mercor is partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work.

Who we are: McDaniel is an internationally recognized and established independent oil and gas consulting firm based in Calgary. Built off of a 70-year history, our firm provides expertise and consulting services in petroleum geology and reservoir engineering, reserves estimation, technical and resource studies, carbon capture and economic evaluations...

Mercor is seeking expert Evaluators in Process improvement / SOPs to review AI-generated documents, spreadsheets, and slide decks for accuracy, rigor, and domain quality. This is a remote, hourly engagement.You will apply deep subject-matter expertise to grade outputs against domain rubrics, identify factual, aesthetic, and presentation errors, and provide...