program evaluation specialist jobs in Montreal

Enhance AI accuracy in accounting with DataAnnotation as an Accountant AI Evaluation Specialist. This remote role focuses on grading AI outputs and ensuring they meet professional standards. As an AI Evaluation Specialist, you will assess AI-generated accounting answers, ensuring adherence to thorough bookkeeping and reporting standards. Your expertise will...

AI Evaluation SpecialistRole Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New ZealandWe are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project.You'll evaluate AI-generated responses using defined quality standards, identify issues, and...

Commitment: Flexible schedule with ongoing project-based workRole ResponsibilitiesReview and evaluate project deliverables with high attention to detailProvide structured feedback to improve quality and accuracyAssess outputs against established guidelines and standardsSupport AI research initiatives through careful analysis and review workMaintain...

JOB SUMMARYThe Program Specialist provides administrative, project support data management, and support to coordinate communications to HealthCare Providers, client and front-line staff on behalf of the Program and Management team. This role supports patients and the program, contributes to project planning and execution, oversees reporting tasks, and...

A technology firm in Canada is seeking contributors for a flexible, project-based opportunity. Ideal candidates should have a strong academic background in Economics, excellent analytical skills, and advanced English proficiency (C1 or higher). This part-time, remote role involves creating complex tasks for AI training, influencing future AI models, and...

Join as an AI Evaluation Specialist, offering flexibility in your schedule while evaluating project deliverables. Your attention to detail will enhance the accuracy of AI initiatives.This role emphasizes reviewing and assessing project outputs with a critical eye. Strong communication and analytical skills are essential as you provide structured feedback...

A tech company specializing in AI is seeking an AI Trainer based in Canada. The role involves improving large language models through RLHF-style evaluations, prompt evaluation, and data labeling. Candidates should have experience with structured evaluation, strong writing skills, and familiarity with AI evaluation workflows. This position offers an hourly...

Mercor is recruiting for a remote contract role focused on document review and evaluation. You will review domain-specific documents, provide structured feedback, and collaborate with teams to raise standards and guidelines.Ideal candidates have a Bachelor's degree and 2+ years of professional experience, with strong skills in Excel, PowerPoint and Word,...

Become a freelance Portuguese Audio Evaluations Specialist with a partner company in Canada. Leverage your language skills to enhance conversational AI through realistic customer support evaluations. This remote role involves creating complex simulation scenarios in travel, finance, and tech sectors. You will design and conduct evaluations of AI-generated...

Enhance AI accuracy in accounting with DataAnnotation as an Accountant AI Evaluation Specialist. This remote role focuses on grading AI outputs and ensuring they meet professional standards. As an AI Evaluation Specialist, you will assess AI-generated accounting answers, ensuring adherence to thorough bookkeeping and reporting standards. Your expertise will...

International Civil Aviation Organization in Montreal seeks an expert evaluator to lead an independent mid-term evaluation of its 2026–2028 Business Plan. The consultant will assess relevance, coherence, efficiency and sustainability, aligning with ICAO’s strategic plan and governance framework. The role requires a Masters or equivalent, at least ten...

About Role:Core Responsibilities Lead and manage supply chain programs such as inventory analysis, demand planning, import/export operations, operations planning (SOP), and contract lifecycle management Drive negotiations with external partners and suppliers to secure favorable terms, improve lead times, and reduce inventory costs. Monitor program health...

AI Evaluation Specialist Role Type: ContractorLocation: Remote — US, Canada, UK, Ireland, Australia, New Zealand We are seeking experienced AI Evaluation Specialists to assess and improve the quality of AI assistant outputs for an enterprise AI training project. You'll evaluate AI-generated responses using defined quality standards, identify issues, and...

YO AI Labs is seeking an AI Evaluation Specialist to assess and improve AI assistant outputs for an enterprise training project. This remote contractor role focuses on applying rubrics for accuracy, relevance, and adherence to guidelines, with feedback that informs system improvements.You will work independently on large datasets, identify gaps, document...

Outlier is seeking detail-oriented English speakers to help train AI models by evaluating live conversations, images, and videos. This remote, freelance role offers flexible hours and the chance to contribute to cutting-edge AI research.You will listen to AI-generated scenarios in English, rate performance, compare outputs, and provide concise,...

Outlier is seeking detail-oriented, fluent English speakers to help train AI models via live conversations and scoring. You will rate naturalness, usefulness, and clarity, then provide concise English explanations. This freelance, remote role offers flexible hours and a quick onboarding process.Contributors work on tasks such as ranking AI voice, image, and...

Outlier is seeking detail-oriented, fluent English speakers to help train AI models by evaluating live conversations and multimedia outputs. This freelance, remote role offers flexible hours and the chance to contribute to cutting-edge AI research.You will rate naturalness, usefulness, and clarity of AI voice models, compare AI-generated images and videos,...

Outlier is seeking freelance English-speaking contributors to help train AI models by evaluating live conversations, ranking how natural and clear each utterance sounds, and judging AI-generated images and videos for adherence to prompts.You’ll need a quiet workspace, reliable internet, and the ability to explain your judgments in clear English. This...

YO AI Labs seeks a Creative & Design Specialist for remote worldwide engagement on a customer project spanning graphic design, multimedia production, UI/UX, motion graphics, and creative workflows.You will evaluate AI-generated outputs, provide high-quality human feedback, and annotate content to improve AI training. Prior paid AI human-data experience is...

Outlier is seeking detail-oriented English speakers to help train AI models through live conversations, image and video comparison, and meticulous evaluation. You will assess naturalness, usefulness, and clarity of AI outputs and provide concise explanations in English.Quiet, remote, flexible hours are offered for this freelance opportunity. Onboarding may...