evaluation specialist jobs in Toronto

IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder. This is a fully remote position , open to candidates based in Canada. Pay: $20–$60/hr Role Title: Evaluation Specialist/Recent Grad Role Type: Contractor...

Enhance technology at Workada by evaluating AI model outputs in a remote, full-time capacity. Contribute to data labeling that drives system accuracy and consistency.As a Data Evaluation Specialist, you'll engage in detailed assessments of various AI-generated content, ensuring quality and precision. The role is perfect for individuals with a background in...

Enhance technology at Workada by evaluating AI model outputs in a remote, full-time capacity. Contribute to data labeling that drives system accuracy and consistency. As a Data Evaluation Specialist, you'll engage in detailed assessments of various AI-generated content, ensuring quality and precision. The role is perfect for individuals with a background in...

Weekday 1 is seeking experienced professionals to evaluate GTM, RevOps, and sales materials for quality and relevance. This fully remote, independent contractor role emphasizes structured feedback and adherence to evaluation guidelines.You will review documents, assess sales strategies and revenue workflows, and provide concise, actionable recommendations....

Mercor is seeking Engineering / Platform professionals with a technical background in software engineering, infrastructure, or platform development. You will review, assess, and provide structured feedback on domain-specific documents to ensure quality, accuracy and relevance.This role suits those with strong analytical skills and domain expertise for...

1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring...

1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced data scientists for a project focused on evaluating how well AI systems perform real-world data science work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring...

Weekday 1 is seeking experienced professionals to contribute to high-impact evaluation projects across event planning and hospitality domains. You will review, assess, and provide structured feedback on documents and work products to ensure quality, accuracy, clarity, and relevance.Ideal candidates have 2+ years in event planning, hospitality, or guest...

Weekday 1 is seeking GTM/Marketing professionals to review, assess, and provide structured feedback on domain-specific documents in a fully remote contractor role.You will evaluate go-to-market strategy, campaign execution, or marketing management content, ensuring quality, accuracy, and relevance. Payments are weekly via Stripe or Wise, and projects can...

This role is for one of our clientsCompensation: $130-$180 per hourJoin a leading AI research initiative focused on advancing healthcare-focused artificial intelligence. We are seeking experienced Internal Medicine physicians to contribute their clinical expertise toward training and evaluating next-generation AI models capable of sophisticated medical...

This role is for one of our clientsCompensation: $130-$180 per hourLocation requirementsCanada, United StatesJoin a leading AI research initiative focused on advancing healthcare-focused artificial intelligence. We are seeking experienced medical professionals to contribute their clinical expertise toward training and evaluating next-generation AI models...

Mercor is seeking Engineering / Platform professionals with a technical background in software engineering, infrastructure, or platform development. You will review, assess, and provide structured feedback on domain-specific documents to ensure quality, accuracy and relevance. This role suits those with strong analytical skills and domain expertise for...

This role is for one of our clients Compensation: $130-$180 per hour Location requirements Canada, United States Join a leading AI research initiative focused on advancing healthcare-focused artificial intelligence. We are seeking experienced medical professionals to contribute their clinical expertise toward training and evaluating next-generation AI...

Mercor is seeking expert Evaluators for General Sales / GTM to review AI-generated outputs such as documents, spreadsheets, and slide decks, assessing accuracy, rigor, and domain quality. You will apply deep subject-matter expertise to grade outputs and provide structured feedback.This is a remote, hourly engagement. You will evaluate artifacts and...

A technology firm in Canada is seeking contributors for a flexible, project-based opportunity. Ideal candidates should have a strong academic background in Economics, excellent analytical skills, and advanced English proficiency (C1 or higher). This part-time, remote role involves creating complex tasks for AI training, influencing future AI models, and...

This role is for one of our clients Compensation: $130-$180 per hour Join a leading AI research initiative focused on advancing healthcare-focused artificial intelligence. We are seeking experienced Internal Medicine physicians to contribute their clinical expertise toward training and evaluating next-generation AI models capable of sophisticated medical...

Enhance public-sector effectiveness with Mercor as a Senior Civic Evaluation Specialist. Engage in designing evaluation tasks for AI systems across extensive governmental contexts. Mercor seeks experienced civic and public administration professionals skilled in developing evaluation tasks for AI systems. You will explore public-sector scenarios, create...

IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder. This is a fully remote position , open to candidates based in Canada. Pay: $40–$90/hr Role Title: Research Evaluation Specialist (PhD / Researcher /...

Mercor is seeking experienced musicians to evaluate generative music AI models in collaboration with a leading AI lab. You will assess AI-generated music across genres and rate it against detailed quality standards, working in Hindi and English.Responsibilities include comparing lyrics to published songs, rating creativity and prompt adherence, and judging...

IMPORTANT: after you apply, please check your email. We send you a link to complete your application — it is not considered until that last step is done. If you do not see it, check your spam folder. This is a fully remote position , open to candidates based in Canada. Pay: $40–$90/hr Role Title: Medical Evaluation Specialist (students, residents,...