Jobs for evaluation lead at Toronto

We are hiring an AI Quality and Evaluation Lead, Application Development! Reporting To: Assistant Vice President IT, Application Development Full-Time/Part- Time: Full-time Posting Date: August 21, 2026  Closing Date: September 21, 2026  Hours of Work: 8:30 a.m. – 5:00 p.m. Grade: Office Location:     ...

Posted Friday, August 21, 2026 at 4:00 AM | Expires Tuesday, September 22, 2026 at 3:59 AM Reporting To: Full-Time/Part- Time: Full-time Salary Range: $80,021-$128,034 Posting Date: August 21, 2026 Closing Date: September 21, 2026 Hours of Work: 8:30 a.m. – 5:00 p.m. Grade: Office Location: 14.4 Toronto Great location! Steps away from the main public...

Posted Friday, August 21, 2026 at 4:00 AM | Expires Tuesday, September 22, 2026 at 3:59 AM Reporting To: Full-Time/Part- Time: Full-time Salary Range: $80,021-$128,034 Posting Date: August 21, 2026 Closing Date: September 21, 2026 Hours of Work: 8:30 a.m. – 5:00 p.m. Grade: Office Location: 14.4 Toronto Great location! Steps away from the main public...

Zafin is an AI platform company helping regulated institutions modernize how critical work is designed, governed, and delivered. Our technology enables organizations to move faster while maintaining the governance, accountability, and control required in highly regulated environments. Our portfolio includes Zafin AIOS, an agent orchestration platform for...

Enhance social equity initiatives as a Policy Development Officer with the City of Toronto. Leverage your skills in monitoring, evaluation, and stakeholder engagement for impactful policy creation. In this influential role, you will manage complex social policy projects from conception to execution, ensuring inclusivity in every stage. You will engage...

Mercor, in partnership with a leading AI research organization, seeks a seasoned data scientist to define what excellent work looks like by designing task-specific grading criteria and scoring sample results with rigorous, written justifications.You will evaluate AI-generated and human work, ensure scores are reproducible and defensible, and incorporate...

Enhance social equity initiatives as a Policy Development Officer with the City of Toronto. Leverage your skills in monitoring, evaluation, and stakeholder engagement for impactful policy creation. In this influential role, you will manage complex social policy projects from conception to execution, ensuring inclusivity in every stage. You will engage...

1. Role OverviewMercor is partnering with a leading AI research organization to engage experienced sales engineers for a project focused on evaluating how well AI systems perform real-world technical sales work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring...

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab.You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Hindi and English.Key ResponsibilitiesCompare AI-generated lyrics with published songs to identify similaritiesRate...

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Hindi and English. Rate lyrics based on quality, creativity, prompt adherence, and originality Native or...

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in French and English. Rate lyrics based on quality, creativity, prompt adherence, and originality Native or...

Mercor is hiring experienced Musicians to evaluate generative musical AI models in partnership with a leading AI lab. You will assess model outputs across in different categories of music in your bilingual language. Key Responsibilities Evaluate AI model output lyrics, voice generation, and other standards Score quality of musical training data ...

Mercor is hiring experienced Musicians to evaluate generative musical AI models in partnership with a leading AI lab. You will assess model outputs across in different categories of music in your bilingual language. Key Responsibilities Evaluate AI model output lyrics, voice generation, and other standards Score quality of musical training data ...

Mercor is hiring experienced musicians to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Hindi and English. Key Responsibilities Compare AI-generated lyrics with published songs to identify similarities Rate...

Mercor is hiring experienced Musicians to evaluate generative musical AI models in partnership with a leading AI lab.You will assess model outputs across in different categories of music in your bilingual language.Key ResponsibilitiesEvaluate AI model output lyrics, voice generation, and other standardsScore quality of musical training dataExperience writing...

Mercor is hiring experienced Musicians to evaluate generative musical AI models in partnership with a leading AI lab.You will assess model outputs across in different categories of music in your bilingual language.Key ResponsibilitiesEvaluate AI model output lyrics, voice generation, and other standardsScore quality of musical training dataExperience writing...

Wayfair in Toronto is seeking an Associate Director of Product Management to lead the Product Discovery & Evaluation portfolio across web and app. You will recruit, coach, and develop a team of product managers, shaping a high-performing PM organization to deliver across navigation, product detail pages, promotions, and AI-powered experiences.You will...

1. Role Overview Mercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring...

Mercor is hiring experienced music producers and audio engineers to evaluate generative music AI models, in partnership with a leading AI lab. You will assess AI-generated music across a wide range of genres and rate it against detailed quality standards, working in Punjabi and English. Key Responsibilities Compare AI-generated songs head-to-head on...

1. Role OverviewMercor is partnering with a leading AI research organization to engage experienced brand designers for a project focused on evaluating how well AI systems perform real-world brand and design work. Rather than producing deliverables yourself, you will define what excellent work looks like: designing task-specific grading criteria and scoring...