Remote AI Evaluation Scenario Designer

YO AI Labs seeks a Creative & Design Specialist for remote worldwide engagement on a customer project spanning graphic design, multimedia production, UI/UX, motion graphics, and creative workflows.You will evaluate AI-generated outputs, provide high-quality human feedback, and annotate content to improve AI training. Prior paid AI human-data experience...

Workada is seeking a freelance graphic designer to evaluate outputs from AI models, text, images, and video, ensuring quality against detailed criteria. You will write clear, well-reasoned justifications for your judgments to help improve these systems.Ideal candidates write clearly, think critically, and can follow detailed written guidelines independently....

Join Workada as a Remote Graphic Design Evaluator, where you’ll enhance technology through precise assessments of AI outputs, images, and video. This full-time position, offering CA$90,000.00–CA$95,000.00 yearly, allows you to work collaboratively for outstanding customer experience.In this active role, you will engage with a dynamic Customer Experience...

Mercor is seeking expert Evaluators in Healthcare operations to review and assess AI-generated work products (documents, spreadsheets, and slide decks) for accuracy, rigor, and domain quality. This is a remote, hourly engagement.You will apply deep subject-matter expertise to grade outputs and identify factual, presentation, and aesthetic errors, delivering...

Turing is seeking Personal account generalist raters based in Canada to participate in Gemini Personalization Evaluations. You will perform generalist evaluation tasks using prompts designed to retrieve context from connected Google apps.Responsibilities include assessing AI responses for relevance, accuracy, and personalization, identifying issues, and...

Workada is hiring a remote, full-time data quality evaluator to assess AI outputs against detailed criteria. You will identify errors and inconsistencies and provide clear, well-reasoned justifications to help improve model performance.Applicants should be strong readers and writers with sound judgment, capable of following detailed guidelines independently...

Xapply is partnering with a company to hire a Senior Software Engineer, AI Training based in Canada. The role is remote and project-based, focusing on evaluating the quality of interactions with modern AI coding agents.You will assess engineering judgment, reasoning, and communication demonstrated by AI systems across technical outputs, explanations, and...

A leading cloud technology company in Toronto is seeking an experienced professional to validate and ensure the reliability of Veeva AI Agents. The ideal candidate should have expertise in data quality, prompt engineering, and proficiency in Python. This full-time role offers a competitive salary range of $85,000 - $225,000 CAD and promotes a flexible work...

YO AI Labs is seeking experienced Senior Software Engineers to support an AI training project by creating reinforcement learning environments that evaluate AI models on complex software engineering tasks using MCP tools.You will design reproducible environments, deterministic verification, and reference solutions for tasks such as bug fixing, feature...