Remote English AI Evaluator

3 days ago

Calgary AB, Calgary Census Division, AB; Alberta, Canada Scale AI Full-time

Use fluent English and sharp attention to detail as a remote evaluator reviewing AI-generated media on your own schedule. Work independently from anywhere.

Outlier Experts support Scale AI's training platform by evaluating model performance across voice, images, video, and audio. You will roleplay conversations, compare outputs, identify artifacts, and explain findings in clear written English. This is a 1099 freelance contract opportunity.

Key Responsibilities:

  • Hold scenario-based conversations with AI voice models
  • Compare generated images and videos against prompts
  • Inspect outputs for visual, motion, text, and audio problems
  • Rate adherence, quality, realism, and naturalness
  • Write specific evidence-based explanations in English

Requirements:

  • Fluent English and clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational speech
  • Experience writing short reviews or explanations
  • Valid identification and mobile phone

Bring careful observation, conversational English, and evidence-based judgment to Outlier's AI evaluation projects remotely.