AI Media Quality Evaluator

2 days ago

Calgary AB, Calgary Census Division, AB; Alberta, Canada Scale AI Full-time

Evaluate AI-generated media with Outlier using careful English communication and close attention to detail. Work remotely on your own schedule.

Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers for AI evaluation projects. You will assess voice conversations, images, videos, captions, and audio. Your feedback helps advanced AI systems improve their performance in real-world situations.

Key Responsibilities:

  • Roleplay live English conversations with AI voice models
  • Rank speech for naturalness, usefulness, and clarity
  • Compare images and videos against prompts
  • Inspect outputs for visual, motion, text, and audio errors
  • Write specific evidence-based explanations in English

Requirements:

  • Fluent English and clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational speech
  • Experience writing concise reviews or explanations
  • Ability to decide between flawed alternatives

Apply your English communication, observational judgment, and review skills to evaluate AI-generated media for Outlier projects.