AI Media Evaluation Specialist

5 days ago

Vancouver BC, Greater Vancouver Regional District, BC; British Columbia, Canada Scale AI Full-time

Review AI-generated media remotely on your own schedule, using fluent English, careful listening, and detailed visual analysis. Evaluate voices, images, and videos.

Outlier, an AI training platform owned and operated by Scale AI, seeks detail-oriented English speakers. You will assess model outputs, explain issues in writing, and support evaluation and feedback for advanced AI systems. The work includes conversational voice review, image and video comparison, and precise caption labeling.

Key Responsibilities:

  • Roleplay live English conversations with AI voice models
  • Rank speech for naturalness, usefulness, clarity, and pronunciation
  • Compare generated images and videos against prompts
  • Inspect outputs for artifacts, motion, text, and audio issues
  • Write evidence-based explanations for evaluation decisions

Requirements:

  • Fluent English with strong written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational situations
  • Experience writing concise reviews or explanations
  • Comfort making decisions when options have flaws

Apply your English communication, visual judgment, and audio evaluation skills to improve AI outputs with Outlier.