AI Content Evaluation Analyst

2 days ago

Calgary AB, Calgary Census Division, AB; Alberta, Canada Scale AI Full-time

Review AI-generated media remotely on your own schedule, using English communication and close attention to detail. Evaluate voices, images, and videos.

Outlier, owned and operated by Scale AI, seeks detail-oriented English speakers as independent contractors. You will assess model outputs across naturalness, quality, realism, and prompt adherence. The work includes conversational voice evaluations, visual comparisons, video labeling, and evidence-based written feedback for AI systems.

Key Responsibilities:

  • Roleplay live English conversations with AI voice models
  • Compare generated images and videos against prompts
  • Inspect outputs for artifacts, errors, and unnatural motion
  • Rate adherence, quality, and realism across outputs
  • Explain evaluation decisions clearly in English

Requirements:

  • Fluent English and clear written communication
  • Strong attention to detail and patience
  • Comfort with natural conversational situations
  • Experience writing brief evidence-based reviews
  • Ability to decide between flawed alternatives

Apply careful media evaluation, conversational judgment, and precise English feedback to help Outlier improve advanced AI systems.