AI Safety Data Annotation Specialist

7 days ago

Calgary AB, Calgary Census Division, AB; Alberta, Canada Cohere Full-time

Evaluate AI safety remotely with Cohere using contextual judgment, content moderation expertise, and detailed written English evaluations. This part-time contract serves Canada and the United States.

As a Data Annotation Specialist, you will improve Large Language Model safety through labeling, ranking, auditing, prompting, and output correction. The work requires Trust & Safety, content moderation, AI model evaluation, or related experience. You will assess sensitive content against nuanced guidelines and support consistent model behavior.

Key Responsibilities:

  • Label, rank, audit, and refine human-generated and model-generated text
  • Apply safety guidelines across ambiguous and context-dependent cases
  • Create prompts, user scenarios, and adversarial safety examples
  • Identify annotation inconsistencies and provide actionable edge-case feedback
  • Complete precise tasks independently in asynchronous remote workflows

Requirements:

  • One or more years in content moderation, Trust & Safety, or AI annotation
  • Experience evaluating complex, sensitive content using detailed guidelines
  • Comfort with explicit, unsafe, toxic, or disturbing content
  • Excellent written English and clear evaluation justifications
  • Strong accuracy, consistency, time management, and independent execution

Apply safety judgment, prompt-writing skill, and annotation precision to improve Cohere's models through remote contract work.