Senior AI ML Test Automation Engineer

3 days ago

Southwestern Ontario, ON, Canada PlayStation Full-time $115,000 - $172,000/year

Build AI and ML quality automation at Sony Interactive Entertainment, using Python or Java to test distributed services and inference systems. Lead quality initiatives across teams.

This senior software engineer in test role focuses on ML and AI quality for complex, cross-functional products and services. You will define test strategies, develop automation frameworks, validate model behavior, and guide release readiness. The work spans APIs, backend services, LLM workflows, and distributed systems.

Key Responsibilities:

  • Define quality strategies, test plans, and automation coverage
  • Generate and maintain test cases using LLM-assisted techniques
  • Validate rankings, scores, prompts, responses, and hallucination indicators
  • Lead risk assessment, dependency management, and release readiness
  • Integrate automated testing into CI/CD pipelines and workflows

Requirements:

  • Bachelor’s degree in Computer Science or equivalent
  • Five or more years as an SDET or QE engineer
  • Strong RESTful API, microservices, and distributed systems testing experience
  • Proficiency in Python, Java, JavaScript, or similar languages
  • Experience with AI evaluation tooling and model monitoring

Apply automation engineering, AI evaluation, debugging, and delivery ownership to quality at Sony Interactive Entertainment.