Senior AI Quality Engineer Machine Learning
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Lead AI quality initiatives within Sony Interactive Entertainment’s Information Security team, validating nondeterministic models and release readiness.
This senior quality engineering role supports ML-powered products and services through model monitoring, statistical evaluation, and automation. You will separate model variance from quality regressions while coordinating risks and dependencies. Collaboration spans ML, engineering, product, infrastructure, and embedded QE teams.
Key Responsibilities:
- Build automated validation for probabilistic ML and LLM outputs
- Assess ranking behavior, score distributions, and response quality
- Drive quality across complex cross-functional machine learning projects
- Perform performance and reliability testing for distributed systems
- Establish scalable quality standards, tooling, and guidelines
Requirements:
- Bachelor’s degree in Computer Science or equivalent
- Experience with AI evaluation, monitoring, or human review workflows
- Proficiency developing automation in Python, Java, or JavaScript
- Understanding of SDLC, Agile methodologies, and release processes
- Strong problem-solving, debugging, and communication skills
Lead dependable AI quality through statistical validation, risk management, and scalable automation at Sony Interactive Entertainment.
-
Senior AI
2 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Vanguard Full-timeTransform business innovation at Vanguard as a Senior AI & Machine Learning Engineer. In this role, you'll design and build scalable AI solutions that drive operational effectiveness across the enterprise. We seek a skilled candidate with a strong software engineering background and cloud expertise, particularly in AWS. You will develop production-grade...
-
Senior AI Machine Learning Test Engineer
2 days ago
southwestern ontario, on, canada | ca, Ontario Sony Full-timeShape AI quality at Sony Interactive Entertainment through Python automation, model evaluation, and testing for ML-powered services and workflows.This senior SDET role focuses on quality strategy, automation frameworks, and validation for AI-powered products. You will guide embedded QE efforts, manage dependencies, and coordinate with ML, engineering,...
-
Senior Machine Learning Engineer
2 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Fitch Full-time €150,000 - €200,000 TemporarySelect how often (in days) to receive an alert: Senior Machine Learning Engineer Requisition ID: 49238 Business Unit: Fitch Group Category: Information Technology Location: Toronto, ON, CA Date Posted: Jul 20, 2026 As one of the world’s top three credit ratings agencies, Fitch Ratings plays a critical role in global capital markets by providing...
-
Senior Machine Learning Test Engineer
8 hours ago
southwestern ontario, on, canada | ca, Ontario PlayStation Global Full-timeTest machine learning products for PlayStation in Madison or Waterloo, using Python, Java, and scalable automation to validate reliability.Sony Interactive Entertainment seeks a senior Software Development Engineer in Test, ML to lead quality efforts for machine learning products. You will work with ML engineers, software engineers, product managers, and...
-
Senior Machine Learning Test Engineer
1 hour ago
southwestern ontario, on, canada | ca, Ontario SportsTechJobs Full-timeLead machine learning quality engineering for PlayStation products from Madison, Wisconsin or Waterloo, Ontario, using Python and scalable test automation.Sony Interactive Entertainment seeks a senior Software Development Engineer in Test focused on machine learning systems. You will partner with machine learning engineers, software engineers, product...
-
Senior Machine Learning Test Engineer
5 hours ago
southwestern ontario, on, canada | ca, Ontario Sony Full-timeBuild machine learning quality strategies with Python or Java at Sony Interactive Entertainment, supporting PlayStation products from Madison or Waterloo.This senior Software Development Engineer in Test role leads validation for machine learning-powered products and services. You will partner with ML engineers, software engineers, product managers, and data...
-
Senior Machine Learning Engineer
2 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Tubi Full-time €143,600 - €205,200 TemporaryAbout The Role The Machine Learning team at Tubi drives the innovation behind personalized user experiences. With the largest inventory in the industry and hundreds of millions of viewers, we tackle problems in the space of recommendations, search, content understanding and ads optimization that shape the future of streaming. We are seeking a highly...
-
Senior Machine Learning Engineer
2 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Scientific Games, LLC Full-timeAbout Scientific Games Scientific Games: Scientific Games is the global leader in lottery games, sports betting and technology, and the partner of choice for government lotteries. From cutting-edge backend systems to exciting entertainment experiences and trailblazing retail and digital solutions, we elevate play every day. We push game designs to the next...
-
Senior Machine Learning Test Engineer
2 hours ago
southwestern ontario, on, canada | ca, Ontario PlayStation Full-timeLead machine learning quality engineering for PlayStation in Madison or Waterloo, using Python, Java, and scalable test automation.As a Senior Software Development Engineer in Test, you will validate ML-powered products and services at global scale. Partner with ML engineers, software engineers, product managers, and data partners. Build confidence in model...
-
Senior Machine Learning Test Engineer
13 hours ago
southwestern ontario, on, canada | ca, Ontario Sony Interactive Entertainment (SIE) Full-timeLead machine learning quality engineering at PlayStation in Madison or Waterloo, using Python or Java and scalable automation for global services.As a Senior Software Development Engineer in Test, ML, you will validate model reliability, production readiness, and behavioral consistency. Partner with machine learning engineers, software engineers, product...