Senior AI Test Automation Developer

1 day ago

Toronto, Ontario, Canada Vena Full-time

Build reliable AI product testing as a Senior Software Developer in Test with Vena, working remotely from Canada on automated quality solutions.

This full-time senior role supports Vena’s agentic AI solutions within Product Development. You will develop, execute, and maintain automated tests while defining approaches for AI-powered products. The work covers model accuracy, output consistency, performance, edge cases, and product quality.

Key Responsibilities:

  • Analyze requirements and define comprehensive test strategies
  • Design and maintain automated UI and API test suites
  • Build scalable frameworks using Playwright or Rest-Assured
  • Execute exploratory, functional, integration, performance, and regression tests
  • Optimize automation pipelines, coverage, and test framework stability

Requirements:

  • Five-plus years in QA, QE, and test automation development
  • Experience testing AI/ML products, including prompt evaluation
  • Experience integrating AI tools or LLM APIs into CI/CD
  • Three-plus years with UI and API automation frameworks
  • Programming, SQL, troubleshooting, and analytical problem-solving skills

Apply your AI testing, automation framework, and quality engineering expertise to Vena’s remote Canadian product development team.