Senior AI Test Automation Developer

16 hours ago

Toronto, ON, Canada Vena Full-time €115,000 - €155,000 Contract
Build reliable AI product testing as a Senior Software Developer in Test with Vena, working remotely from Canada on automated quality solutions. This full-time senior role supports Vena’s agentic AI solutions within Product Development. You will develop, execute, and maintain automated tests while defining approaches for AI-powered products. The work covers model accuracy, output consistency, performance, edge cases, and product quality.

Key Responsibilities
- Analyze requirements and define comprehensive test strategies
- Design and maintain automated UI and API test suites
- Build scalable frameworks using Playwright or Rest-Assured
- Execute exploratory, functional, integration, performance, and regression tests
- Optimize automation pipelines, coverage, and test framework stability

Requirements:
- Five-plus years in QA, QE, and test automation development
- Experience testing AI/ML products, including prompt evaluation
- Experience integrating AI tools or LLM APIs into CI/CD
- Three-plus years with UI and API automation frameworks
- Programming, SQL, troubleshooting, and analytical problem-solving skills Apply your AI testing, automation framework, and quality engineering expertise to Vena’s remote Canadian product development team.