Senior AI Test Automation Developer
16 hours ago
Toronto, ON, Canada
Vena
Full-time
€115,000 - €155,000 Contract
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Build reliable AI product testing as a Senior Software Developer in Test with Vena, working remotely from Canada on automated quality solutions.
This full-time senior role supports Vena’s agentic AI solutions within Product Development. You will develop, execute, and maintain automated tests while defining approaches for AI-powered products. The work covers model accuracy, output consistency, performance, edge cases, and product quality.
Key Responsibilities
- Analyze requirements and define comprehensive test strategies
- Design and maintain automated UI and API test suites
- Build scalable frameworks using Playwright or Rest-Assured
- Execute exploratory, functional, integration, performance, and regression tests
- Optimize automation pipelines, coverage, and test framework stability
Requirements:
- Five-plus years in QA, QE, and test automation development
- Experience testing AI/ML products, including prompt evaluation
- Experience integrating AI tools or LLM APIs into CI/CD
- Three-plus years with UI and API automation frameworks
- Programming, SQL, troubleshooting, and analytical problem-solving skills Apply your AI testing, automation framework, and quality engineering expertise to Vena’s remote Canadian product development team.
Key Responsibilities
- Analyze requirements and define comprehensive test strategies
- Design and maintain automated UI and API test suites
- Build scalable frameworks using Playwright or Rest-Assured
- Execute exploratory, functional, integration, performance, and regression tests
- Optimize automation pipelines, coverage, and test framework stability
Requirements:
- Five-plus years in QA, QE, and test automation development
- Experience testing AI/ML products, including prompt evaluation
- Experience integrating AI tools or LLM APIs into CI/CD
- Three-plus years with UI and API automation frameworks
- Programming, SQL, troubleshooting, and analytical problem-solving skills Apply your AI testing, automation framework, and quality engineering expertise to Vena’s remote Canadian product development team.