Senior AI Test Automation Developer

2 days ago

Winnipeg, Manitoba, Canada Vena Solutions Inc. Full-time
Build reliable AI product testing as a Senior Software Developer in Test with Vena, working remotely from Canada on automated quality solutions. This full-time senior role supports Vena’s agentic AI solutions within Product Development. You will develop, execute, and maintain automated tests while defining approaches for AI-powered products. The work covers model accuracy, output consistency, performance, edge cases, and product quality. Key Responsibilities:

Analyze requirements and define comprehensive test strategies Design and maintain automated UI and API test suites Build scalable frameworks using Playwright or Rest-Assured Execute exploratory, functional, integration, performance, and regression tests Optimize automation pipelines, coverage, and test framework stability Requirements:

Five-plus years in QA, QE, and test automation development Experience testing AI/ML products, including prompt evaluation Experience integrating AI tools or LLM APIs into CI/CD Three-plus years with UI and API automation frameworks Programming, SQL, troubleshooting, and analytical problem-solving skills Apply your AI testing, automation framework, and quality engineering expertise to Vena’s remote Canadian product development team.