Senior AI Quality Engineer Personalization

5 hours ago

Winnipeg, Manitoba, Canada Skillhub Solutions Inc. Full-time
Build trustworthy AI personalization quality at Autodesk in Toronto using TypeScript, Python, and automated testing expertise. Support reliable Autodesk Assistant experiences. As a Senior AI Quality Developer, you will support Autodesk’s Personalized Experiences Team. Your work covers recommendation systems, LLM applications, RAG, agentic systems, and AI behavior evaluation. The role requires software engineering, quality engineering, or test automation experience, with a focus on dependable AI-powered experiences. Key Responsibilities:

Design quality strategies for AI personalization and recommendation systems Build automated functional, integration, API, end-to-end, and performance frameworks Create evaluation datasets, benchmarks, regression tests, and automated pipelines Assess retrieval quality, groundedness, relevance, ranking, and response consistency Test agent workflows, tool use, orchestration, memory, and task completion Requirements:

Degree in computer science, software engineering, or related field At least six years in software or quality engineering Hands-on TypeScript and Python programming experience Experience developing automated test frameworks Knowledge of data validation, security, privacy, and Responsible AI Apply AI quality engineering, TypeScript, Python, and personalization testing to strengthen Autodesk Assistant experiences in Toronto.