AI Quality Engineer
3 weeks ago
OverviewWe are looking for an AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features.ResponsibilitiesBuild and maintain automated test suites for AI/ML features and GenAI workflows.Validate AI outputs and ensure system reliability and quality across AI-driven applications.Contribute to the quality strategy for next-generation AI features and capabilities.Collaborate with Developers, Data Scientists, and QE teams; clearly communicate progress, risks, and results.QualificationsCore Experience4-6 years as a Software Engineer, SDET, or Automation Engineer.Strong coding skills in Python, TypeScript, or Java.Hands-on experience developing automation scripts, tools, or frameworks.Practical experience using LLMs, prompt engineering, and evaluating AI-generated outputs.Familiarity with agentic AI systems and exposure to tools like LangGraph, AutoGen, or CrewAI.Basic understanding of Model Context Protocol (MCP) or context-aware workflow automation (nice to have).AI / ML TechnologiesPractical experience with AI/ML frameworks.Experience with ML/DL libraries such as TensorFlow, PyTorch, or equivalents.Ability to work with embeddings, similarity search, and content evaluation metrics.GenAI & AI Agent DevelopmentAbility to integrate or build GenAI components, including RAG pipelines or agent-based workflows.Support model evaluation tasks such as output quality checks.Automation & Quality EngineeringExperience building automation using Python, PyTest, Selenium, Playwright, or API testing libraries.Ability to design and execute automated tests for functional, integration, API, and basic performance & reliability testing.Hands-on experience testing RESTful APIs and building automated API suites.Cloud, DevOps & CI/CDExposure to deploying AI or automation solutions on AWS.Working knowledge of CI/CD pipelines, including automated testing.Strong understanding of the software development lifecycle, including requirements, development, testing, and defect analysis.Ability to collaborate with Developers, Data Scientists, and QE teams, clearly communicating progress, risks, and results.Skilled in documenting and tracking defects and participating in defect triage.Other InformationLocation: Toronto, Ontario, CanadaEmployment type: Full-timeJob function: Quality AssuranceIndustries: Staffing and Recruiting #J-18808-Ljbffr
-
AI Engineer
2 weeks ago
Toronto, Canada Armilla AI Full timeArmilla AI is a cutting-edge startup based in Toronto, Ontario, Canada, operating at the intersection of artificial intelligence and insurance. We're not just talking about AI risk; we're actively building the solutions to manage, underwrite, and insure it. Our dynamic team is passionate about pioneering the future of AI risk management through the...
-
AI Engineer
2 weeks ago
Toronto, Canada Armilla AI Full timeArmilla AI is a cutting-edge startup based in Toronto, Ontario, Canada, operating at the intersection of artificial intelligence and insurance. We're not just talking about AI risk; we're actively building the solutions to manage, underwrite, and insure it. Our dynamic team is passionate about pioneering the future of AI risk management through the...
-
AI Engineer
2 weeks ago
Toronto, Canada Armilla AI Full timeArmilla AI is a cutting-edge startup based in Toronto, Ontario, Canada, operating at the intersection of artificial intelligence and insurance. We're not just talking about AI risk; we're actively building the solutions to manage, underwrite, and insure it. Our dynamic team is passionate about pioneering the future of AI risk management through the...
-
Applied AI Engineer
6 days ago
Toronto, Canada Boam AI Full timeOverview Ship production ML and agentic AI powering market leaders worldwideBoam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs, data...
-
Applied AI Engineer
6 days ago
Toronto, Canada Boam AI Full timeOverview Ship production ML and agentic AI powering market leaders worldwideBoam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs, data...
-
Applied AI Engineer
4 days ago
Toronto, Canada Boam AI Full timeOverview Ship production ML and agentic AI powering market leaders worldwide Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs, data...
-
Applied AI Engineer
4 weeks ago
Toronto, Canada Boam AI Full timeJoin to apply for the Applied AI Engineer role at Boam AI Get AI-powered advice on this job and more exclusive features. Ship production ML and agentic AI powering market leaders worldwide Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always...
-
Applied AI Engineer
4 weeks ago
Toronto, Canada Boam AI Full timeJoin to apply for the Applied AI Engineer role at Boam AI Get AI-powered advice on this job and more exclusive features. Ship production ML and agentic AI powering market leaders worldwide Boam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always...
-
Applied AI Engineer
2 weeks ago
Toronto, Ontario, Canada Boam AI Full timeShip production ML and agentic AI powering market leaders worldwideBoam AI builds managed data solutions that transform messy, unstructured signals from public, private, and proprietary sources into structured, reliable, and always up-to-date intelligence on millions of SMBs and enterprises worldwide. These agentic systems power CRMs, data warehouses, AI...
-
AI Engineer
3 weeks ago
Toronto, Canada Siena AI Full timeAI Engineer We are Siena, the first intelligence layer for customer experience. We're building an operating system of AI agents that learn, remember, and act across every customer touchpoint—from support conversations to shopping experiences to voice and social media interactions. Siena doesn't just automate support; it powers shopping agents, builds...
