AI Quality Engineer

3 weeks ago

Ontario, Canada New York Technology Partners Full time

We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6 years as a Software Engineer, SDET, or Automation Engineer. Strong coding skills in Python, TypeScript, or Java. Hands-on experience developing automation scripts, tools, or frameworks. Practical experience using LLMs, prompt engineering, and evaluating AI-generated outputs. Familiarity with agentic AI systems and exposure to tools like LangGraph, AutoGen, or CrewAI. Basic understanding of Model Context Protocol (MCP) or context-aware workflow automation (nice to have) AI / ML Technologies Practical experience with AI/ML frameworks: LangChain, Hugging Face, GPT models, vector databases, RAG pipelines. Experience with ML/DL libraries such as: Scikit-learn, PyTorch, TensorFlow, Keras, Transformers, OpenCV. Ability to work with embeddings, similarity search, and content evaluation metrics. GenAI & AI Agent Development Ability to integrate or build GenAI components, including RAG pipelines or agent-based workflows. Support model evaluation tasks such as: Output quality checks Hallucination detection, Prompt validation ,Regression checks for model updates &Automation & Quality Engineering Experience building automation using Python, PyTest, Selenium, Playwright, or API testing libraries. Ability to design and execute automated tests for: Functional Integration ,API Basic performance & reliability testing Hands-on experience testing RESTful APIs and building automated API suites. Cloud, DevOps & CI/CD Exposure to deploying AI or automation solutions on AWS. Working knowledge of CI/CD pipelines, including: Automated testing ,Model validation steps Versioning & artifact management SDLC & Collaboration

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario (ON), Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario (ON), Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features.Core Experience4-6 years...

  • Senior Software Engineer, AI Products

    2 weeks ago

    Southwestern Ontario, Canada Cambio AI Inc. Full time

    About Cambio Cambio is a software platform for world‑class real estate decarbonization. We help commercial real estate owners and tenants bring their real estate portfolios to net‑zero using a machine learning‑driven, end‑to‑end real estate sustainability platform. Our mission is to take the real estate industry into the climate action era. We are...

  • Senior Software Engineer, AI Products

    2 weeks ago

    Southwestern Ontario, Canada Cambio AI Inc. Full time

    About Cambio Cambio is a software platform for world‑class real estate decarbonization. We help commercial real estate owners and tenants bring their real estate portfolios to net‑zero using a machine learning‑driven, end‑to‑end real estate sustainability platform. Our mission is to take the real estate industry into the climate action era. We are...

  • Quality Automation Engineer

    4 weeks ago

    Ontario (ON), Canada Tata Consultancy Services Full time

    Inclusion without Exception:Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our...

  • AI Software Team Lead

    3 weeks ago

    Ontario, Canada Musashi AI North America Full time

    Musashi AI North America, Inc. is a growing hardware and software focused company that builds smart vision solutions for quality assurance in manufacturing environments. Based in Waterloo, Ontario, Musashi AI North America employs a talented and dynamic team of R&D and Applications Engineers who lead design, prototyping, and testing efforts to drive new...