AI Quality Engineer

3 weeks ago

Ontario ON, Canada New York Technology Partners Full time

We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features.Core Experience4-6 years as a Software Engineer, SDET, or Automation Engineer.Strong coding skills in Python, TypeScript, or Java.Hands-on experience developing automation scripts, tools, or frameworks.Practical experience using LLMs, prompt engineering, and evaluating AI-generated outputs.Familiarity with agentic AI systems and exposure to tools like LangGraph, AutoGen, or CrewAI.Basic understanding of Model Context Protocol (MCP) or context-aware workflow automation (nice to have).AI / ML TechnologiesPractical experience with AI/ML frameworks:LangChain, Hugging Face, GPT models, vector databases, RAG pipelines.Experience with ML/DL libraries such as:Scikit-learn, PyTorch, TensorFlow, Keras, Transformers, OpenCV.Ability to work with embeddings, similarity search, and content evaluation metrics.GenAI & AI Agent DevelopmentAbility to integrate or build GenAI components, including RAG pipelines or agent-based workflows.Support model evaluation tasks such as:Output quality checksHallucination detectionPrompt validationRegression checks for model updatesAutomation & Quality EngineeringExperience building automation using Python, PyTest, Selenium, Playwright, or API testing libraries.Ability to design and execute automated tests for:FunctionalIntegrationAPIBasic performance & reliability testingHands-on experience testing RESTful APIs and building automated API suites.Cloud, DevOps & CI/CDExposure to deploying AI or automation solutions on AWS.Working knowledge of CI/CD pipelines, including:Automated testingModel validation stepsVersioning & artifact managementSDLC & CollaborationStrong understanding of the software development lifecycle, including requirements, development, testing, and defect analysis.Ability to collaborate with Developers, Data Scientist, and QE teams, clearly communicating progress, risks, and results.Skilled in documenting and tracking defects and participating in defect triage.

  • AI Quality Engineer

    3 weeks ago

    Ontario (ON), Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Ontario, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • Quality Automation Engineer

    4 weeks ago

    Ontario (ON), Canada Tata Consultancy Services Full time

    Inclusion without Exception:Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our...

  • AI Quality Engineer

    3 weeks ago

    Toronto, ON, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Toronto, ON, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...

  • AI Quality Engineer

    3 weeks ago

    Toronto, ON, Canada New York Technology Partners Full time

    We are looking for a AI Quality Engineer with strong automation expertise and hands-on experience validating LLMs, GenAI workflows, and AI-driven applications. This role involves building automated test suites, validating AI outputs, ensuring system reliability, and contributing to the quality strategy for next-generation AI features. Core Experience 4-6...