RQ00822 - Systems Testing/QA Specialist - Senior

RQ00822 - Systems Testing/QA Specialist - Senior 6 Months contract (282 Business Days)

Hybrid - Metro Hall, 55 John StreetToronto

Must-haves:

Minimum of 3 years of solid experience in AI-assisted testing with hands-on experience in developing AI-powered QA agents using agentic AI, LLM technologies and chatbot applications to create and execute test cases.

Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.

Extensive hands-on experience with all layers of testing: UI, Integration, Regression, Performance, AI-enabled systems, and User Acceptance Testing—across web-based, mobile, and cloud platforms.

Proven ability to execute AI testing activities utilizing specialized tools such as DeepEval, Applitools, Promptfoo, SaolaAI, Reflect AI, Agentic AI, Copilot Studio Kit, etc.

Experienced in SAP or Salesforce

Description Qualifications:

The Quality Assurance Specialist (QA lead) is responsible for performing application testing tasks and Quality Assurance activities including Functional Testing, Automation Testing, and various AI testing as described below.

The Quality Assurance Specialist (QA lead) will participate in planning and estimating the activities required to test the new solutions and enhanced applications. He/She will participate in the development of Master Test Plans, Test Cases, Test Scripts, Test Completion Reports, etc. while providing advice to business users for the development of Test Cases for User Acceptance Test.

Executing the tests as required, performing issue tracking and resolution.

The Quality Assurance Specialist (QA Lead) plays a critical role in ensuring the delivery of high-quality software solutions by designing, executing, and managing testing activities throughout the software development lifecycle. The QA Specialist will work collaboratively with cross-functional teams to validate system functionality, performance, and usability, and ensure alignment with business requirements and quality standards.

Key Responsibilities: Quality Assurance Leadership

Lead testing efforts for assigned projects, including planning, coordination, execution and oversight of QA activities.

Assess risks to quality based on verification and validation results and provide recommendations for mitigation.

Implement and maintain quality processes that support development and production change management.

Test Design & Planning

Design comprehensive manual and automated testing processes, including test plans, test cases, and test scripts.

Develop functional, system, regression, integration, load, and performance test scenarios based on project requirements.

Collaborate with development leads and business analysts to design and create test data to support test execution.

Test Execution & Management Perform various types of testing manually and/or using automation tools, including:

Functional Testing

Regression Testing

Integration Testing

Usability/Accessibility Testing

Performance Testing

Perform the following types of AI testing activities:

Functional AI Testing

Response accuracy

Hallucination testing

Prompt testing

AI-Security and privacy testing (prompt injection)

AI-Safety Testing (inappropriate behaviours)

Execute test cycles, monitor progress, and manage defect resolution and issue tracking.

Maintain detailed records of test results and discrepancies using designated QA tools.

Coordination & Collaboration

Work closely with project managers, implementation team, system administrators, architects, vendors (as needed) and database administrators to ensure testing activities are aligned with project timelines and technical requirements.

Lead and assist business users in conducting User Acceptance Testing (UAT), providing guidance and support as needed.

Reporting & Communication

Manage the full-cycle process for documenting and communicating test discrepancies and defects to appropriate stakeholders.

Provide regular updates on testing progress, issues, and outcomes to project teams and management

Develop and build a Test Completion Report summarizing all testing activities and results for Gating purposes

Assignment Duties:

Post-secondary degree in Computer Science, Electronic Engineering, or a related discipline.

Minimum of 10+ years of experience performing testing for large-scale applications, including on-premise web solutions, cloud-based integrations, and mobile platforms.

Minimum of 3 years of solid experience in AI-assisted testing with hands‑on experience in developing AI‑powered Q