Big Data QE

Job Description

What's the opportunity?

As part of the Global Functions Technology (GFT) within RBC's Technology and Operations division, you'll be at the heart of a team that extends its services across the organization, offering IT solutions that drive transformation and efficiency. Our collaborative efforts span various domains including Risk, Finance, HR, CAO, Audit, Legal, Compliance, Financial Crime, Capital Markets, Personal and Commercial Banking, and Wealth Management. Moreover, we're at the forefront of creating digital tools and platforms that foster better collaboration across the board.

In this dynamic environment, you'll have the opportunity to work closely with leadership that values the recognition of achievements and the sharing of insights across teams to fuel continuous improvement.

Joining our Finance IT Data As a Service team, you'll play a crucial role in overseeing Test Implementation and Test Automation on our cutting-edge Big Data Platform. This role involves working with the latest technologies and programming languages such as Cloudera, Spark, Scala, Unix, SQL, Python, and leveraging GenAI.

Your primary responsibility will be to lead the team in supporting QE Automation for our diverse client groups, alongside managing test execution. This position offers a unique chance to showcase and further develop your technical and architectural expertise, as well as your leadership capabilities, all while delivering IT solutions in a fast-paced and ever-changing business landscape.

What will you do? 

Data Pipeline Testing & Validation

• Test and validate big data pipelines from ingestion to consumption

• Perform data quality checks across HDFS, Hive, and Spark environments

• Automate ETL testing using Python (Pandas, PySpark) and SQL

• Validate data transformations, aggregations, and business rule implementations

Test Automation Development

• Build and maintain automated test suites using Robot Framework and Selenium

Data Quality Assurance

• Design and execute test strategies for large-scale data processing

• Perform data reconciliation between source and target systems

• Validate data accuracy, completeness, and consistency across environments

• Monitor and report on data quality metrics using Tableau dashboards

Big Data Technology Testing

• Test Spark jobs, Hive queries, and Yarn cluster performance

• Validate data ingestion processes and real-time streaming pipelines

• Perform load and performance testing on big data infrastructure

• Ensure data masking and privacy compliance in test environments

Advanced Responsibilities:

Innovation & Continuous Improvement

• Leverage GenAI and GitHub Copilot to enhance test automation efficiency

• Research and implement new testing tools and methodologies

• Collaborate with data engineers on testability and quality design

• Participate in code reviews for both application and test automation code

• Work within Agile/Scrum methodology with cross-functional teams

• Manage test environments and data using tools like qTest and JIRA

• Support production deployments through UrbanCode Deploy integration

What You'll Impact: As a Big Data Quality Engineer, you'll ensure the reliability and accuracy of massive data processing systems that power critical business decisions. You'll work with cutting-edge technologies, automate complex testing scenarios, and help shape the future of data quality in enterprise environments.

What You'll Need to Thrive

Essential Skills:

Technical Foundation

• Computer Science degree or equivalent + 2+ years hands-on experience

• Mastery of modern test automation stack: Robot Framework, Selenium, Jenkins, and CI/CD pipelines

Code & Automation Expertise

• Proficient in Python (Pandas, PySpark), Scala, Shell scripting, and SQL

Big Data Testing Excellence

• Deep knowledge of Hadoop ecosystem: HDFS, Hive, Yarn, Spark

• Expertise in automated testing across the full data lifecycle: ingestion → enrichment → transformation → consumption

• Strong focus on data quality, lineage validation, and performance testing at scale

Bonus Points:

Modern Development Practices

• Code review experience for both application and test automation code

• Hands-on with modern DevOps toolchain: JIRA, GitHub, Jenkins, UrbanCode Deploy, qTest

Cutting-Edge Technologies

• Experience with GenAI and GitHub Copilot for test automation enhancement

• Knowledge of data masking and privacy-focused testing approaches

• Agile/Scrum methodology implementation in QA workflows

What's in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable

• Leaders who support your development through coaching and managing opportunities

• Ability to make a difference and lasting impact

• Work in a dynamic, collaborative, progressive, and high-performing team

• A world-class training program in financial services

• Opportunities to do challenging work

• Opportunities to take on progressively greater accountabilities 

• Opportunities to building close relationships with clients

Job Skills

Application Testing, Automated Testing, Automation Technology, Big Data, Decision Making, Detail-Oriented, DevOps, Python (Programming Language), Software Development Life Cycle (SDLC), Structured Query Language (SQL), Test Automation

Additional Job Details

Address:

175 WESTERN PKY:BEDFORD

City:

Bedford

Country:

Canada

Work hours/week:

Employment Type:

Full time

Platform:

TECHNOLOGY AND OPERATIONS

Job Type:

Regular

Pay Type:

Salaried

Posted Date:

Application Deadline:

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Inclusion and Equal Opportunity Employment

At RBC, we believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities

---