Sr. Site Reliability Engineer, Chaos Engineering

Job Description

What is the Opportunity?

We are seeking an experienced and innovative Lead Site Reliability Engineer (SRE) to spearhead the implementation of Chaos Engineering practices across all Digital Channels. This senior-level role is critical to ensuring the resilience, scalability, and availability of our systems in high-stress environments while driving operational excellence within the organization.

What will you do?
As the Lead SRE specialized in Chaos Engineering, your responsibilities will include:

Chaos Engineering Implementation:

• Design and execute chaos experiments using tools such as Gremlin to proactively test systems under stress.

• Simulate failure scenarios to identify potential risks and validate system behavior during degradation or outages.

• Ensure experiments yield actionable insights for improving resilience.

Assess and Validate Autoscaling:

• Analyze and validate autoscaling policies across individual systems to ensure optimal performance under variable loads.

• Collaborate with engineering teams to refine and implement dynamic scaling strategies based on experimental outcomes.

Resiliency Reporting:

• Develop comprehensive reports that outline system resiliency metrics, findings from chaos experiments, and recommendations for improvement.

• Provide insights to leadership and technical teams to guide decision-making on infrastructure updates and architectural enhancements.

High Availability Architectures:

• Embed redundancy patterns such as failover mechanisms and active-active configurations to achieve high availability across key systems.

• Lead efforts to integrate seamless failover processes during both planned and unplanned downtimes.

Collaboration and Communication:

• Act as a subject matter expert and promote Chaos Engineering practices across teams.

• Partner with DevOps, infrastructure, and application teams to ensure resilience objectives align with broader organizational goals.

• Facilitate training sessions and knowledge-sharing initiatives on Chaos Engineering concepts for technical staff.

What do you need to succeed?

Must Have:

• 5+ years of experience in Site Reliability Engineering or a related role, with a minimum of 2 years focused on Chaos Engineering.

• Hands-on experience in designing and implementing reliable, scalable, and fault-tolerant systems.

• Strong proficiency in Chaos Engineering tools like Gremlin, Chaos Monkey, or similar platforms.

• Deep understanding of cloud infrastructure (AWS, Azure, GCP) and concepts like load balancing, autoscaling, failover, and high availability.

• Proven expertise in monitoring and observability tools like Prometheus, Grafana, or Datadog.

Nice to Have:

• Excellent analytical, problem-solving, and decision-making abilities.

• Strong collaboration and communication skills to influence cross-functional teams.

• A proactive and innovative mindset to drive continuous improvements.

What's in it for you?

We thrive on the challenge to be our best, progressive thinking to keep growing, and working together to deliver trusted advice to help our clients thrive and communities prosper. We care about each other, reaching our potential, making a difference to our communities, and achieving success that is mutual.

• A comprehensive Total Rewards Program including bonuses and flexible benefits, competitive compensation, commissions, and stock where applicable

• Leaders who support your development through coaching and managing opportunities

• Ability to make a difference and lasting impact

• Work in a dynamic, collaborative, progressive, and high-performing team

• A world-class training program in financial services

• Flexible work/life balance options

• Opportunities to do challenging work

• Opportunities to take on progressively greater accountabilities 

• Opportunities to building close relationships with clients

#LI-POST

#TECHPJ

Job Skills

Chaos Engineering, Cloud Infrastructure, Site Reliability Engineering

Additional Job Details

Address:

RBC WATERPARK PLACE, 88 QUEENS QUAY W:TORONTO

City:

Toronto

Country:

Canada

Work hours/week:

Employment Type:

Full time

Platform:

TECHNOLOGY AND OPERATIONS

Job Type:

Regular

Pay Type:

Salaried

Posted Date:

Application Deadline:

Note: Applications will be accepted until 11:59 PM on the day prior to the application deadline date above

Inclusion and Equal Opportunity Employment

At RBC, we believe an inclusive workplace that has diverse perspectives is core to our continued growth as one of the largest and most successful banks in the world. Maintaining a workplace where our employees feel supported to perform at their best, effectively collaborate, drive innovation, and grow professionally helps to bring our Purpose to life and create value for our clients and communities. RBC strives to deliver this through policies and programs intended to foster a workplace based on respect, belonging and opportunity for all.

Join our Talent Community

Stay in-the-know about great career opportunities at RBC. Sign up and get customized info on our latest jobs, career tips and Recruitment events that matter to you.

Expand your limits and create a new future together at RBC. Find out how we use our passion and drive to enhance the well-being of our clients and communities

---