Lead Data Engineer

3 weeks ago

Toronto, Ontario, Canada Scotiabank Full time
Job Summary

We are seeking an experienced Lead Data Engineer to join our growing team within the Global Wealth Engineering (GWE) department. In this role, you will be responsible for designing, building, and maintaining scalable data architectures that support our data-driven initiatives. You will lead a team of engineers, collaborate with cross-functional teams, and ensure that our data infrastructure is robust, secure, and optimized for performance.

Key Responsibilities

- Designing, building, and operationalizing the Wealth Data Hub (WDH) using Google Cloud Platform (GCP) data services such as Data Proc, Dataflow, Cloud SQL, Big Query, Cloud Spanner, and third-party tools like Spark, Apache Beam, DBT, Cloud Pub/Sub, Confluent Kafka, Cloud Storage, and Cloud Functions.
- Leading, mentoring, and developing a team of data engineers, fostering a culture of continuous learning and technical excellence. Overseeing project timelines, resource allocation, and deliverables to ensure successful project completion. Driving the adoption of best practices in code quality, testing, and deployment.
- Designing and implementing data ingestion patterns that support batch, streaming, and API interfaces on both the Ingress and Egress.
- Leading the design and building of production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, Big Query, DBT, and SQL.
- Experience using Cloud Dataflow and Java/Python for deploying streaming jobs in GCP, as well as batch jobs using text/JSON files and writing them to Big Query.
- Ability to conduct proof of technology using GCP technologies and work with data architects and solution architects to achieve desired results and performance.
- Communicating complex technical concepts to non-technical stakeholders, providing insights and recommendations. Collaborating with the DevOps team to automate and streamline CI/CD processes for data pipelines.
- Optimizing data processing performance, ensuring high availability, scalability, and fault tolerance of data systems. Implementing monitoring and alerting mechanisms to proactively identify and resolve issues. Conducting regular performance tuning and capacity planning.

Requirements

- 10+ years of experience in data engineering, performance optimization for large OLTP applications, with a minimum of 4+ years of working experience as a Google Cloud Platform (GCP) developer.
- Proven experience leading and mentoring engineering teams.
- Experience with primary managed data services within GCP, including Data Proc, Dataflow, Big Query/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub, and third-party tools like Spark, Apache Beam, and Confluent Kafka.
- Experience with data streaming and technologies such as Kafka, Spark-streaming, and Cloud Pub/Sub.
- Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform.
- Knowledge of Java microservices and Spring Boot.
- Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
- Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams.
- Understanding of Wealth business line and various data domains required for building an end-to-end solution.
- Bachelor's or Master's degree in Computer Science, Engineering, Information Systems, or a related field.
- Active Google Cloud Data Engineer certification or Google Professional Cloud Architect certification.

What's in it for you?

- Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank.
- Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone. Scotiabank continues to locate, remove, and prevent barriers so that we can build a diverse and inclusive environment while meeting accessibility requirements.
- Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
- Competitive Rewards program including bonus, flexible vacation, personal, sick days, and benefits will start on day one.
- Dynamic Ecosystem - Free tea & coffee, universal washrooms, and lots of space for team collaboration.
- Community Engagement - No matter where you choose to work from; we offer opportunities for community engagement & belonging with our various programs such as hackathons, contests, cooking with friends, Humans of Digital, and much more.

Working Location Condition

Hybrid

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data models, data warehouses, and data pipelines to support business...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data models, data warehouses, and data pipelines to support business...

  • Senior Data Engineer

    3 weeks ago

    Old Toronto, Ontario, Canada Data Engineer Jobs Full time

    About This RoleWe are seeking a highly skilled Senior Data Engineer to join our Analytics Engineering team. As a key member of this team, you will be responsible for designing and building scalable data models and ETL pipelines to support business decisions.Key Responsibilities:Collaborate with data scientists to design data models and answer questions.Work...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job Title: Lead Data EngineerAre you a seasoned data engineer looking for a new challenge? We're seeking a highly skilled Lead Data Engineer to join our team at Scotiabank.About the RoleIn this role, you will be responsible for leading the design and implementation of data solutions to support our Capital Reporting capabilities. You will work closely with...

  • Data Engineering Lead

    1 month ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job Title: Lead Data EngineerAre you a seasoned data engineer looking for a new challenge? We're seeking a highly skilled Lead Data Engineer to join our team at Scotiabank.About the RoleIn this role, you will be responsible for leading the design and implementation of data solutions to support our Capital Reporting capabilities. You will work closely with...

  • Data Engineering Lead

    1 month ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job Title: Lead Data EngineerAre you a seasoned data engineer looking for a new challenge? We're seeking a highly skilled Lead Data Engineer to join our team at Scotiabank.About the RoleIn this role, you will be responsible for leading the design and implementation of data solutions to support our Capital Reporting capabilities. You will work closely with...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job Title: Lead Data EngineerAre you a seasoned data engineer looking for a new challenge? We're seeking a highly skilled Lead Data Engineer to join our team at Scotiabank.About the RoleIn this role, you will be responsible for leading the design and implementation of data solutions to support our Capital Reporting capabilities. You will work closely with...

  • Lead Data Engineer

    2 months ago

    Toronto, Ontario, Canada CPP Investments Full time

    {"title": "Data Engineering Opportunities at CPP Investments", "content": "Transforming Data for a Global Investment OrganizationCPP Investments is a leading institutional investor seeking a skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and deploying data...

  • Lead Data Engineer

    2 months ago

    Toronto, Ontario, Canada CPP Investments Full time

    {"title": "Data Engineering Opportunities at CPP Investments", "content": "Transforming Data for a Global Investment OrganizationCPP Investments is a leading institutional investor seeking a skilled Lead Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and deploying data...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job SummaryWe are seeking a highly skilled and motivated individual to join our dynamic Data Solutions team at Royal Bank of Canada as a Data Engineering Tech Lead.What is the Opportunity?This is an opportunity to work with a talented team of data engineers, developing and maintaining complex data systems and architectures that support business growth and...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job SummaryWe are seeking a highly skilled and motivated individual to join our dynamic Data Solutions team at Royal Bank of Canada as a Data Engineering Tech Lead.What is the Opportunity?This is an opportunity to work with a talented team of data engineers, developing and maintaining complex data systems and architectures that support business growth and...

  • Lead Data Engineer

    1 month ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job Title: Lead Data EngineerWe are seeking an experienced Lead Data Engineer to join our growing team at Scotiabank. In this role, you will be responsible for designing, building, and maintaining scalable data architectures that support our data-driven initiatives.Key Responsibilities:Designing and implementing data ingestion patterns that support batch,...

  • Lead Data Engineer

    1 month ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job Title: Lead Data EngineerWe are seeking an experienced Lead Data Engineer to join our growing team at Scotiabank. In this role, you will be responsible for designing, building, and maintaining scalable data architectures that support our data-driven initiatives.Key Responsibilities:Designing and implementing data ingestion patterns that support batch,...

  • Lead Data Engineer

    1 month ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job Title: Lead Data EngineerWe are seeking an experienced Lead Data Engineer to join our growing team at Scotiabank. As a key member of our Global Wealth Engineering team, you will be responsible for designing, building, and maintaining scalable data architectures that support our data-driven initiatives.Key Responsibilities:Design and implement data...

  • Lead Data Engineer

    1 month ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job Title: Lead Data EngineerWe are seeking an experienced Lead Data Engineer to join our growing team at Scotiabank. As a key member of our Global Wealth Engineering team, you will be responsible for designing, building, and maintaining scalable data architectures that support our data-driven initiatives.Key Responsibilities:Design and implement data...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada> Full time

    Job SummaryWe are seeking a highly skilled and motivated individual to join our dynamic team as a Data Engineering Tech Lead. As a key member of our data engineering team, you will play a crucial role in leading a team of talented data engineers to spearhead the delivery of data products to improve decision making, driven by data, and empowered by...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada> Full time

    Job SummaryWe are seeking a highly skilled and motivated individual to join our dynamic team as a Data Engineering Tech Lead. As a key member of our data engineering team, you will play a crucial role in leading a team of talented data engineers to spearhead the delivery of data products to improve decision making, driven by data, and empowered by...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada CB Canada Full time

    Job Title: Lead Data Engineering AnalystAt CB Canada, we are seeking a highly skilled Lead Data Engineering Analyst to join our team. As a key member of our data engineering team, you will be responsible for designing and developing state-of-the-art data analytics solutions for business problems.Key Responsibilities:Architect Big Data analytics frameworks...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada CB Canada Full time

    Job Title: Lead Data Engineering AnalystAt CB Canada, we are seeking a highly skilled Lead Data Engineering Analyst to join our team. As a key member of our data engineering team, you will be responsible for designing and developing state-of-the-art data analytics solutions for business problems.Key Responsibilities:Architect Big Data analytics frameworks...

  • Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada> Full time

    Job SummaryAs a key member of our data engineering team, you will play a crucial role in leading the delivery of data products to improve decision making, driven by data, and empowered by technology. Your primary focus will be on designing, implementing, and maintaining robust data infrastructure and pipelines to support our organization's data needs and...