Data Engineer

2 weeks ago


Old Toronto, Ontario, Canada Scotiabank Full time
About the Role

We are seeking a highly skilled Data Engineer to join our Wealth Data Hub team at Scotiabank. As a key member of our team, you will play a critical role in designing and implementing the Wealth Data Hub using Google Cloud Platform (GCP) data services.

Key Responsibilities
  • Design and Implement Data Pipelines: Design, build, and operationalize the Wealth Data Hub using GCP data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner, and third-party tools like Spark, Apache Beam/composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage, and Cloud Functions.
  • Data Ingestion and Processing: Design and implement data ingestion patterns that support batch, streaming, and API interfaces on both the Ingress and Egress.
  • Collaboration and Leadership: Work with senior data engineers to develop a framework and custom code using best practices that meet demanding performance requirements.
  • Production Data Pipelines: Work with minimum supervision in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL, and other tools.
  • Cloud Dataflow and BigQuery: Experience using Cloud Dataflow with Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery.
  • Data Pipeline Management: Build and manage data pipelines with a deep understanding of workflow orchestration, task scheduling, and dependency management.
  • Proof of Technology: Ability to do proof of technology using GCP technologies and work with data architects and solution architects to achieve desired results and performance.
Requirements
  • Experience: 2+ years of experience in data engineering and performance optimization for large OLTP applications with a minimum of 4+ years of working experience as a Google Cloud Platform (GCP) developer.
  • Cloud Skills: Experience with primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub, and other tools.
  • Database Knowledge: Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL) and relational/NoSQL databases.
  • Streaming and IaC: Experience with data streaming and technologies like Kafka, Spark-streaming, and Infrastructure as Code (IaC) practices and frameworks like Terraform.
  • Java and Spring Boot: Knowledge of Java microservices and Spring Boot, as well as developing and scaling JAVA REST services using frameworks like Spring.
  • Communication and Problem-Solving: Good communication and problem-solving skills, with the ability to effectively convey ideas to business and technical teams.
Nice-to-Have Skills
  • Wealth Business Line: Understanding of the Wealth business line and the various data domains required for building an end-to-end solution.
  • Computer Science Degree: Degree in Computer Science or related field.
About Scotiabank

Scotiabank is a leading bank in the Americas, guided by our purpose: 'for every future'. We help our customers, their families, and their communities achieve success through a broad range of advice, products, and services, including personal and commercial banking, wealth management and private banking, corporate and investment banking, and capital markets.

We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and embraced through bias-free practices and inclusive values across Scotiabank.

We value the unique skills and experiences each individual brings to the Bank and are committed to creating and maintaining an inclusive and accessible environment for everyone.


  • Data Engineer

    1 week ago


    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesDesign and implement data pipelines deployed to our client's investment entities, ensuring high reliability, scalability, and...

  • Data Engineer

    1 week ago


    Toronto, Ontario, Canada Pacific Data Integrators Full time

    Job Title: Data EngineerPacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key Responsibilities:Design and implement data pipelines deployed to the client's investment entitiesCultivate a business relationship that assists in...

  • Data Engineer

    1 week ago


    Toronto, Ontario, Canada Pacific Data Integrators Full time

    Job Title: Data EngineerPacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key Responsibilities:Design and implement data pipelines deployed to the client's investment entitiesCultivate a business relationship that assists in...


  • Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, develop, and maintain data pipelines deployed to our client's investment entities, ensuring high levels of...


  • Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, develop, and maintain data pipelines deployed to our client's investment entities, ensuring high levels of...


  • Old Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial infrastructure platform that empowers businesses to thrive in the digital economy. With a mission to increase the GDP of the internet, we're committed to providing innovative solutions that help companies grow and succeed.About the TeamThe Growth Data Engineering team at Stripe is responsible for designing and...


  • Old Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial infrastructure platform that empowers businesses to thrive in the digital economy. With a mission to increase the GDP of the internet, we're committed to providing innovative solutions that help companies grow and succeed.About the TeamThe Growth Data Engineering team at Stripe is responsible for designing and...


  • Old Toronto, Ontario, Canada NTT DATA, Inc. Full time

    About the Role:We are seeking a highly skilled Cloud Architect DevOps Data Engineer to join our team at NTT DATA, Inc. This is a unique opportunity to work with a leading provider of digital and AI infrastructure, driving innovation and transformation for our clients.Key Responsibilities:Design and implement cloud architecture solutions, leveraging expertise...


  • Old Toronto, Ontario, Canada NTT DATA, Inc. Full time

    About the Role:We are seeking a highly skilled Cloud Architect DevOps Data Engineer to join our team at NTT DATA, Inc. This is a unique opportunity to work with a leading provider of digital and AI infrastructure, driving innovation and transformation for our clients.Key Responsibilities:Design and implement cloud architecture solutions, leveraging expertise...


  • Old Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial infrastructure platform that empowers businesses to succeed in the digital economy. With a mission to increase the GDP of the internet, Stripe provides a suite of tools that enable companies to accept payments, grow their revenue, and accelerate new business opportunities.The Growth Data Engineering TeamThe Growth...


  • Old Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial infrastructure platform that empowers businesses to succeed in the digital economy. With a mission to increase the GDP of the internet, Stripe provides a suite of tools that enable companies to accept payments, grow their revenue, and accelerate new business opportunities.The Growth Data Engineering TeamThe Growth...

  • Data Engineer

    7 days ago


    Old Toronto, Ontario, Canada BeachHead Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BeachHead Inc. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Lead the technical aspects of data engineering projects from inception to deployment.Ensure that data solutions adhere...

  • Data Engineer

    7 days ago


    Old Toronto, Ontario, Canada BeachHead Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BeachHead Inc. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data infrastructure.Key Responsibilities:Lead the technical aspects of data engineering projects from inception to deployment.Ensure that data solutions adhere...


  • Old Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial infrastructure platform for businesses, providing a range of services to help companies grow their revenue and accelerate new business opportunities.About the TeamThe Growth Data Engineering team at Stripe is responsible for managing business-critical data across the organization. We're looking for talented...


  • Old Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial infrastructure platform for businesses, providing a range of services to help companies grow their revenue and accelerate new business opportunities.About the TeamThe Growth Data Engineering team at Stripe is responsible for managing business-critical data across the organization. We're looking for talented...

  • Data Architect

    2 weeks ago


    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Pacific Data Integrators. As a key member of our team, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, develop, and maintain data pipelines deployed to our client's investment entities.Data...

  • Data Architect

    2 weeks ago


    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Pacific Data Integrators. As a key member of our team, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, develop, and maintain data pipelines deployed to our client's investment entities.Data...

  • Data Architect

    2 weeks ago


    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, implement, and maintain data pipelines deployed to our client's investment entities, ensuring high...

  • Data Architect

    2 weeks ago


    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, implement, and maintain data pipelines deployed to our client's investment entities, ensuring high...

  • Data Engineer

    3 days ago


    Old Toronto, Ontario, Canada VendorPM, Inc. Full time

    About VendorPM, Inc.We're a fast-growing Toronto-based startup that's modernizing the way vendors and property managers work together. Our industry-specific vendor management and procurement software connects over 6,000 buildings and 50,000 vendors in a single marketplace, improving efficiency and reducing costs for property managers while driving new...