Data Engineer

3 weeks ago

Toronto, Ontario, Canada Scotiabank Full time

Are you looking for a challenging role that will allow you to utilize your technical skills and experience in data engineering?

In this position, you will be responsible for designing, building, and operationalizing the Customer Profile Database using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage Cloud Functions & Github.

You will work with senior data engineers in developing framework and custom code using best practices that will meet the demanding performance requirements.

Additionally, you will work with minimum supervision in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL etc.

Experience using Cloud Dataflow using Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery is required.

Key responsibilities include:

  • Designing and implementing data ingestion patterns that will support batch, streaming and API interface on both the Ingress and Egress.
  • Building and managing data pipelines with a deep understanding of workflow orchestration, task scheduling and dependency management.
  • Ability to do proof of technology using GCP technologies and work with data architects, solution architects to achieve the desired results and performance.

Requirements include:

  • 2+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer.
  • Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.
  • Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL).
  • Experience working with relational/NoSQL databases.
  • Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
  • Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform.
  • Knowledge of Java microservices and Spring Boot.
  • Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring.
  • Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams.

What's in it for you?

At Scotiabank, we strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank.

We offer:

  • Diversity, Equity, Inclusion & Allyship.
  • Accessibility and Workplace Accommodations.
  • Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
  • Competitive Rewards program including bonus, flexible vacation, personal, sick days and benefits will start on day one.
  • Community Engagement.

Working location condition: Hybrid

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data models, data warehouses, and data pipelines to support business...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data models, data warehouses, and data pipelines to support business...

  • Senior Data Engineer

    3 weeks ago

    Old Toronto, Ontario, Canada Data Engineer Jobs Full time

    About This RoleWe are seeking a highly skilled Senior Data Engineer to join our Analytics Engineering team. As a key member of this team, you will be responsible for designing and building scalable data models and ETL pipelines to support business decisions.Key Responsibilities:Collaborate with data scientists to design data models and answer questions.Work...

  • Staff Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada NTT DATA, Inc. Full time

    Job Title: Staff Data EngineerNTT DATA Services is seeking a highly skilled Staff Data Engineer to join our team. As a Staff Data Engineer, you will design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics, and beyond within a dynamically evolving technical stack.Key...

  • Staff Data Engineer

    4 weeks ago

    Old Toronto, Ontario, Canada NTT DATA, Inc. Full time

    Job Title: Staff Data EngineerWe are seeking a highly skilled Staff Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing tailored data solutions to meet customer needs and use cases.Key Responsibilities:Provide thought leadership and recommend the most appropriate technologies...

  • Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Job Summary:We are seeking a highly skilled Staff Data Engineer with expertise in Google Cloud Platform to join our Data Intelligence team. The ideal candidate will be a growth-minded, adaptable, and collaborative individual with a strong background in designing and implementing tailored data solutions.Key Responsibilities:Provide thought leadership in...

  • Staff Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Job Title: Staff Data Engineer - Google Cloud Platform ExpertWe are seeking a highly skilled Staff Data Engineer with expertise in Google Cloud Platform to join our Data Intelligence team. As a key member of our team, you will design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics,...

  • Staff Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Job Title: Staff Data Engineer - Google Cloud Platform ExpertWe are seeking a highly skilled Staff Data Engineer with expertise in Google Cloud Platform to join our Data Intelligence team. As a key member of our team, you will design and implement tailored data solutions to meet customer needs and use cases, spanning from streaming to data lakes, analytics,...

  • Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada BBD Insights Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BBD Insights Inc. as a key member of our data engineering team.Job Description:Job Summary: As a Data Engineer, you will be responsible for designing, developing, and implementing large-scale data systems and architectures to support our business needs.Key...

  • Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada BBD Insights Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BBD Insights Inc. as a key member of our data engineering team.Job Description:Job Summary: As a Data Engineer, you will be responsible for designing, developing, and implementing large-scale data systems and architectures to support our business needs.Key...

  • Data Engineer

    2 months ago

    Toronto, Ontario, Canada CB Canada Full time

    Job Title: Data EngineerRobert Half is seeking a highly skilled Data Engineer to join our team in Canada. As a Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and solutions on Microsoft Azure's Data Platform.Key Responsibilities:Design and build data extraction, transformation, and loading processes using custom...

  • Data Engineer

    2 months ago

    Toronto, Ontario, Canada CB Canada Full time

    Job Title: Data EngineerRobert Half is seeking a highly skilled Data Engineer to join our team in Canada. As a Data Engineer, you will be responsible for designing, building, and optimizing data pipelines and solutions on Microsoft Azure's Data Platform.Key Responsibilities:Design and build data extraction, transformation, and loading processes using custom...

  • Data Engineer

    2 months ago

    Toronto, Ontario, Canada CB Canada Full time

    Job Title: Data EngineerRobert Half is seeking a highly skilled Data Engineer to join our team in Canada. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems on Microsoft Azure's Data Platform.The ideal candidate will have 2-3 years of experience in data engineering, visualization, and analytics...

  • Data Engineer

    2 months ago

    Toronto, Ontario, Canada CB Canada Full time

    Job Title: Data EngineerRobert Half is seeking a highly skilled Data Engineer to join our team in Canada. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems on Microsoft Azure's Data Platform.The ideal candidate will have 2-3 years of experience in data engineering, visualization, and analytics...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Canada CB Canada Full time

    Azure Data EngineerThe Azure Data Engineer is a technical leader in our Data & Analytics commercial data engineering team. Responsibilities include the design, build, optimization, and maintenance of experiments, prototypes, and products across the organization's Microsoft Azure's Data Platform.The incumbent will use modern and innovative technology to help...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Canada CB Canada Full time

    Azure Data EngineerThe Azure Data Engineer is a technical leader in our Data & Analytics commercial data engineering team. Responsibilities include the design, build, optimization, and maintenance of experiments, prototypes, and products across the organization's Microsoft Azure's Data Platform.The incumbent will use modern and innovative technology to help...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Canada CB Canada Full time

    Job Title: Data EngineerRobert Half is seeking a highly skilled Data Engineer to join our team in Canada. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems on Microsoft Azure's Data Platform.Key Responsibilities:Design and build data extraction, transformation, and loading processes using custom...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Canada CB Canada Full time

    Job Title: Data EngineerRobert Half is seeking a highly skilled Data Engineer to join our team in Canada. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems on Microsoft Azure's Data Platform.Key Responsibilities:Design and build data extraction, transformation, and loading processes using custom...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Canada BBD Insights Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BBD Insights Inc. as a key member of our data engineering team.Job Summary:The Data Engineer will be responsible for designing, developing, and implementing data systems and solutions to support our business needs. This includes working with our data scientists to...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Canada BBD Insights Inc. Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BBD Insights Inc. as a key member of our data engineering team.Job Summary:The Data Engineer will be responsible for designing, developing, and implementing data systems and solutions to support our business needs. This includes working with our data scientists to...