Lead Data Engineer

4 weeks ago

Toronto, Canada CGI Full time

Position Description:

We are Canada's largest independent information technology services firm, and after 45 years, we're still growing Join Canada's largest IT Company as a "Lead Data Consultant - Google Cloud Platform(GCP)" in our Banking Services Division.

This role is hybrid and requires you to be at Downtown Toronto office at a minimum 2 -3 days per week - subject to change at any time.

The Google Lead Data Engineer will play a key role in standing up the Wealth Data Hub using GCP technology. The candidate will play a key role in designing and implementing the Data Hub using Google cloud components working closely with the enterprise data team and data architects, solution architects, business systems analyst and data engineers.

Your future duties and responsibilities:

•Designing, building, operationalizing the Wealth Data Hub (WDH) using Google Cloud Platform (GCP) data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner in combination with third parties such as Spark, Apache Beam/ composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage Cloud Functions & Github
•Designing and implementing data ingestion patterns that will support batch, streaming and API interface on both the Ingress and Egress.
•Guide a team of data engineers and work hands on in developing framework and custom code using best practices that will meet the demanding performance requirements
•Take a lead in designing and building production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL etc.
•Experience using Cloud Dataflow using Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery
•Building and managing data pipelines with a deep understanding of workflow orchestration, task scheduling and dependency management
•Ability to do proof of technology using GCP technologies and work with data architects, solution architects to achieve the desired results and performance.
•Provide end-to-end technical guidance and expertise on how to effectively use Google Cloud to build solutions; creatively applying cloud infrastructure and platform services to help solve business problems; and communicating these approaches to different business users
•Provide guidance on Implementing application logging, notification, jobs monitoring and performance monitoring

Required qualifications to be successful in this role:

•10+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as Google Cloud Platform (GCP) developer
•Experience with the primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub etc.
•Experience with Google Cloud Platform Databases (SQL, Spanner, PostgreSQL)
•Experience working with relational/NoSQL databases
•Experience with data streaming and technologies such as Kafka, Spark-streaming etc.
•Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform
•Knowledge of Java microservices and Spring Boot
•Strong architecture knowledge with experience in providing technical solutions for cloud infrastructure.
•Working knowledge of developing and scaling JAVA REST services, using frameworks such as Spring
•Good communication and problem-solving skills. Ability to effectively convey ideas to business and technical teams

Nice-To-Have Skills:
•Understanding of Wealth business line and the various data domains required for building an end to end solution

Education and Other requirements:
•Degree in Computer Science or related field
•Active Google Cloud Data Engineer certification or Google Professional Cloud Architect certification

#LI-GS

Skills:

Big Data DevOps Financial Services Java NoSQL Postgre SQL Real-Time Appliance Spring Boot SQL Terraform

  • Data Engineer

    1 week ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (Snowflake/Python) - Remote Canada Position Day to Day / Job Responsibilities: As a Snowflake/Python...

  • Data Engineer

    4 weeks ago

    Toronto, Canada NTT Data Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA). Data Engineer...

  • Data Engineer

    4 weeks ago

    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer...

  • Data Engineer

    1 week ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...

  • Data Engineer

    4 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create...

  • Data Engineer

    4 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 276510 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our hybrid team.Data Engineer Responsibilities- (Informatica,...

  • Senior Data Engineer

    1 week ago

    Toronto, Ontario, Canada NTT DATA Full time

    Job Description Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our hybrid team.Data Engineer Responsibilities- (Informatica, Snowflake,...

  • Data Engineer

    3 weeks ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Data Engineer

    3 weeks ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Lead Data Engineer

    1 week ago

    Toronto, Ontario, Canada Bank of Montreal Full time

    Lead Data Engineer (Global Asset Management) page is loaded Lead Data Engineer (Global Asset Management)Apply locations Toronto, ON, CAN time type Full time posted on Posted 6 Days Ago job requisition id R Application Deadline: 06/18/2024 Address: 10

  • Sr Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...

  • Sr Data Engineer

    1 month ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...

  • Sr Data Engineer

    1 week ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our hybrid team.Data Engineer Responsibilities- (Informatica, Snowflake,...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our hybrid team. Data Engineer Responsibilities- (Informatica,...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our hybrid team. Data Engineer Responsibilities- (Informatica,...

  • Lead Data Engineer

    1 week ago

    Toronto, Ontario, Canada Crypto Recruiters Full time

    We are actively searching for a Lead Data Engineer to join our team on a permanent basis. This role does require onsite work as you will be leading a team that is building a data product that will give insights to investors in the crypto and Web3 industry. In this role, you will be responsible for designing and building cutting-edge data analysis systems,...

  • Data Engineer

    4 weeks ago

    Toronto, Canada NTT Data Full time

    Req ID: 284206 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (Snowflake/Python) - Remote Canada Position Day to Day / Job Responsibilities: As a...

  • Data Engineering Team Lead

    3 weeks ago

    Toronto, Canada TechBiz Global GmbH Full time

    About TechBiz GlobalTechBiz Global is a leading recruitment and software development company. Our diverse, globally distributed team provides IT recruitment, outstaffing, outsourcing, software development, and different consulting services with a primary focus on making our partners achieve their business goals successfully.With headquarters in Germany we...