Lead Data Engineer

1 month ago

Toronto, Canada Sun Life Full time

Job Description

:

We seek an experienced and high-performing individual to join our team as a Lead Data Engineer . This senior technical leadership role is responsible for the design, building, deployment and support of data integration for BI reporting and analytic solutions, and application integration solutions using Python, AWS Glue and supporting tools and services. The Delivery team is involved in exciting projects using leading-edge technologies and leveraging our AWS Cloud based data platform for advanced analytics and data science.

IMPORTANT : Candidates must be eligible to attain Reliability Status Clearance which requires that you have lived and worked in Canada for the previous 5 consecutive years . Please do not apply if you are not able to satisfy this criteria.

What will you do?

Provide coding and design leadership on the construction and maintenance of robust and efficient data applications and reusable frameworks Develop data pipelines in an AWS Cloud environment using Python and AWS Glue (PySpark) technology Responsible for coordinating or participating in all aspects of the development cycle from design and development to release planning and implementation of data systems. Mentor and guide other data developers across various locations to ensure all code follows applicable standards and is efficient and easily maintainable Translate requirements into detailed functional and technical design using architecturally approved technology Provide high level solution options and estimates for project proposals, and detailed work estimates in support of assigned work Deliver solutions according to Systems Development Life Cycle (SDLC) methodology for either waterfall or agile projects Provide consultation for the evaluation of data and software systems. Develop and manage effective working relationships with other departments, groups or personnel with whom work must be coordinated.

What do you need to succeed?

7 to 10 years or more of up-the-ranks experience developing solutions for data warehouse loads and system integrations using  ETL tools. 2 or more years developing data pipelines using AWS Glue. Minimum 2 years of experience with Python script development using PySpark , Python libraries, configuration driven and object-oriented ETL. Demonstrated strong core competency in SQL is essential. Minimum 3 years of experience with Big Data including knowledge of Hive Experience with creating complex data frames/structures in Hadoop for data integration and complex calculations Experience with HDFS, Tez, and Spark is an asset. An understanding and/or hands-on experience with Step and Lambda functions will be an asset. Experience with data modeling concepts and data structure design for supporting high performing read SQLs. Advanced level of SQL writing skills for handling large volume of data efficiently Ability to deep dive in existing data integration code to analyze and reverse engineer. Experience with handling complex multi level data transformations to integrate source system data to deliver on business needs. Experience with production implementation change management processes Experience with project management and software development life cycle/SDLC in an Agile environment. Strong analytical skills, including conceptual, requirements interpretation, solution creation and problem-solving abilities Excellent collaboration and leadership skills and proven ability to adapt to challenges, coaching and mentoring Ability to work in a global multi-site environment and working in a matrix environment, onshore/offshore IT mode Ability to lead a team of diverse skill sets and interface with peripheral technical teams

While we strongly prefer experience with AWS (AWS Glue), in the absence of a strong candidate, we may also consider candidates from GCP (Data Fusion) or Azure (Data Factory) cloud environments.

What’s in it for you?

Great Place to Work® Certified for Most Trusted Executive Team in Canada – 2024 and 2023 Great Place to Work® Certified for Best Workplaces in Canada – 2024 and 2022 Great Place to Work® Certified for Best Workplaces for Women in Canada - 2024 Great Place to Work® Certified for Best Workplaces in Ontario - 2023 Great Place to Work® Certified in Canada in Financial Services and Insurance – 2023 Great Place to Work® list for Best Workplaces for #HybridWork – 2022 Great Place to Work® list for Best Workplaces for Professional Development in Canada – 2022 Named “Best Places to Work” by Glassdoor – 2021 and 2023 Canada Award for Excellence for Mental Health at Work - 2021 Flexible hybrid work model.

  • Data Engineer

    2 weeks ago

    Toronto, Canada NTT Data Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA). Data Engineer...

  • Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer...

  • Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create...

  • Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 276510 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our hybrid team.Data Engineer Responsibilities- (Informatica,...

  • Data Engineer

    1 week ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Data Engineer

    1 week ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Sr Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...

  • Sr Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...

  • Sr Data Engineer

    3 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276517  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA). Data Engineer...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our hybrid team. Data Engineer Responsibilities- (Informatica,...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our hybrid team.Data Engineer Responsibilities- (Informatica, Snowflake,...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our hybrid team. Data Engineer Responsibilities- (Informatica,...

  • Data Engineer

    2 weeks ago

    Toronto, Canada NTT Data Full time

    Req ID: 284206 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (Snowflake/Python) - Remote Canada Position Day to Day / Job Responsibilities: As a...

  • Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 284206 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Snowflake/Python) - Remote Canada Position Day to Day / Job Responsibilities:...

  • Data Engineering Team Lead

    1 week ago

    Toronto, Canada TechBiz Global GmbH Full time

    About TechBiz GlobalTechBiz Global is a leading recruitment and software development company. Our diverse, globally distributed team provides IT recruitment, outstaffing, outsourcing, software development, and different consulting services with a primary focus on making our partners achieve their business goals successfully.With headquarters in Germany we...

  • Lead Data Engineer

    3 weeks ago

    Toronto, Canada Ipsos Full time

    About the Team: Ipsos Global Data Management Tower serves as the backbone of Ipsos’ efforts to harness and integrate the power of data, globally. GDMT is tasked with the critical role of ensuring that data, one of the most valuable assets in the modern digital economy, is accurately collected, stores, processed, and analyzed to support decision-making...

  • Lead Data Engineer

    3 weeks ago

    Toronto, Canada Ipsos Full time

    About the Team: Ipsos Global Data Management Tower serves as the backbone of Ipsos’ efforts to harness and integrate the power of data, globally. GDMT is tasked with the critical role of ensuring that data, one of the most valuable assets in the modern digital economy, is accurately collected, stores, processed, and analyzed to support decision-making...

  • Lead Data Engineer

    2 weeks ago

    Toronto, Canada Ipsos Full time

    About the Team: Ipsos Global Data Management Tower serves as the backbone of Ipsos’ efforts to harness and integrate the power of data, globally. GDMT is tasked with the critical role of ensuring that data, one of the most valuable assets in the modern digital economy, is accurately collected, stores, processed, and analyzed to support decision-making...

  • Manager/Lead- Data Engineering

    2 months ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success. In this role, you will be responsible for leading a team of data engineers in designing,...