Senior Data Engineer

4 weeks ago

Toronto, Canada Compunnel Inc. Full time

Duration: 6 months contract

Location: Waterloo/ Toronto ON

Payrate: $53/hr. on T4


Description

The Senior Data Engineer will play a key role by building certified data pipelines and views to be consumed by other business areas and visualization layers.

The role involves hands-on data engineering and the development of end-to-end data pipelines (processes supporting data ingestion, curation, visualization, and delivery using Microsoft Azure Data & Analytics Services). A vital skill to have will also be translation of business requirements to technical solutions, working with development teams, architects, and business analysts by applying enterprise standards, architecture, and technologies.


Responsibilities:

  • Mentor and coach data engineers on the team, providing technical guidance and leadership to build an impactful data engineering team.
  • Working with stakeholders and analysts to document and validate data sources to expand existing datamarts and warehouses.
  • Build, test, and maintain data pipelines with focus in continuous integration and fault tolerant ETL processes.
  • Design and implement performant data views and work with stakeholders through data certification and risk management process.
  • Mentor fellow engineers and spread technical knowledge within Group Benefits.
  • Growth your engineering skillset by participating in training, coaching, and code review sessions.
  • Lead the development of data integration solutions, including API integrations and data feeds.
  • Use expertise in big data and cloud computing to ensure solutions are scalable, efficient, and effective.
  • Design, develop, and implement data pipelines and ETL processes to extract, transform, and load data from various sources into Manulife's data warehouse.
  • Develop and maintain the company's data architecture, including data models, schemas, and data dictionaries.


Requirement

  • 6 + years of previous data engineering experience, with 3+ years of experience building out table structures to host multiple different data entry points to serve multiple customer needs.
  • Build, test, and maintain data pipelines with focus in continuous integration and fault tolerant ETL processes.
  • Maintain/enhance our PowerBI / SSAS datasets and C#, SSRS/SSIS Solutions.
  • Advanced experience with SQL, Stored Procedures and ETL processes using SSIS, Visual Studio and other data extraction tools.
  • Strong knowledge of Azure Databricks, ADF, ADLS, Synapse etc.
  • Hands-on experience on designing and developing scripts for ETL processes and automation in Azure data factory, Azure Databricks and PySpark using Python, Spark, and T-SQL
  • Good understanding of data modeling and ability to apply different techniques within a cloud platform.
  • Knowledge of Azure networking – Subnets, private endpoints, firewalls etc.
  • Knowledge of GIT/Jenkins – using pipelines for deployment

  • Senior Data Engineer

    4 weeks ago

    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Senior Data Engineer

    1 week ago

    Toronto, Ontario, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Canada Lorven Technologies Full time

    Job Title: Senior Data Engineer Job Location: Toronto, ON, Canada (visiting the office 3-4 days per week) Job Type: Contract 12+ Months Responsibilities: Must have overall 8+ Years of experience in Data Engineering with a bachelor’s degree Manage timelines/deliverables within the team towards the successful delivery of projects. ...

  • Senior Azure Data Engineer

    6 days ago

    Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...

  • Senior Azure Data Engineer

    7 days ago

    Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid)Term: Fulltime• Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile.• Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL• Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle.• Experience in Sqoop / Hadoop•...

  • Senior Azure Data Engineer

    6 days ago

    Toronto, Canada Epsilon Solutions Ltd. Full time

    Role: Senior Azure Data Engineer Location: Toronto, ON (Hybrid) Term: Fulltime • Azure Data Engineer (minimum 8 years exp) please do not submit any junior profile. • Azure Data Factory , Azure Data bricks Spark (PySpark or scala), SQL • Experience in Azure ingestion from on-prem source, e.g. mainframe, SQL server, Oracle. • Experience in Sqoop /...

  • Senior Data Engineer

    3 weeks ago

    Toronto, ON, Canada Tiger Analytics, LLC Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Canada ISG Search Inc Full time

    Duration: 6 months initially with chance to extend or become permanent Our Client: One of North America's most recognized and respected brands, is looking for someone to assist in their large scale business and technology transformation. Role description Looking for a Senior Data Engineer with expertise in On-Premise Data Knowledge to join a new team...

  • Senior Engineer, Data

    4 weeks ago

    Toronto, ON, Canada Deep Genomics Full time

    Deep Genomics aims to revolutionize drug development using artificial intelligence built to decode RNA biology and RNA therapeutics. Our proprietary AI platform enables us to decode the enormous complexity of RNA biology to find novel targets, mechanisms, and molecules that are not accessible through traditional methods. Founded in 2015, our...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Canada Prodigy Labs a UST Company Full time

    Data Engineer with Databricks & Spark ExperienceWe are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.ResponsibilitiesDesign, develop, and maintain data...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Canada Prodigy Labs a UST Company Full time

    Data Engineer with Databricks & Spark ExperienceWe are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.ResponsibilitiesDesign, develop, and maintain data...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Canada Prodigy Labs a UST Company Full time

    Data Engineer with Databricks & Spark ExperienceWe are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.ResponsibilitiesDesign, develop, and maintain data...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Canada Prodigy Labs a UST Company Full time

    Data Engineer with Databricks & Spark ExperienceWe are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.ResponsibilitiesDesign, develop, and maintain data...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Canada Prodigy Labs a UST Company Full time

    Data Engineer with Databricks & Spark Experience We are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business. Responsibilities Design, develop, and maintain data...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Canada theScore Full time

    About the Role & Team As part of the theScore Data Engineering team, you will be working with a team of smart, friendly, and dedicated Data Engineers, Analysts, and Data Scientists determined to develop high-quality and sustainable data-driven solutions to improve profitability, growth and the user experience. You’ll work hand in hand with the...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Canada Guidepoint Full time

    of the role: Guidepoint seeks an experienced Data Engineer as an integral member of the Toronto-based Data/AI team. The Toronto Technology Hub will serve as the base of our new Data/AI team, dedicated to building a modern data infrastructure for advanced analytics and the development of responsible AI. This strategic investment is integral to...

  • Senior Data Integration Engineer

    3 weeks ago

    Toronto, ON, Canada Lightci Full time

    Lightci (Light Consulting) is a full-service engineering & talent solution created for engineers, by engineers. We build and ship products for clients like Google, Meta, Brex, and Walmart - and help Fortune 500 companies grow by way of full team construction, staff augmentation, executive search, and tailored recruitment to address unique hiring needs. ...

  • Senior Data Engineer

    3 weeks ago

    Toronto, ON, Canada Enable International Full time

    Do you want to help design new ways of processing Enterprise scale data at speed, learn leading edge technologies, work on complex big-data algorithms, shape processes into a growing engineering organisation, all while helping to scale a Series D rocket ship to the next level? Enable is the SaaS rebate management platform that drives trusted relationships...

  • Data Analyst

    3 weeks ago

    Toronto, Canada Data SEA Consulting Full time

    Data SEA Consulting – Data Analyst Company DescriptionData SEA Consulting focuses on helping mid-sized businesses harness the power of their data by leveraging the latest analytics tools and techniques. We work with Private Equity Funds and Independent Business Owners to find the unique data solutions that will drive the most value for their business....

  • Data Analyst

    3 weeks ago

    Toronto, Canada Data SEA Consulting Full time

    Data SEA Consulting – Data Analyst Company DescriptionData SEA Consulting focuses on helping mid-sized businesses harness the power of their data by leveraging the latest analytics tools and techniques. We work with Private Equity Funds and Independent Business Owners to find the unique data solutions that will drive the most value for their business....