Azure Data engineer

Found in: Appcast CA C2 Glassdoor - 2 weeks ago


Waterloo, Canada Compunnel Inc. Full time

Requisition Title: Reports Developer III

Preferred Job Title: Senior Data Engineer

Site: CAN, Ontario, Waterloo, 500 King Street North

Location: Waterloo, Canadian Division Head Office (500 King)

Job Description

The Group Benefits Sponsor Insights and Data Services team is a diverse team that is responsible for providing accurate data, visualization, and business intelligence across the Group Benefits organization and our customers.

The Senior Data Engineer will play a key role by building certified data pipelines and views to be consumed by other business areas and visualization layers.

The role involves hands-on data engineering and the development of end-to-end data pipelines (processes supporting data ingestion, curation, visualization, and delivery using Microsoft Azure Data & Analytics Services). A vital skill to have will also be translation of business requirements to technical solutions, working with development teams, architects, and business analysts by applying enterprise standards, architecture, and technologies.

Responsibilities:

  • Mentor and coach data engineers on the team, providing technical guidance and leadership to build an impactful data engineering team.
  • Working with stakeholders and analysts to document and validate data sources to expand existing datamarts and warehouses.
  • Build, test, and maintain data pipelines with focus in continuous integration and fault tolerant ETL processes.
  • Design and implement performant data views and work with stakeholders through data certification and risk management process.
  • Mentor fellow engineers and spread technical knowledge within Group Benefits.
  • Growth your engineering skillset by participating in training, coaching, and code review sessions.
  • Lead the development of data integration solutions, including API integrations and data feeds.
  • Use expertise in big data and cloud computing to ensure solutions are scalable, efficient, and effective.
  • Design, develop, and implement data pipelines and ETL processes to extract, transform, and load data from various sources into Manulife's data warehouse.
  • Develop and maintain the company's data architecture, including data models, schemas, and data dictionaries.

How will you create impact?

You will partner with business partners in understanding data and using the data to build data marts, reports ensuring consistency to Manulife’s IT security and Risk guidelines.

What motivates you?

  • You obsess about customers, listen, engage, and act for their benefit.
  • You think big, with curiosity to discover ways to use your agile approach and enable business outcomes.
  • You thrive in teams and enjoy getting things done together.
  • You take ownership and build solutions, focusing on what matters.
  • You do what is right, work with integrity and speak up.
  • You share your humanity, helping us build a diverse and inclusive work environment for everyone.

What are we looking for?

  • 6 + years of previous data engineering experience, with 3+ years of experience building out table structures to host multiple different data entry points to serve multiple customer needs.
  • Build, test, and maintain data pipelines with focus in continuous integration and fault tolerant ETL processes.
  • Maintain/enhance our PowerBI / SSAS datasets and C#, SSRS/SSIS Solutions.
  • Advanced experience with SQL, Stored Procedures and ETL processes using SSIS, Visual Studio and other data extraction tools.
  • Strong knowledge of Azure Databricks, ADF, ADLS, Synapse etc.
  • Hands-on experience on designing and developing scripts for ETL processes and automation in Azure data factory, Azure Databricks and PySpark using Python, Spark, and T-SQL
  • Good understanding of data modeling and ability to apply different techniques within a cloud platform.
  • Knowledge of Azure networking – Subnets, private endpoints, firewalls etc.
  • Knowledge of GIT/Jenkins – using pipelines for deployment.


Brief Overview:


Internal Title: Senior Data Engineer

Should have extensive knowledge of moving pipelines where data sources reside. There is not one particular data source we’re capturing information, there are many. Need someone who can understand complex data structures. Knows programming languages, such as SQL, Python, etc. There are a couple of reports we’re running manually. Need someone with the vision of creating these reports in platforms and has knowledge of automation.


Top 3 Skills:

  • Python and SQL
  • Azure
  • Similar experience – creating reporting platforms.


Open to other industries: Nice to have financial sector and insurance data.

Ok with international experience.


Dealbreakers:

Doesn’t want long resumes—such as 5+ pages.


  • Data Analyst

    3 days ago


    Waterloo, Canada University of Waterloo Full time

    Overview: Under the direction and guidance of the Director, Strategic Initiatives and Integrated Planning (“Director”), the Data Analyst (DA) is responsible for the development of databases, models, analyses, and reporting as well as communicating the results of analyses internal and external to the Faculty of Engineering. The Data Analyst will...

  • Data Analyst

    3 days ago


    Waterloo, Canada University of Waterloo Full time

    Overview: The Data Analyst will advance the School’s use of data to inform strategic, operational, and curriculum decision-making by School leadership. The Data Analyst is responsible for sourcing, understanding, consolidating, and analyzing student and other data about the School; for effectively communicating analyses and findings; and for making related...

  • Site Reliability Engineer

    Found in: Talent CA C2 - 2 weeks ago


    Waterloo, Canada Descartes Systems Group Full time

    Descartes Unites the People and Technology that Move the World The need for efficient, secure, and agile supply chains and logistics operations has become ever more critical and complex. By combining innovative technology, powerful trade intelligence and the reach of our network, Descartes helps get goods, information, transportation assets, and people...

  • Network Engineer

    Found in: Talent CA C2 - 2 weeks ago


    Waterloo, Canada MCAP Full time

    The Role This role is responsible for the security, stability and integrity of in-house voice, data, video and wireless network services. This is achieved by planning, designing, and developing local area networks (LANs) and wide area networks (WANs) across the organization. Strategy and Planning Collaborate with the team to assess near- and...

  • Director, Enterprise Data Architecture

    Found in: Talent CA C2 - 2 weeks ago


    Waterloo, Canada Sun Life Full time

    Job Description : We seek a strategic individual contributor to join our Enterprise Data architecture team as a Director, Enterprise Data Architecture . This leadership role is responsible for designing critical enterprise data strategy in consultation with Sun Life’s business and enterprise partners, including the holistic alignment of technologies,...

  • Data Analyst

    5 days ago


    Waterloo, Canada ThinkLP Full time

    **About ThinkLP** ThinkLP imagines a world where there is zero retail crime and all companies operate safely and effectively, ensuring all employees return home at the end of the day. At ThinkLP, we are helping to drive a loss prevention industry transformation with awesome loss prevention software. The innovative ThinkLP software platform has become an...

  • Business Data Analyst

    Found in: Talent CA C2 - 2 weeks ago


    Waterloo, Canada RideCo Full time

    This is an opportunity in the exciting and fast-growing transportation technology industry. Public transit is being transformed from a system of static, scheduled fixed-routes, to a dynamic on-demand network, and you’ll be one of the pioneers shaping this transformation. You’ll join a robust and rapidly growing client success team. As a Business Data...


  • Waterloo, Canada Sandvine Full time

    **Transform the way the world runs networks**: **The Opportunity**: This position will be responsible for the implementation of product and pricing master data that align and support all the product strategies, enabling sales growth and operational efficiencies. Working with Manufacturing, Product Management, Finance, Operations and IT in order to coordinate...

  • Senior Data Scientist

    Found in: Talent CA C2 - 2 weeks ago


    Waterloo, Canada Sun Life Full time

    Job Description : Within Sun Life, the Analytics & Insights teams are comprised of savvy and intellectually curious professionals who are on a mission to transform how we apply data and analytics to support Sun Life becoming client centric. An integral part of the Analytics & Insights organization, the Data Science team supports Canadian business units in...


  • Waterloo, Canada Geosyntec Consultants Full time

    If you re looking for a place to grow your career, where you can contribute to a dynamic innovative firm, tackle challenging project work, and collaborate with industry recognized professionals - Geosyntec is the place for you! We are seeking an **Early-Career Environmental Data Technician** to work with our team of consulting scientists and engineers in...


  • Waterloo, Canada Geosyntec Consultants Full time

    If you re looking for a place to grow your career, where you can contribute to a dynamic innovative firm, tackle challenging project work, and collaborate with industry recognized professionals - Geosyntec is the place for you! We are seeking an **Early-Career Environmental Data Specialist** to work with our team of consulting scientists and engineers in...

  • Researcher - Data Security and Privacy

    Found in: Talent CA C2 - 2 weeks ago


    Waterloo, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate permanent opening for a ResearcherResponsibilities:Research, communicate, and document state-of-art in academia and industrial data security and privacy technologies.Develop prototypes of innovative data security and privacy solutions for different Huawei products like Huawei servers, Huawei laptops, mobile phones, IoT devices,...


  • Waterloo, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate permanent opening for a Researcher Responsibilities: Research, communicate, and document state-of-art in academia and industrial data security and privacy technologies.Develop prototypes of innovative data security and privacy solutions for different Huawei products like Huawei servers, Huawei laptops, mobile phones, IoT devices,...


  • Waterloo, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate permanent opening for a Researcher Responsibilities: Research, communicate, and document state-of-art in academia and industrial data security and privacy technologies.Develop prototypes of innovative data security and privacy solutions for different Huawei products like Huawei servers, Huawei laptops, mobile phones, IoT devices,...


  • Waterloo, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate permanent opening for a Researcher Responsibilities: Research, communicate, and document state-of-art in academia and industrial data security and privacy technologies.Develop prototypes of innovative data security and privacy solutions for different Huawei products like Huawei servers, Huawei laptops, mobile phones, IoT devices,...


  • Waterloo, Canada Sun Life Full time

    You are as unique as your background, experience and point of view. Here, you’ll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day, you'll...


  • Waterloo, Canada Huawei Full time

    Our team has an immediate permanent opening for a Director Responsibilities: Responsible for the technical competitiveness of the company's data and privacy protection research, a breakthrough innovation in core technical fields such as applied cryptography and privacy protection technology.Responsible for providing technical insights, transforming them into...


  • Waterloo, Canada Huawei Full time

    Our team has an immediate permanent opening for a Director Responsibilities: Responsible for the technical competitiveness of the company's data and privacy protection research, a breakthrough innovation in core technical fields such as applied cryptography and privacy protection technology.Responsible for providing technical insights, transforming them into...


  • Waterloo, Canada Huawei Full time

    Our team has an immediate permanent opening for a Director Responsibilities: Responsible for the technical competitiveness of the company's data and privacy protection research, a breakthrough innovation in core technical fields such as applied cryptography and privacy protection technology.Responsible for providing technical insights, transforming them into...

  • Software Engineer II

    Found in: Talent CA C2 - 2 weeks ago


    Waterloo, Canada Tripadvisor Full time

    We believe that we are better together, and at Tripadvisor we welcome you for who you are. Our workplace is for everyone, as is our people powered platform. At Tripadvisor, we want you to bring your unique identities, abilities, and experiences, so we can collectively revolutionize travel and together find the good out there. Imagine the impact you could...