Lead / Senior Data Engineer

20 hours ago

Mississauga, Ontario, Canada Agilus Work Solutions Full time

We are seeking a Lead / Senior Data Engineer to join our retail client's growing data and analytics team.

Agilus is recruiting for a
Lead / Senior Data Engineer
in the
Retail Sector
in
a hybrid work environment in Mississauga, Ontario.
The ideal candidate will be an expert in building and optimizing large-scale data pipelines on Azure Databricks, with hands-on experience in Azure Data Factory and continuous/real-time data streaming solutions. You will work closely with data scientists, analysts, and business stakeholders to enable advanced analytics, machine learning, and retail-specific use cases such as demand forecasting, customer behavior analysis, personalization, and supply chain optimization.

A Typical Day

  • Design, develop, and maintain scalable data pipelines and architectures using Azure Databricks and Azure Data Factory.
  • Build and optimize real-time data streaming solutions (e.g., using Spark Structured Streaming, Event Hubs, Kafka, or similar).
  • Collaborate with stakeholders to translate retail business requirements into efficient technical data solutions.
  • Implement data ingestion frameworks for batch and streaming from diverse sources (e.g., ERP, CRM, POS, IoT, eCommerce).
  • Develop reusable components, frameworks, and standards to improve efficiency and consistency across data engineering practices.
  • Ensure data quality, governance, security, and compliance with industry and organizational standards.
  • Mentor junior engineers and guide best practices in coding, architecture, and cloud-native data solutions.

Requirements

  • 5+ years of data engineering experience in enterprise-scale environments, preferably in retail or consumer-focused industries.
  • Strong expertise in Azure Databricks (PySpark/Scala, Delta Lake, MLflow).
  • Proficiency with Azure Data Factory for orchestrating complex ETL/ELT workflows.
  • Proven experience with real-time/continuous data streaming frameworks (e.g., Spark Structured Streaming, Kafka, Event Hubs).
  • Solid understanding of cloud data architecture principles (data lakes, medallion architecture, CI/CD for data pipelines).
  • Advanced SQL and experience with data modeling for analytics and reporting.

What's In It For You

  • $ $85.00 hourly
  • Working with an Industry Leader on new cutting edge Projects

Soft Skills

  • Experience integrating data from SAP systems (ERP, BW, S/4HANA) into cloud platforms.
  • Knowledge of retail-specific data domains (merchandising, inventory, sales, customer loyalty, supply chain).
  • Familiarity with Azure Synapse or other modern cloud data warehouses.
  • Exposure to DevOps for data engineering (infrastructure as code, Git, CI/CD pipelines).

This posting is for an active opening.
Interested?

Please apply directly online

Agilus would like to thank all candidates for their interest in this opportunity. Due to the volume of resumes we receive; we may only be able to respond directly to those candidates being selected for an interview.

We encourage you to visit regularly or subscribe to our email alerts at as new exciting employment opportunities become available daily.

  • Senior / Lead Data Engineer

    21 hours ago

    Mississauga, Ontario, Canada McKesson Full time

    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you and those we serve – we care.What you do at McKesson matters. We foster a...

  • Senior Data Engineer

    1 day ago

    Mississauga, Ontario, Canada Itech Enterprises Full time

    Role DescriptionThis is a full-time, on-site Senior Data Engineer (Lead) role located in Mississauga, ON. The Senior Data Engineer will be responsible for designing, developing, and maintaining scalable data solutions. Key responsibilities include data modeling, implementing Extract, Transform, Load (ETL) processes, managing data pipelines, and leveraging...

  • Senior Data Engineer

    21 hours ago

    Mississauga, Ontario, Canada Global ERP Solutions Full time

    Company DescriptionGlobal ERP Solutions Inc, established in 2009, specializes in delivering comprehensive business solutions tailored for small and medium-sized companies. The company offers a wide range of services and products in the information technology field, including web and mobile application development, ERP software, AI-powered automation, CRM,...

  • Senior Data Engineer

    1 day ago

    Mississauga, Ontario, Canada IQVIA Full time

    Imagine shaping the future of healthcare through data. At IQVIA, we harness the power of advanced analytics and cutting-edge technology to improve patient outcomes worldwide. As a Senior Data Engineer, you'll lead the design of scalable data solutions, mentor talented engineers, and work on projects that truly make an impact. Join a global team that values...

  • Senior Data Engineer

    1 day ago

    Mississauga, Ontario, Canada IQVIA Full time US$93,200 - US$143,200

    Imagine shaping the future of healthcare through data. At IQVIA, we harness the power of advanced analytics and cutting-edge technology to improve patient outcomes worldwide. As a Senior Data Engineer, you'll lead the design of scalable data solutions, mentor talented engineers, and work on projects that truly make an impact. Join a global team that values...

  • Senior Data Engineer

    3 days ago

    Mississauga, Ontario, Canada Sobeys Full time

    Ready to Transform Retail? Embark on a rewarding career with Sobeys Inc., celebrated among Canada's Top 100 employers where your unique contributions drive success.Sobeys is full of exciting opportunities, and we are always looking for bright new talent to join our team We currently have a full time opportunity for a Senior Data Engineer. This role is based...

  • Data Engineering Lead

    1 day ago

    Mississauga, Ontario, Canada Cognizant Full time

    About The RoleAs aData Engineering Lead, you will make an impact by driving the modernization, optimization, and reliability of enterprise data platforms. You will be a valued member of theData Engineering & Analyticsteam and work collaboratively with engineering leads, business stakeholders, cloud architects, and cross‑functional technology teams to...

  • Data Engineering Lead

    20 hours ago

    Mississauga, Ontario, Canada Cognizant Technology Solutions Full time

    About the roleAs a Data Engineering Lead, you will make an impact by driving the modernization, optimization, and reliability of enterprise data platforms. You will be a valued member of the Data Engineering & Analytics team and work collaboratively with engineering leads, business stakeholders, cloud architects, and cross‑functional technology teams to...

  • Senior / Lead Data Architect

    1 day ago

    Mississauga, Ontario, Canada McKesson Full time

    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you and those we serve – we care.What you do at McKesson matters. We foster a...

  • Senior/Lead Data Scientist

    1 day ago

    Mississauga, Ontario, Canada McKesson Full time

    McKesson is an impact-driven, Fortune 10 company that touches virtually every aspect of healthcare. We are known for delivering insights, products, and services that make quality care more accessible and affordable. Here, we focus on the health, happiness, and well-being of you and those we serve – we care.What you do at McKesson matters. We foster a...