Azure Databricks Platform Engineer

4 hours ago

Winnipeg, Manitoba, Canada BDO Canada LLP Full-time
Engineer secure, scalable Azure data platforms with Databricks, Spark, and Delta Lake for BDO Digital’s Technology Advisory Services practice. This senior engineering role combines platform development with technical leadership across client engagements. Build reliable pipelines, automate ingestion and transformation, and support analytics and machine learning initiatives. Collaborate with data scientists, engineers, business partners, and executive leadership while converting requirements into production solutions. Key Responsibilities:

Build scalable pipelines with Databricks, Delta Lake, and Spark Automate ingestion, transformation, and validation workflows Develop integrations across cloud and on-premises data sources Convert prototypes and requirements into robust data solutions Document pipelines and promote data engineering best practices Requirements:

Degree in Computer Science, Data Engineering, Information Systems, or related field Five years of data engineering experience, including three with Databricks Strong Azure ecosystem knowledge, including Data Lake and Synapse Python and/or Scala experience with engineering libraries CI/CD, Terraform or ARM, governance, security, and compliance experience Use Azure platform engineering, Databricks development, and pipeline automation skills to deliver dependable data solutions for BDO clients.