Senior Azure Databricks Data Engineer
2 hours ago
Winnipeg, Manitoba, Canada
Recruiting In Motion - Eastern Ontario
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Build Azure Databricks Lakehouse pipelines as a Senior Data Engineer in the Greater Toronto Area, working four days onsite and one remotely.
This senior role develops the production data and AI foundation on Azure Databricks. You will scale Medallion architecture across Bronze, Silver, and Gold layers while optimizing clusters hosted in Azure. The work includes Python, PySpark, Spark SQL, Delta Lake, and Azure SQL Server.
Key Responsibilities:
Design scalable ETL and ELT pipelines using Python and PySpark Maintain Bronze, Silver, and Gold data layers Configure Databricks clusters, workflows, and Unity Catalog governance Optimize Azure SQL Server schemas, queries, and integrations Establish automated quality checks and schema evolution standards Requirements:
Production experience building Azure Databricks Lakehouse solutions Advanced Python, PySpark, Spark SQL, and Delta Lake proficiency Hands-on Unity Catalog access control and lineage experience Azure SQL Server modeling, normalization, and query tuning knowledge Strong communication with business and executive stakeholders Apply senior Azure Databricks expertise across Lakehouse engineering, governance, SQL Server integration, and production data pipelines.
Design scalable ETL and ELT pipelines using Python and PySpark Maintain Bronze, Silver, and Gold data layers Configure Databricks clusters, workflows, and Unity Catalog governance Optimize Azure SQL Server schemas, queries, and integrations Establish automated quality checks and schema evolution standards Requirements:
Production experience building Azure Databricks Lakehouse solutions Advanced Python, PySpark, Spark SQL, and Delta Lake proficiency Hands-on Unity Catalog access control and lineage experience Azure SQL Server modeling, normalization, and query tuning knowledge Strong communication with business and executive stakeholders Apply senior Azure Databricks expertise across Lakehouse engineering, governance, SQL Server integration, and production data pipelines.