Databricks Engineer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
The Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.
This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.
The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and high-performance data solutions that support analytics, BI, and business initiatives.
Key Responsibilities
- Build and maintain scalable ETL/ELT data pipelines using Databricks.
- Use PySpark/Spark and SQL to process, cleanse, and transform large datasets.
- Integrate data from diverse sources such as Azure Blob Storage, ADLS, and relational/non-relational databases.
- Work with teams across the organization to prepare data for BI dashboards and reporting tools.
- Partner with business stakeholders to understand requirements and deliver tailored data solutions.
Performance & Optimization
- Optimize Databricks workloads for performance, scalability, and cost efficiency.
- Monitor, troubleshoot, and resolve issues in data pipelines to ensure accuracy and reliability.
Governance & Security
- Implement data governance, access controls, and security frameworks using Unity Catalog.
- Ensure compliance with enterprise data policies and regulatory standards.
Deployment
- Use Databricks Asset Bundles for deploying jobs, notebooks, and configurations across environments.
- Maintain version control for Databricks artifacts and collaborate with the team on development best practices.
Required Qualifications
- 10+ years of overall experience in data engineering.
- Recent experience in financial services, banking, or capital markets.
- Strong expertise in Databricks, including:
- Unity Catalog
- Lakehouse Architecture
- Table Triggers
- Databricks Runtime
- Proficiency with Azure cloud services.
- Deep understanding of Spark and PySpark for big data processing.
- Strong programming skills in Python.
- Experience with relational databases.
- Knowledge of Databricks Asset Bundles and GitLab for version control.
Preferred Qualifications
- Familiarity with advanced Databricks Runtime configurations.
- Experience with streaming frameworks such as Spark Streaming.
-
Databricks Engineer
3 days ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada Compunnel Inc. Full-timeThe Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services. This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering. The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and...
-
Sr Databricks Engineer
3 hours ago
Mississauga, Ontario, Canada Synechron Full-timeThis range is provided by Synechron. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more.Base pay range$130,000.00/yr - $135,000.00/yrDirect message the job poster from SynechronAt Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines...
-
Sr Databricks Engineer
3 days ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada Synechron Full-time €130,000 - €135,000 TemporaryThis range is provided by Synechron. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range $130,000.00/yr - $135,000.00/yr Direct message the job poster from Synechron At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines...
-
Technical lead – azure databricks engineer
14 hours ago
mississauga, ontario, Canada USEReady Inc. Full-timeShort-term onsite travel may be requiredAre you an experienced Azure Data Engineer who enjoys solving complex data challenges and taking technical ownership of enterprise-scale platforms?We’re looking for a Technical Lead – Azure Databricks Engineer with 8–10 years of Data Engineering experience and strong hands‑on expertise in Azure Databricks, Py...
-
Databricks Engineer
3 hours ago
Mississauga, Ontario, Canada Compunnel Inc. Full-timeThe Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services.This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering.The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and...
-
Technical Lead
4 days ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada USEReady Inc. Full-timeShort-term onsite travel may be required Are you an experienced Azure Data Engineer who enjoys solving complex data challenges and taking technical ownership of enterprise-scale platforms? We’re looking for a Technical Lead – Azure Databricks Engineer with 8–10 years of Data Engineering experience and strong hands‑on expertise in Azure...
-
Databricks Engineer
3 days ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada Compunnel Inc. Full-timeThe Databricks Engineer will design, develop, and optimize large-scale data pipelines using Databricks and Azure cloud services. This role requires advanced expertise in Spark/PySpark, Delta Lake technologies, data governance, and cloud-based data engineering. The engineer will collaborate with cross-functional teams to deliver scalable, reliable, and...
-
Azure Databricks Data Engineer
3 days ago
Mississauga, Ontario, Canada Cognizant Full-timeAbout the roleAs an Azure Databricks Data Engineer, you will make an impact by designing, developing, and optimizing scalable cloud-based data engineering solutions that enable efficient data processing and analytics. You will be a valued member of the Data Engineering team and work collaboratively with architects, business analysts, data scientists, and...
-
Databricks Data Engineering Role
3 days ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada Compunnel Inc. Full-timeEnhance your data engineering skills as a Databricks Engineer focused on Azure cloud solutions. Utilize your extensive Spark experience to optimize and deliver large-scale data pipelines. This role demands over 10 years of expertise in data engineering, particularly within financial institutions. You will design ETL/ELT pipelines and collaborate with...
-
Azure Databricks Data Engineer
3 days ago
Mississauga, ON, Peel Regional District, ON; Ontario, Canada Cognizant Full-time €90,000 - €105,000 TemporaryAbout the role As an Azure Databricks Data Engineer, you will make an impact by designing, developing, and optimizing scalable cloud-based data engineering solutions that enable efficient data processing and analytics. You will be a valued member of the Data Engineering team and work collaboratively with architects, business analysts, data scientists, and...