Expert Databricks Data Engineer Opportunity
2 days ago
Winnipeg, Manitoba, Canada
KData AI
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
We seek a Senior Databricks Data Engineer dedicated to designing and optimizing data pipelines. This role requires a hands-on approach, leveraging PySpark and SQL to improve data processes and architecture.
In your role, you'll lead the charge in end-to-end data pipeline execution and Lakehouse modernization. You'll engage deeply with Databricks to optimize cluster performance and enforce essential data governance, all while collaborating on high-impact solutions.
Key Responsibilities: • Develop and support real-time streaming and batch pipelines • Implement robust Medallion architectures and support BI needs • Troubleshoot and optimize Spark performance issues • Ensure data governance through Unity Catalog • Establish automated CI/CD processes for testing and deployment
Requirements: • 8+ years in Data Engineering, including 4 years in Databricks • Proficient with PySpark, Advanced SQL, and Python • Extensive experience with Delta Lake and workflows • Strong cloud integration experience (AWS, Azure, GCP) • Knowledge of dimensional modeling strategies
Channel your data engineering capabilities to enhance our data infrastructure in a rewarding environment.
In your role, you'll lead the charge in end-to-end data pipeline execution and Lakehouse modernization. You'll engage deeply with Databricks to optimize cluster performance and enforce essential data governance, all while collaborating on high-impact solutions.
Key Responsibilities: • Develop and support real-time streaming and batch pipelines • Implement robust Medallion architectures and support BI needs • Troubleshoot and optimize Spark performance issues • Ensure data governance through Unity Catalog • Establish automated CI/CD processes for testing and deployment
Requirements: • 8+ years in Data Engineering, including 4 years in Databricks • Proficient with PySpark, Advanced SQL, and Python • Extensive experience with Delta Lake and workflows • Strong cloud integration experience (AWS, Azure, GCP) • Knowledge of dimensional modeling strategies
Channel your data engineering capabilities to enhance our data infrastructure in a rewarding environment.