Data Engineer

16 hours ago

Toronto, Ontario, Canada MSR Technology Group Full-time

• Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Databricks Jobs, Workflows, and Notebooks.
• Expertise in PySpark, Python, SQL, Delta Lake, and ETL/ELT pipeline development.
• Experience implementing Medallion Architecture (Bronze, Silver, Gold) for enterprise data platforms.
• Develop reusable data ingestion, transformation, and orchestration pipelines.
• Implement automated data quality checks, reconciliation, testing, and performance optimization.
• Experience with Azure DevOps, Git, and CI/CD integration.
• Good to have: Unity Catalog, Databricks Asset Bundles, and Lakeflow Spark Declarative Pipelines.