Azure Data Engineer

3 days ago

Canada Viva Tech Solutions Full-time
  • Strong hands-on experience with Azure Data Factory (ADF), Azure Databricks, Python, PySpark, SQL, and Azure cloud services.
  • Expertise in developing scalable data ingestion, transformation, and orchestration pipelines using Databricks and Apache Airflow.
  • Experience implementing Medallion Architecture (Bronze, Silver, Gold), Delta Lake, and reusable data engineering frameworks.
  • Develop reusable Databricks notebooks, data transformation components, orchestration workflows, and automated data quality checks.
  • Strong experience with Azure DevOps, Git, CI/CD pipelines, and automated deployment processes.
  • Experience with Spark performance tuning, pipeline troubleshooting, data reconciliation, and workload optimization.
  • Knowledge of data governance, metadata management, Unity Catalog, and enterprise data engineering best practices.