Unity Catalog Migration Data Engineer

5 days ago

Canada Apex Systems, LLC Full-time
Lead hands-on Unity Catalog migration work with Databricks, SQL, and Python across Toronto’s enterprise data engineering environment. Support workloads moving from Hive Metastore.
Apex Systems is seeking a Data Engineer focused on migration and centralization into an enterprise Databricks data hub. This contract assignment includes developing pipelines, transforming multiple source systems, and supporting users and workloads in Unity Catalog. You will collaborate with architecture, ADF, BI, and downstream teams.

Key Responsibilities

Migrate jobs and workloads from Hive MetastoreSupport Unity Catalog access and workload transitionsTransform data from Db2 and SQL ServerAssess jobs, users, dependencies, and migration dataSupport Azure Data Factory integrations and pipelinesRequirements:
Hands-on Databricks engineering experienceUnity Catalog tables, objects, and access control experiencePython, PySpark, and SQL development experienceExperience migrating relational and file-based dataStrong troubleshooting and problem-solving skillsBring Unity Catalog, Databricks, ADF, and migration experience to Apex Systems’ Toronto data engineering assignment.