Senior Data Platform Engineer Lakehouse

4 days ago

Remote, Canada Hyve Solutions Full-time

Apache Spark and Iceberg expertise define this Data Platform Engineer role at Hyve Solutions. Build cloud-native infrastructure for large-scale data workloads.

This experienced position leads enterprise platform evolution from Hadoop and Hive toward Apache Iceberg and object storage. You will engineer distributed systems rather than business-specific pipelines, using Kubernetes, Spark, and cloud ecosystems. The work supports batch, streaming, and incremental workloads at petabyte scale.

Key Responsibilities:

  • Design and operate Apache Iceberg Lakehouse platforms
  • Lead Hadoop and HDFS migration to object storage
  • Develop metadata, catalog, governance, and access services
  • Optimize Spark performance, reliability, and cost efficiency
  • Operate Kubernetes workloads and resource management

Requirements:

  • Expert knowledge of Apache Spark execution and optimization
  • Experience with Iceberg, Hudi, or Delta Lake
  • Hands-on Kubernetes data workload deployment experience
  • Cloud object storage and Lakehouse architecture knowledge
  • Three or more years in data platform engineering

Apply your Spark, Iceberg, Kubernetes, and distributed systems expertise to Hyve Solutions’ modern Lakehouse platform.

#J-18808-Ljbffr