Senior Data Platform Engineer Lakehouse
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Apache Spark and Iceberg expertise define this Data Platform Engineer role at Hyve Solutions. Build cloud-native infrastructure for large-scale data workloads.
This experienced position leads enterprise platform evolution from Hadoop and Hive toward Apache Iceberg and object storage. You will engineer distributed systems rather than business-specific pipelines, using Kubernetes, Spark, and cloud ecosystems. The work supports batch, streaming, and incremental workloads at petabyte scale.
Key Responsibilities:
- Design and operate Apache Iceberg Lakehouse platforms
- Lead Hadoop and HDFS migration to object storage
- Develop metadata, catalog, governance, and access services
- Optimize Spark performance, reliability, and cost efficiency
- Operate Kubernetes workloads and resource management
Requirements:
- Expert knowledge of Apache Spark execution and optimization
- Experience with Iceberg, Hudi, or Delta Lake
- Hands-on Kubernetes data workload deployment experience
- Cloud object storage and Lakehouse architecture knowledge
- Three or more years in data platform engineering
Apply your Spark, Iceberg, Kubernetes, and distributed systems expertise to Hyve Solutions’ modern Lakehouse platform.
#J-18808-Ljbffr