Lead Data Platform Engineer Opportunity

10 hours ago

Montreal, Quebec, Canada LawZero Full-time
LawZero in Montreal is searching for a Senior Data Platform Engineer ready to architect large-scale data systems. In this capacity, you will ensure the integrity of our AI data engine. This role combines innovation with technical expertise, requiring you to build automated, petabyte-scale data pipelines that are efficient and reliable. You will work closely with researchers to guarantee seamless dataset integration with various training pipelines, pushing the boundaries of AI technology while maintaining strict governance protocols.

Key Responsibilities
â€
¢ Automate the scaling of extensive data processing systems â€
¢ Design execution strategies for diversified pipeline components â€
¢ Optimize compute resources, focusing on GPU utilization â€
¢ Build robust systems with effective bottleneck observability â€
¢ Implement full traceability for all datasets and outputs

Requirements:
â€
¢ Bachelor’s in computer science or related discipline â€
¢ Minimum of 5 years in distributed data processing frameworks â€
¢ Background in technologies like Apache Spark or Ray â€
¢ Experience with Kubernetes and other workload managers â€
¢ Ability to collaborate across teams and document procedures Empower AI research at LawZero by applying your data engineering expertise.