Lead Data Platform Engineer Opportunity
10 hours ago
Montreal, Quebec, Canada
LawZero
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
LawZero in Montreal is searching for a Senior Data Platform Engineer ready to architect large-scale data systems. In this capacity, you will ensure the integrity of our AI data engine.
This role combines innovation with technical expertise, requiring you to build automated, petabyte-scale data pipelines that are efficient and reliable. You will work closely with researchers to guarantee seamless dataset integration with various training pipelines, pushing the boundaries of AI technology while maintaining strict governance protocols.
Key Responsibilities
â€
¢ Automate the scaling of extensive data processing systems â€
¢ Design execution strategies for diversified pipeline components â€
¢ Optimize compute resources, focusing on GPU utilization â€
¢ Build robust systems with effective bottleneck observability â€
¢ Implement full traceability for all datasets and outputs
Requirements:
â€
¢ Bachelor’s in computer science or related discipline â€
¢ Minimum of 5 years in distributed data processing frameworks â€
¢ Background in technologies like Apache Spark or Ray â€
¢ Experience with Kubernetes and other workload managers â€
¢ Ability to collaborate across teams and document procedures Empower AI research at LawZero by applying your data engineering expertise.
Key Responsibilities
â€
¢ Automate the scaling of extensive data processing systems â€
¢ Design execution strategies for diversified pipeline components â€
¢ Optimize compute resources, focusing on GPU utilization â€
¢ Build robust systems with effective bottleneck observability â€
¢ Implement full traceability for all datasets and outputs
Requirements:
â€
¢ Bachelor’s in computer science or related discipline â€
¢ Minimum of 5 years in distributed data processing frameworks â€
¢ Background in technologies like Apache Spark or Ray â€
¢ Experience with Kubernetes and other workload managers â€
¢ Ability to collaborate across teams and document procedures Empower AI research at LawZero by applying your data engineering expertise.