Distributed Systems Engineer at Baseten
14 hours ago
Montreal, Quebec, Canada
Baseten
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Join Baseten as a Distributed Systems Engineer and revolutionize AI inference. This role focuses on building large-scale systems for deployed models, optimizing cost-efficiency and reliability.
At Baseten, we're powering some of the most dynamic AI companies and looking for engineers who excel in distributed systems. In this role, you will work with cutting-edge technology to create an infrastructure that supports high-performance AI models in production. You'll be responsible for deploying, managing, and optimizing our inference platform's capabilities.
Key Responsibilities
• Build infrastructure for distributed LLM inference
• Design and operate advanced Model APIs
• Implement API versioning, validation, and quotas
• Instrument observability metrics and logs
• Debug complex systems across Kubernetes and GPU
Requirements:
• 3+ years in distributed systems or large-scale APIs
• Proven experience in reliable backend services
• Strong understanding of performance profiling and testing
• Comfort in debugging across application layers
• Excellent collaboration and documentation skills Bring your expertise to Baseten and contribute to shaping the future of AI products.
Key Responsibilities
• Build infrastructure for distributed LLM inference
• Design and operate advanced Model APIs
• Implement API versioning, validation, and quotas
• Instrument observability metrics and logs
• Debug complex systems across Kubernetes and GPU
Requirements:
• 3+ years in distributed systems or large-scale APIs
• Proven experience in reliable backend services
• Strong understanding of performance profiling and testing
• Comfort in debugging across application layers
• Excellent collaboration and documentation skills Bring your expertise to Baseten and contribute to shaping the future of AI products.