Senior Distributed Systems Software Engineer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Build high-performance inference infrastructure at Anthropic using distributed systems expertise and intelligent routing across a hybrid office model.
This Staff and Senior Software Engineer role supports the Inference team serving Claude to millions worldwide. You will work across request routing, fleet orchestration, load balancing, and deployment pipelines. The work spans diverse AI accelerators, cloud platforms, and emerging model architectures.
Key Responsibilities:
- Design distributed systems serving Claude to millions worldwide
- Develop real-time resilient systems for changing events
- Build routing, load balancing, and traffic management systems
- Autoscale and orchestrate production and research workloads
- Operate production-grade model deployment pipelines
Requirements:
- Significant software engineering experience with distributed systems
- Experience with high-performance large-scale distributed systems
- Experience deploying machine learning systems at scale
- Proficiency in Python or Rust
- Bachelor’s degree or equivalent education, training, or experience
Apply distributed systems, routing, and infrastructure expertise to advance Anthropic’s reliable, high-performance Claude inference platform.
#J-18808-Ljbffr