Senior Engineer in AI Networking Innovations
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Transform the AI landscape as a Senior Engineer at Baseten, specializing in GPU networking and distributed systems. Work on groundbreaking RDMA technologies to enhance model performance. At Baseten, we are seeking an innovative engineer for our GPU Networking team to integrate advanced networking technologies into our AI infrastructure. This pivotal role requires not only coding expertise but an understanding of how networking and compute interact to deliver maximum performance for distributed inference solutions. Key Responsibilities:
- Integrate RDMA and InfiniBand for enhanced performance
- Optimize networking layers for distributed AI models
- Achieve fast startup times for complex systems
- Conduct performance validation on cutting-edge hardware
- Create diagnostic tools for network management
- Proven deep knowledge of networking protocols
- Proficient in C++ or Python with a focus on optimization
- Ability to dive into low-level hardware benchmarks
- Experience with NCCL, NVSHMEM, or custom kernels is ideal
- Familiarity with high-performance filesystems is advantageous