AI Infrastructure Operations Engineer
3 weeks ago
Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to effortlessly run large-scale ML applications, without the hassle of managing hundreds of GPUs or TPUs.Cerebras' current customers include global corporations across multiple industries, national labs, and top-tier healthcare systems. In January, we announced a multi-year, multi-million-dollar partnership with Mayo Clinic, underscoring our commitment to transforming AI applications across various fields. In August, we launched Cerebras Inference, the fastest Generative AI inference solution in the world, over 10 times faster than GPU-based hyperscale cloud inference services.About The RoleWe are seeking a highly skilled and experienced AI Infrastructure Operations Engineer to manage and operate our cutting-edge machine learning compute clusters. These clusters would provide the candidate an opportunity to work with the world's largest computer chip, the Wafer-Scale Engine (WSE), and the systems that harness its unparalleled power.You will play a critical role in ensuring the health, performance, and availability of our infrastructure, maximizing compute capacity, and supporting our growing AI initiatives. This role requires a deep understanding of Linux-based systems, containerization technologies, and experience with monitoring and troubleshooting complex distributed systems. The ideal candidate is a proactive problem-solver with expertise in large-scale compute infrastructure, dependable and an advocate for customer success.ResponsibilitiesManage and operate multiple advanced AI compute infrastructure clusters.Monitor and oversee cluster health, proactively identifying and resolving potential issues.Maximize compute capacity through optimization and efficient resource allocation.Deploy, configure, and debug container-based services using Docker.Provide 24/7 monitoring and support, leveraging automated tools and performing hands-on troubleshooting as needed.Handle engineering escalations and collaborate with other teams to resolve complex technical challenges.Contribute to the development and improvement of our monitoring and support processes.Stay up-to-date with the latest advancements in AI compute infrastructure and related technologies.Skills And Requirements6-8 years of relevant experience in managing and operating complex compute infrastructure, preferably in the context of machine learning or high-performance computing.Strong proficiency in Python scripting for automation and system administration.Deep understanding of Linux-based compute systems and command-line tools.Extensive knowledge of Docker containers and container orchestration platforms like k8s and SLURM.Proven ability to troubleshoot and resolve complex technical issues in a timely and efficient manner.Experience with monitoring and alerting systems.Should have a proven track record to own and drive challenges to completion.Excellent communication and collaboration skills.Ability to work effectively in a fast-paced environment.Willingness to participate in a 24/7 on-call rotation.Preferred Skills And RequirementsOperating large scale GPU clusters.Knowledge of technologies like Ethernet, RoCE, TCP/IP, etc. is desired.Knowledge of cloud computing platforms (e.g., AWS, GCP, Azure).Familiarity with machine learning frameworks and tools.Experience with cross-functional team projects.LocationSF Bay Area.Toronto, Canada.Bangalore, India.Why Join CerebrasPeople who are serious about software make their own hardware. At Cerebras we have built a breakthrough architecture that is unlocking new opportunities for the AI industry. With dozens of model releases and rapid growth, we’ve reached an inflection point in our business. Members of our team tell us there are five main reasons they joined Cerebras:Build a breakthrough AI platform beyond the constraints of the GPU.Publish and open source their cutting-edge AI research.Work on one of the fastest AI supercomputers in the world.Enjoy job stability with startup vitality.Our simple, non-corporate work culture that respects individual beliefs.Read our blog: Five Reasons to Join Cerebras in 2025.Apply today and become part of the forefront of groundbreaking advancements in AICerebras Systems is committed to creating an equal and diverse environment and is proud to be an equal opportunity employer. We celebrate different backgrounds, perspectives, and skills. We believe inclusive teams build better products and companies. We try every day to build a work environment that empowers people to do their best work through continuous learning, growth and support of those around them.This website or its third-party tools process personal data. For more details, click here to review our CCPA disclosure notice. #J-18808-Ljbffr
-
Network Engineer, AI/ML Infrastructure
4 weeks ago
Toronto, Canada Boson AI Full time2 days ago Be among the first 25 applicants This range is provided by Boson AI. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base Pay Range CA$150,000.00/yr - CA$250,000.00/yr About the Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking...
-
Network Engineer, AI/ML Infrastructure
3 weeks ago
Toronto, Canada Boson AI Full time2 days ago Be among the first 25 applicants This range is provided by Boson AI. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base Pay Range CA$150,000.00/yr - CA$250,000.00/yr About the Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking...
-
Network Engineer, AI/ML Infrastructure
2 weeks ago
Toronto, Canada Boson AI Full timeGet AI-powered advice on this job and more exclusive features. This range is provided by Boson AI. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range CA$150,000.00/yr - CA$250,000.00/yr About The Role We're seeking an experienced Network Engineer to design, build, and optimize the...
-
Network Engineer, AI/ML Infrastructure
2 weeks ago
Toronto, Canada Boson AI Full timeGet AI-powered advice on this job and more exclusive features. This range is provided by Boson AI. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range CA$150,000.00/yr - CA$250,000.00/yr About The Role We're seeking an experienced Network Engineer to design, build, and optimize the...
-
Network Engineer, AI/ML Infrastructure
4 weeks ago
Toronto, Canada Boson AI Full timeAbout The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...
-
Network Engineer, AI/ML Infrastructure
3 weeks ago
Toronto, Canada Boson AI Full timeAbout The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...
-
Network Engineer, AI/ML Infrastructure
4 weeks ago
Toronto, Canada Boson AI Full timeAbout The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...
-
Network Engineer, AI/ML Infrastructure
2 days ago
Toronto, Ontario, Canada Boson AI Full time $150,000 - $250,000 per yearAbout The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...
-
HPC Engineer, AI/ML Infrastructure
4 weeks ago
Toronto, Canada Boson AI Full timeBase pay range CA$150,000.00/yr - CA$250,000.00/yr About The Role We're looking for a Senior High Performance Computing Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers. You'll be hands‑on with the full...
-
HPC Engineer, AI/ML Infrastructure
3 weeks ago
Toronto, Canada Boson AI Full timeBase pay range CA$150,000.00/yr - CA$250,000.00/yr About The Role We're looking for a Senior High Performance Computing Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers. You'll be hands‑on with the full...