Senior Software Engineer, Infrastructure
3 weeks ago
About Us
We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.
Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems who holds multiple academic and industry research awards from Google, Amazon, Facebook, and VMware.
Position Overview:
We are seeking a highly motivated and skilled senior infrastructure engineer to join our team in a key role focused on designing, developing, and maintaining the CentML platform that offers a cost effective infrastructure for serving and training large scale machine learning models. As an infrastructure engineer, you will be responsible for laying out the design of a deployment infrastructure for ML training and inference jobs over GPU clusters that spans across multiple cloud service providers like AWS, GCP, Azure, Coreweave, and OCI. You should also be responsible for leading a team of engineers and building a scalable, performant, and reliable platform, enabling our customers to seamlessly access and utilize a comprehensive suite of ML services that we offer.
Responsibilities- Design and lead the development of the deployment infrastructure of the CentML platform. The deployment infrastructure manages the hardware resources necessary to deploy the ML training and inference applications.
- Implementing GPU cluster scheduling solutions for large scale ML training and inference workloads to efficiently utilize the hardware resources in the GPU cluster.
- Communicate with our product teams and define new features and goals for improving the CentML platform.
- 4+ years of experience working with containerized deployment systems (e.g, kubernetes, openshift, terraform etc.).
- A big plus if you have contributed to kubernetes and have expertise in container runtime technologies like docker engine, containerd, or CRI-O
- Experience with deploying and managing cloud infrastructure on AWS, GCP, Azure
- Past experience in building GPU clusters for large scale ML training and inference is desirable.
- Knowledge in GPU architecture and Nvidia GPU virtualization technologies is highly desirable.
- Strong coding skills in languages like Python, Java, Go, and/or C/C++.
Benefits & Perks
- An open and inclusive culture and work environment
- Fully stocked kitchen at the office
- Full health and dental benefits
- Parental Leave top-up for 6 months
- Continuous education budget
- Generous vacation - we're not saying unlimited, but if you need extra time to recharge, just ask
At CentML, we celebrate our differences and value cultivating an inclusive environment for all. We welcome applications of all kinds and are committed to providing an equal opportunity process.
#J-18808-Ljbffr-
Senior Infrastructure Engineer
4 weeks ago
Old Toronto, Canada Alora Labs Inc. Full timeAlora Labs is a leading-edge software company specializing in building innovative and scalable solutions. We’re looking for a talented and experienced Senior DevOps Engineer to join our team and contribute to the effective operation and improvement of our systems and services. If you’re passionate about automation, infrastructure as code, and enjoy...
-
Senior Infrastructure Engineer
1 month ago
Old Toronto, Canada Alora Labs Inc. Full timeAlora Labs is a leading-edge software company specializing in building innovative and scalable solutions. We’re looking for a talented and experienced Senior DevOps Engineer to join our team and contribute to the effective operation and improvement of our systems and services. If you’re passionate about automation, infrastructure as code, and enjoy...
-
Senior Infrastructure Engineer
4 days ago
Old Toronto, Canada Alora Labs Inc. Full timeAlora Labs is a leading-edge software company specializing in building innovative and scalable solutions. We’re looking for a talented and experienced Senior DevOps Engineer to join our team and contribute to the effective operation and improvement of our systems and services. If you’re passionate about automation, infrastructure as code, and enjoy...
-
Senior Infrastructure Engineer
4 weeks ago
Old Toronto, Canada Alora Labs Inc. Full timeAlora Labs is a leading-edge software company specializing in building innovative and scalable solutions. We’re looking for a talented and experienced Senior DevOps Engineer to join our team and contribute to the effective operation and improvement of our systems and services. If you’re passionate about automation, infrastructure as code, and enjoy...
-
Senior Software Engineer
4 weeks ago
Toronto, Canada Fathom Full timeFathom is on a mission to use AI to understand and structure the world’s medical data, starting by making sense of the terabytes of clinician notes contained within the electronic health records of the world’s largest health systems. Our deep learning engine automates the translation of patient records into the billing codes used for healthcare provider...
-
Senior Infrastructure Engineer
2 days ago
Old Toronto, Canada Canadian Imperial Bank of Commerce Full timeSenior Infrastructure Engineer page is loaded Senior Infrastructure Engineer Apply locations Toronto, ON time type Full time posted on Posted Yesterday job requisition id 2406757 We’re building a relationship-oriented bank for the modern world. We need talented, passionate...
-
Senior Infrastructure Engineer
1 day ago
Old Toronto, Canada Canadian Imperial Bank of Commerce Full timeSenior Infrastructure Engineer page is loaded Senior Infrastructure Engineer Apply locations Toronto, ON time type Full time posted on Posted Yesterday job requisition id 2406757 We’re building a relationship-oriented bank for the modern world. We need talented, passionate...
-
Senior Software Engineer, Infrastructure
4 days ago
Old Toronto, Canada CentML Full timeAbout UsWe believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at...
-
Old Toronto, Canada Alphawave IP Inc Full timeStaff Software Engineer – Software Infrastructure page is loaded Staff Software Engineer – Software Infrastructure Apply locations Toronto time type Full time posted on Posted 6 Days Ago job requisition id JR100235 The OpportunityWe're looking for the Wavemakers of tomorrow. Alphawave Semi enables...
-
Old Toronto, Canada Alphawave IP Inc Full timeStaff Software Engineer – Software Infrastructure page is loaded Staff Software Engineer – Software Infrastructure Apply locations Toronto time type Full time posted on Posted 6 Days Ago job requisition id JR100235 The OpportunityWe're looking for the Wavemakers of tomorrow. Alphawave Semi enables...
-
Old Toronto, Canada Alphawave IP Inc Full timeStaff Software Engineer – Software Infrastructure page is loaded Staff Software Engineer – Software Infrastructure Apply locations Toronto time type Full time posted on Posted 6 Days Ago job requisition id JR100235 The OpportunityWe're looking for the Wavemakers of tomorrow. Alphawave Semi enables...
-
Senior Software Engineer
4 weeks ago
Old Toronto, Canada ML6 Search + Talent Advisory Full timeThe Opportunity: We are currently supporting our client, an early-stage mobility-tech start-up, to help them hire a Senior Software Engineer for their growing team in Toronto, ON. Your role will involve architecting and maintaining key components of our client’s infrastructure while establishing and refining engineering processes to support company growth....
-
Senior Software Engineer
4 weeks ago
Old Toronto, Canada ML6 Search + Talent Advisory Full timeThe Opportunity: We are currently supporting our client, an early-stage mobility-tech start-up, to help them hire a Senior Software Engineer for their growing team in Toronto, ON. Your role will involve architecting and maintaining key components of our client’s infrastructure while establishing and refining engineering processes to support company growth....
-
Senior Software Engineer
4 weeks ago
Old Toronto, Canada ML6 Search + Talent Advisory Full timeThe Opportunity: We are currently supporting our client, an early-stage mobility-tech start-up, to help them hire a Senior Software Engineer for their growing team in Toronto, ON. Your role will involve architecting and maintaining key components of our client’s infrastructure while establishing and refining engineering processes to support company growth....
-
Senior Infrastructure Engineer
4 weeks ago
Toronto, ON, Canada Alora Labs Inc. Full timeAlora Labs is a leading-edge software company specializing in building innovative and scalable solutions. We’re looking for a talented and experienced Senior DevOps Engineer to join our team and contribute to the effective operation and improvement of our systems and services. If you’re passionate about automation, infrastructure as code, and enjoy...
-
Senior Software Engineer, Infrastructure
3 weeks ago
Toronto, ON, Canada CentML Full timeAbout Us We believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential. Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts...
-
Senior Software Engineer, Integrations
4 weeks ago
Old Toronto, Canada Secoda Full timeWe are hiring a Senior Software Engineer to join our Engineering team. In this role, you will take the lead on building and maintaining the metadata ingestion and lineage systems for integrations. You'll collaborate closely with design, product management, and engineering to shape our core platform, improving performance, and influencing our product roadmap....
-
Senior Software Engineer, Integrations
1 month ago
Old Toronto, Canada Secoda Full timeWe are hiring a Senior Software Engineer to join our Engineering team. In this role, you will take the lead on building and maintaining the metadata ingestion and lineage systems for integrations. You'll collaborate closely with design, product management, and engineering to shape our core platform, improving performance, and influencing our product roadmap....
-
Senior Software Engineer, Integrations
4 days ago
Old Toronto, Canada Secoda Full timeWe are hiring a Senior Software Engineer to join our Engineering team. In this role, you will take the lead on building and maintaining the metadata ingestion and lineage systems for integrations. You'll collaborate closely with design, product management, and engineering to shape our core platform, improving performance, and influencing our product roadmap....
-
Senior Software Engineer, Integrations
4 weeks ago
Old Toronto, Canada Secoda Full timeWe are hiring a Senior Software Engineer to join our Engineering team. In this role, you will take the lead on building and maintaining the metadata ingestion and lineage systems for integrations. You'll collaborate closely with design, product management, and engineering to shape our core platform, improving performance, and influencing our product roadmap....
