Principal DevOps Engineer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
This position is listed on behalf of a partner company, which manages all applications and next steps. Our partner is looking for a Principal DevOps Engineer (AI/ML Infrastructure) based in Canada
We are looking for an experienced Principal DevOps Engineer to design, build, and manage the infrastructure powering advanced AI and machine learning capabilities within a modern SaaS platform. In this senior technical role, you will drive the development of scalable, secure, and reliable AI/ML environments, supporting the entire lifecycle from experimentation and data ingestion to model deployment and production monitoring. You will work closely with AI researchers, software engineers, and cross-functional R&D teams to bridge the gap between research and production-ready solutions. Your expertise will help optimize infrastructure performance, automate complex workflows, and accelerate AI innovation. You will also serve as a technical leader and mentor, promoting engineering best practices and driving continuous improvement. This is an opportunity to contribute to impactful scientific software solutions within an international, innovation-driven environment.
Accountabilities
Architect, design, and lead the implementation of scalable, secure, resilient, and high-performance infrastructure to support demanding AI and machine learning workloads.
Build, maintain, and optimize specialized CI/CD pipelines for AI/ML applications, covering the complete lifecycle from data ingestion and model development to deployment, serving, and monitoring.
Design and manage cloud-based AI/ML infrastructure, leveraging containerization, orchestration, and platform engineering technologies to ensure scalability and operational efficiency.
Drive automation across infrastructure provisioning, model deployment, testing, and operational workflows to improve reliability, consistency, and development speed.
Collaborate closely with AI researchers, data scientists, and software engineers to streamline experimentation processes and translate machine learning models into reliable production applications.
Ensure the security, availability, reliability, and performance of AI/ML systems through effective infrastructure management, monitoring, and continuous optimization.
Act as a technical subject matter expert, mentoring junior engineers and promoting best practices in AI/ML platform development, source control, automation, and deployment.
Identify emerging technologies, tools, and industry trends, evaluating innovative solutions that can strengthen infrastructure capabilities and accelerate AI/ML development.
Requirements:
At least 5 years of professional experience in DevOps, machine learning infrastructure, or platform engineering, including several years in a senior technical or leadership capacity.
At least 5 years of advanced experience with one or more major cloud platforms, such as AWS, Microsoft Azure, or Google Cloud Platform (GCP), including their AI/ML and containerization services.
Minimum 5 years of hands-on experience with machine learning orchestration and platform technologies such as Kubeflow, MLflow, or Amazon SageMaker.
Approximately 5-8+ years of strong expertise in Docker and Kubernetes, particularly for deploying, managing, and scaling AI/ML workloads.
Approximately 5-8+ years of programming experience with languages such as Python, Go, or Bash, with a strong focus on scripting and infrastructure automation.
Experience with infrastructure-as-code and configuration management tools such as Terraform or Ansible.
Demonstrated ability to design and implement reliable automated CI/CD pipelines using tools such as GitHub Actions, GitLab CI/CD, or Jenkins.
Strong understanding of DevOps principles, cloud infrastructure, container orchestration, automation, scalability, and security best practices.
Excellent communication and collaboration skills, with the ability to work effectively alongside AI researchers, software developers, infrastructure specialists, and business stakeholders.
Strong technical problem-solving skills, initiative, and the ability to drive complex infrastructure proj