HPC Engineer, AI/ML Infrastructure

7 days ago

Toronto, Ontario, Canada Boson AI Full time $120,000 - $180,000 per year

About The Role We're looking for a Senior High Performance Computing Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers You'll be hands-on with the full lifecycle of HPC infrastructure: planning, building, testing, deploying, and keeping everything running smoothly. That means troubleshooting issues as they arise, monitoring performance, developing automation to make our lives easier, and working closely with engineering and science teams to ensure they have what they need. You'll also help us plan for future capacity and evaluate new technologies as we continue to scale. Responsibilities Manage and optimize HPC cluster operations Deploy and maintain infrastructure-as-code solutions Support ML/research teams with cluster usage optimization Operate, troubleshoot and optimize Ceph storage clusters. Develop automation and tooling Minimum Qualifications 5 years of experience in HPC operations. Proficiency in Linux systems administration (Ubuntu/Debian). Experience with Kubernetes and container orchestration Knowledge of security best practices in multi-tenant environments. Understanding of L2/L3 networking fundamentals Skilled in Python and Bash scripting. Preferred Qualifications Experience with infrastructure-as-code tools (Ansible/Terraform). Experience with Ceph >1PB deployments and maintenance Experience with GitOps (Helm, ArgoCD). Strong grasp of RDMA, InfiniBand, and GPUDirect technologies Familiarity with deep learning frameworks such as PyTorch and TensorFlow. Familiarity in at least one cloud platform: AWS, Azure or GCP. If you're a natural problem-solver with a passion for continuous learning, we'd love to hear from you.

  • HPC Engineer, AI/ML Infrastructure

    7 days ago

    Toronto, Ontario, Canada Boson AI Full time US$150,000 - US$250,000

    About The RoleWe're looking for a Senior High Performance Computing Engineer to help us run one of the most exciting GPU clusters around—our Toronto datacenter packed with NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage, terabit networking, and hundreds of servers.You'll be hands-on with the full lifecycle of HPC infrastructure: planning, building,...

  • Network Engineer, AI/ML Infrastructure

    7 days ago

    Toronto, Ontario, Canada Boson AI Full time $120,000 - $180,000 per year

    About The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...

  • Network Engineer, AI/ML Infrastructure

    7 days ago

    Toronto, Ontario, Canada Boson AI Full time US$150,000 - US$250,000

    About The RoleWe're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage,...

  • Network Engineer, AI/ML Infrastructure

    1 day ago

    Toronto, Ontario, Canada Boson AI Full time $150,000 - $250,000 per year

    About The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...

  • HPC Engineer

    2 weeks ago

    Toronto, Ontario, Canada iVedha Inc. Full time $120,000 - $180,000 per year

    Job Title: HPC Engineer – AI Workloads & InfrastructureLocation:Toronto, ON (Hybrid)Department:Operations – High Performance Computing (HPC)Company:iVedha IncAbout iVedhaiVedha is a leading provider of cloud and managed services, helping enterprises modernize their IT infrastructure and accelerate digital transformation. Be part of the Canada's...

  • AI/ML Engineer

    2 days ago

    Toronto, Ontario, Canada The Vanguard Group Full time $80,000 - $120,000 per year

    Vanguard is seeking a talented and motivated AI/ML Engineer to join our team in building agentic systems for IT operations and resilience checking. This role is ideal for early-career professionals who are passionate about AI, autonomous agents, and advanced machine learning techniques. You will work alongside senior data scientists and engineers to develop...

  • CoverRight - AI/ML Engineer

    1 week ago

    Toronto, Ontario, Canada 43North Full time $120,000 - $180,000 per year

    About CoverRight CoverRight is on a mission to make Medicare, and retiree health-related-finances transparent and accessible. We're building technology to empower older adults to confidently navigate their healthcare options through personalized guidance and modern digital experiences. We're a fast-growing, venture-backed company blending human expertise...

  • Senior AI/ML Engineer

    2 days ago

    Toronto, Ontario, Canada Vanguard Canada Full time

    Vanguard's Corporate Services department is seeking a Senior AI/ML Engineer to design and deliver scalable machine learning infrastructure and pipelines that enable experimentation, deployment, and monitoring of AI/ML models across the enterprise.This role is ideal for someone with deep technical expertise in building production-grade ML systems and a...

  • JD-2025-AIML-1: Senior AI/ML Engineer – Agentic AI

    1 week ago

    Toronto, Ontario, Canada Amyantek Full time $100,000 - $150,000 per year

    JD-2025-AIML-1: Senior AI/ML Engineer – Agentic AILocation: Toronto, ON (Hybrid)Client: Applab/LoblawsType: Full-time Team: Machine Learning Platform / Digital & DataAbout the RoleLoblaws Digital is hiring a Senior AI/ML Engineer with a strong emphasis on Agentic AI systems. This role focuses on building production-grade multi-agent workflows, LLM-powered...

  • AI/ML Engineer

    1 day ago

    Toronto, Ontario, Canada Confiar Services LLC Full time $124,800 - $135,200 per year

    Job Title: AI/ML EngineerLocation: Toronto, CanadaDuration: Long Term ContractKey ResponsibilitiesDevelop and maintain Python applications using MCP (Model Context Protocol).Integrate MCP with AI/ML models, APIs, and data pipelines.Build scalable real-time and batch AI workflow services.Work with data scientists/ML engineers to deliver AI-driven...