AI agent Infrastructure Engineers

1 week ago

Toronto, Ontario, Canada MERCOR Full time $150,000 - $200,000 per year

Mercor is hiring AI Agent Infrastructure Engineers on behalf of a leading AI Lab developing scalable systems to power the next generation of intelligent, autonomous agents. This is a unique opportunity to work with world-class AI researchers and engineers, building the infrastructure that enables advanced reasoning, multi-agent coordination, and real-world deployment of AI systems.

Responsibilities

  • Design, build, and optimize infrastructure for training, deploying, and scaling AI agents across distributed systems.
  • Develop robust backend services, APIs, and orchestration frameworks that support multi-agent workflows and high-performance compute environments.
  • Collaborate closely with research and product teams to integrate model-serving pipelines, memory systems, and reasoning components.
  • Implement monitoring, observability, and failover mechanisms to ensure high system reliability and fault tolerance.
  • Evaluate and refine infrastructure performance, identifying bottlenecks and improving efficiency across data, compute, and model layers.
  • Participate in synchronous collaboration sessions (4-hour windows, 2–3 times per week) to review architecture decisions, troubleshoot distributed systems, and iterate on design improvements.

Requirements

  • Strong background in Computer Science, Software Engineering, or Systems Design, with focus on large-scale distributed infrastructure.
  • Experience with cloud computing (AWS, GCP, or Azure) and containerization/orchestration tools such as Docker and Kubernetes.
  • Proficiency in backend programming languages such as Go, Rust, Python, or C++.
  • Familiarity with LLM inference pipelines, multi-agent architectures, or reinforcement learning environments is a strong plus.
  • Knowledge of network optimization, data streaming, and caching architectures preferred.
  • Excellent collaboration and communication skills.
  • Ability to commit 20–30 hours per week, including required synchronous collaboration sessions.

Why Join

  • Work directly with a world-class AI research lab building the infrastructure behind tomorrow's intelligent agent ecosystems.
  • Influence the foundations of AI scalability, reliability, and deployment, enabling complex agents to operate in real-world environments.
  • Enjoy schedule flexibility — select your own 4-hour collaboration windows and manage your 20–30 hour work week.
  • Be engaged as an hourly contractor through Mercor, giving you autonomy while contributing to mission-critical AI infrastructure projects.
  • Collaborate with top systems engineers, researchers, and AI developers working at the intersection of distributed systems and advanced intelligence.
  • Join a global network of technical experts shaping how the next generation of AI agents reason, interact, and evolve at scale.

  • Agentic AI Platform Engineer

    1 week ago

    Toronto, Ontario, Canada KData AI Full time $120,000 - $180,000 per year

    Job Title: Agentic AI Platform EngineerClient: Banking ClientLocation:Downtown Toronto (On-site 4 days/week)Position Type:6-Month Contract (Renewable)Domain: Generative AI, Agentic Systems, AI Platform EngineeringRate: up to $90Role SummaryA leading Banking Client is building a next-generationAgentic AI Platformto enable scalable, enterprise-wide deployment...

  • Network Engineer, AI/ML Infrastructure

    2 days ago

    Toronto, Ontario, Canada Boson AI Full time $150,000 - $250,000 per year

    About The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...

  • Network Engineer, AI/ML Infrastructure

    1 week ago

    Toronto, Ontario, Canada Boson AI Full time $120,000 - $180,000 per year

    About The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...

  • Network Engineer, AI/ML Infrastructure

    1 week ago

    Toronto, Ontario, Canada Boson AI Full time US$150,000 - US$250,000

    About The RoleWe're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage,...

  • AI Engineer – Agentic Platform

    1 week ago

    Toronto, Ontario, Canada Epiq Full time $120,000 - $180,000 per year

    It's fun to work at a company where people truly believe in what they are doingJob Description:Epiq is at the forefront of AI innovation in the legal tech industry. We are looking for a skilled AI Engineer to be a core member of our team as we build a first-of-its-kind agentic platform. This platform will revolutionize how we serve our global customers in...

  • JD-2025-AIML-1: Senior AI/ML Engineer – Agentic AI

    1 week ago

    Toronto, Ontario, Canada Amyantek Full time $100,000 - $150,000 per year

    JD-2025-AIML-1: Senior AI/ML Engineer – Agentic AILocation: Toronto, ON (Hybrid)Client: Applab/LoblawsType: Full-time Team: Machine Learning Platform / Digital & DataAbout the RoleLoblaws Digital is hiring a Senior AI/ML Engineer with a strong emphasis on Agentic AI systems. This role focuses on building production-grade multi-agent workflows, LLM-powered...

  • AI Agent Deployment Engineering Manager

    3 days ago

    Toronto, Ontario, Canada MAGICAL Full time $120,000 - $250,000 per year

    AI Agent Deployment Engineering ManagerReports to: Head of Deployment / ProductMagical's agentic AI platform brings AI Agents into the workplace to take over repetitive, soul-crushing workflows that slow teams down. Our customers, especially in healthcare, use Magical to automate high-stakes, high-complexity processes.The shift to agentic work is...

  • AI Agent Deployment Engineering Manager

    5 days ago

    Toronto, Ontario, Canada Magical Full time $180,000 - $300,000 per year

    AI Agent Deployment Engineering ManagerTeam size scaling: 8 today → ~25 by end of 2026Reports to: Head of Deployment / ProductMagical's agentic AI platform brings AI Agents into the workplace to take over repetitive, soul-crushing workflows that slow teams down. Our customers—especially in healthcare—use Magical to automate high-stakes, high-complexity...

  • Ai Agent Engineer

    1 week ago

    Toronto, Ontario, Canada BMO Full time $103,000 - $192,000 per year

    AI Agent EngineerLocation:Toronto, ONReports to:AI Engineering and Delivery LeadWorks with:Solution Architects, Data Engineers, Product Managers, Business Stakeholders, and cross-functional AI Execution SquadsRole OverviewThe AI Agent Engineer is responsible for designing, developing, deploying, and optimizing autonomous AI agents that enhance advisor...

  • AI Agent Deployment Engineering Manager

    3 days ago

    Toronto, Ontario, Canada Magical Full time $150,000 - $200,000 per year

    Reports to:Head of Deployment / ProductMagical's agentic AI platform brings AI Agents into the workplace to take over repetitive, soul-crushing workflows that slow teams down. Our customers, especially in healthcare, use Magical to automate high-stakes, high-complexity processes.The shift to agentic work is accelerating, and we're leading it. Our AI...