AI agent Infrastructure Engineers

2 weeks ago

Toronto, Ontario, Canada Mercor Full time $80,000 - $120,000 per year

Mercor is hiring AI Agent Infrastructure Engineers on behalf of a leading AI Lab developing scalable systems to power the next generation of intelligent, autonomous agents. This is a unique opportunity to work with world-class AI researchers and engineers, building the infrastructure that enables advanced reasoning, multi-agent coordination, and real-world deployment of AI systems.

Responsibilities

  • Design, build, and optimize infrastructure for training, deploying, and scaling AI agents across distributed systems.

  • Develop robust backend services, APIs, and orchestration frameworks that support multi-agent workflows and high-performance compute environments.

  • Collaborate closely with research and product teams to integrate model-serving pipelines, memory systems, and reasoning components.

  • Implement monitoring, observability, and failover mechanisms to ensure high system reliability and fault tolerance.

  • Evaluate and refine infrastructure performance, identifying bottlenecks and improving efficiency across data, compute, and model layers.

  • Participate in synchronous collaboration sessions (4-hour windows, 2–3 times per week) to review architecture decisions, troubleshoot distributed systems, and iterate on design improvements.

Requirements

  • Strong background in Computer Science, Software Engineering, or Systems Design, with focus on large-scale distributed infrastructure.

  • Experience with cloud computing (AWS, GCP, or Azure) and containerization/orchestration tools such as Docker and Kubernetes.

  • Proficiency in backend programming languages such as Go, Rust, Python, or C++.

  • Familiarity with LLM inference pipelines, multi-agent architectures, or reinforcement learning environments is a strong plus.

  • Knowledge of network optimization, data streaming, and caching architectures preferred.

  • Excellent collaboration and communication skills.

  • Ability to commit 20–30 hours per week, including required synchronous collaboration sessions.

Why Join

  • Work directly with a world-class AI research lab building the infrastructure behind tomorrow's intelligent agent ecosystems.

  • Influence the foundations of AI scalability, reliability, and deployment, enabling complex agents to operate in real-world environments.

  • Enjoy schedule flexibility — select your own 4-hour collaboration windows and manage your 20–30 hour work week.

  • Be engaged as an hourly contractor through Mercor, giving you autonomy while contributing to mission-critical AI infrastructure projects.

  • Collaborate with top systems engineers, researchers, and AI developers working at the intersection of distributed systems and advanced intelligence.

  • Join a global network of technical experts shaping how the next generation of AI agents reason, interact, and evolve at scale.

  • Agentic AI Platform Engineer

    7 days ago

    Toronto, Ontario, Canada KData AI Full time $120,000 - $180,000 per year

    Job Title: Agentic AI Platform EngineerClient: Banking ClientLocation:Downtown Toronto (On-site 4 days/week)Position Type:6-Month Contract (Renewable)Domain: Generative AI, Agentic Systems, AI Platform EngineeringRate: up to $90Role SummaryA leading Banking Client is building a next-generationAgentic AI Platformto enable scalable, enterprise-wide deployment...

  • AI agent Infrastructure Engineers

    7 days ago

    Toronto, Ontario, Canada MERCOR Full time $150,000 - $200,000 per year

    Mercor is hiring AI Agent Infrastructure Engineers on behalf of a leading AI Lab developing scalable systems to power the next generation of intelligent, autonomous agents. This is a unique opportunity to work with world-class AI researchers and engineers, building the infrastructure that enables advanced reasoning, multi-agent coordination, and real-world...

  • Agentic AI Engineer

    2 weeks ago

    Toronto, Ontario, Canada Cognichip Full time $150,000 - $250,000 per year

    About the RoleWe are seeking an AI Engineer to design, implement, and deploy advanced agentic AI systems. In this role, you'll build production-ready AI agents that can reason across multiple steps, leverage a mixture of proprietary models, integrate with semiconductor design tools, and operate autonomously over a long period of time.You'll work with state...

  • Network Engineer, AI/ML Infrastructure

    6 days ago

    Toronto, Ontario, Canada Boson AI Full time $120,000 - $180,000 per year

    About The Role We're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph...

  • Network Engineer, AI/ML Infrastructure

    5 days ago

    Toronto, Ontario, Canada Boson AI Full time US$150,000 - US$250,000

    About The RoleWe're seeking an experienced Network Engineer to design, build, and optimize the high-performance networking infrastructure powering our AI/ML operations in Toronto. You'll work at the cutting edge of network technology—managing InfiniBand and ultra-high-speed Ethernet fabrics that connect NVIDIA H100 and A100 GPUs, over 20PB of Ceph storage,...

  • AI Engineer – Agentic Platform

    6 days ago

    Toronto, Ontario, Canada Epiq Full time $120,000 - $180,000 per year

    It's fun to work at a company where people truly believe in what they are doingJob Description:Epiq is at the forefront of AI innovation in the legal tech industry. We are looking for a skilled AI Engineer to be a core member of our team as we build a first-of-its-kind agentic platform. This platform will revolutionize how we serve our global customers in...

  • JD-2025-AIML-1: Senior AI/ML Engineer – Agentic AI

    7 days ago

    Toronto, Ontario, Canada Amyantek Full time $100,000 - $150,000 per year

    JD-2025-AIML-1: Senior AI/ML Engineer – Agentic AILocation: Toronto, ON (Hybrid)Client: Applab/LoblawsType: Full-time Team: Machine Learning Platform / Digital & DataAbout the RoleLoblaws Digital is hiring a Senior AI/ML Engineer with a strong emphasis on Agentic AI systems. This role focuses on building production-grade multi-agent workflows, LLM-powered...

  • Ai Agent Engineer

    6 days ago

    Toronto, Ontario, Canada BMO Full time $103,000 - $192,000 per year

    AI Agent EngineerLocation:Toronto, ONReports to:AI Engineering and Delivery LeadWorks with:Solution Architects, Data Engineers, Product Managers, Business Stakeholders, and cross-functional AI Execution SquadsRole OverviewThe AI Agent Engineer is responsible for designing, developing, deploying, and optimizing autonomous AI agents that enhance advisor...

  • AI Agent Deployment Engineering Manager

    2 days ago

    Toronto, Ontario, Canada Magical Full time $180,000 - $300,000 per year

    AI Agent Deployment Engineering ManagerTeam size scaling: 8 today → ~25 by end of 2026Reports to: Head of Deployment / ProductMagical's agentic AI platform brings AI Agents into the workplace to take over repetitive, soul-crushing workflows that slow teams down. Our customers—especially in healthcare—use Magical to automate high-stakes, high-complexity...

  • Agentic AI Engineer

    7 days ago

    Toronto, Ontario, Canada BULLIT SYSTEMS Full time $120,000 - $180,000 per year

    Responsibilities• Architect and lead development of scalable, production-grade agentic AI systems.• Design serverless, event-driven workflows using Azure Functions, Logic Apps, and Power Automate.• Build and optimize ML models for predictive analytics, anomaly detection, and recommendations using Azure ML, Databricks, and Python.• Integrate agents...