AI Systems Engineer – Serverless Distributed Computing

1 day ago

Markham, Ontario, Canada Huawei Canada Full time $120,000 - $180,000 per year

**Huawei Canada has an immediate permanent opening for a Software Engineer.

About the team:**
The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including cloud-native disaggregated databases, pay-by-query user models, and optimizing low-level data transfers via RDMA. Teams within this lab create advanced cloud serverless data infrastructure and implement cutting-edge networking technologies for Huawei's global AI infrastructure.

About the job:

  • Architect and develop frameworks and engines for next-generation serverless computing tailored to AI workloads (LLM training/inference, agent execution, RL training, etc.).
  • Analyze and optimize end-to-end AI system performance, including distributed scheduling, data flow, and memory utilization across large clusters.
  • Research and evaluate cutting-edge technologies in distributed computing, serverless infrastructure, reinforcement learning, and LLM-based AI agents.
  • Collaborate cross-functionally with research, product, and platform teams to transform conceptual AI agent or RL research into scalable production systems.
  • Contribute thought leadership through innovation, technical presentations, and patent generation.
  • Stay ahead of industry trends, assessing emerging tools and frameworks (e.g., Ray, SkyPilot, vLLM, DeepSpeed, Mojo, etc.) to inform team.

Job requirements

About the ideal candidate:

  • PhD with research background in LLM systems, RL, AI agents, or distributed computing, or MS in Computer Science, Electrical Engineering, or related field with 3–4 years of AI industry experience.
  • Strong system design and software engineering skills, including experience with C++ or Python, concurrency, performance tuning, and large-scale distributed systems.
  • Proven expertise in one or more of the following areas:
  • AI system architecture — LLM training/inference pipeline optimization, multi-agent orchestration, or reinforcement learning frameworks.
  • Serverless / distributed infrastructure — autoscaling, resource scheduling, fault recovery, or cloud-native microservices.
  • Ability to lead complex technical projects, mentor peers, and deliver solutions with measurable impact.
  • Publications, open-source contributions, or patents in AI systems, RL, or distributed computing is an asset.
  • Familiarity with GPU cluster management, model parallelism, or memory-optimized inference (e.g., KVCache, offloading strategies) is an asset.
  • Demonstrated ability to bridge research and engineering, bringing experimental AI methods into production-grade systems is an asset.

  • Software Engineer – Serverless Distributed Computing

    1 day ago

    Markham, Ontario, Canada Huawei Technologies Canada Co., Ltd. Full time $120,000 - $180,000 per year

    Huawei Canada has an immediate permanent opening for a Software Engineer.About the team: The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including cloud-native...

  • Software Engineer – Serverless Distributed Computing

    2 days ago

    Markham, Ontario, Canada Huawei Technologies Canada Co., Ltd. Full time $120,000 - $180,000 per year

    Huawei Canada has an immediate permanent opening for a Software Engineer. About the team: The Distributed Data Storage and Management Lab leads research in distributed data systems, aiming to develop next-generation cloud serverless products that encompass core infrastructure and databases. This lab addresses various data challenges, including...

  • Engineer, AI Systems Architecture

    2 days ago

    Markham, Ontario, Canada Qualcomm Full time $80,000 - $120,000 per year

    Company:Qualcomm Canada ULCJob Area:Engineering Group, Engineering Group > Machine Learning EngineeringGeneral Summary:Do you ever wonder when will connected devices become thinking devices? Be part of the group that is working on technology that will bring "Cognition" to all connected devices: That means devices that don't just think but instinctively react...

  • Staff Engineer, AI/Machine Learning/Embedded Systems

    1 day ago

    Markham, Ontario, Canada Qualcomm Full time US$1,240,000 - US$2,000,000 per year

    Company:Qualcomm Canada ULCJob Area:Engineering Group, Engineering Group > Machine Learning EngineeringGeneral Summary: Qualcomm is a company of inventors that unlocked 5G ushering in an age of rapid acceleration in connectivity and new possibilities that will transform industries, create jobs, and enrich lives. But this is just the beginning. It takes...

  • Sr. Systems Design Engineer

    4 days ago

    Markham, Ontario, Canada Advanced Micro Devices, Inc Full time $120,000 - $180,000 per year

    WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create...

  • Systems Design Engineer Compute Graphics Business Unit

    1 day ago

    Markham, Ontario, Canada Advanced Micro Devices, Inc Full time US$120,000 - US$180,000 per year

    WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create...

  • SoC System Performance Architect AI/ML

    1 day ago

    Markham, Ontario, Canada Advanced Micro Devices, Inc Full time US$60,000 - US$200,000 per year

    WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create...

  • AI Enablement Engineer

    1 day ago

    Markham, Ontario, Canada Advanced Micro Devices, Inc Full time $80,000 - $120,000 per year

    WHAT YOU DO AT AMD CHANGES EVERYTHING At AMD, our mission is to build great products that accelerate next-generation computing experiences—from AI and data centers, to PCs, gaming and embedded systems. Grounded in a culture of innovation and collaboration, we believe real progress comes from bold ideas, human ingenuity and a shared passion to create...

  • Staff Software Engineer, AI Runtime

    2 days ago

    Markham, Ontario, Canada Qualcomm Full time $120,000 - $200,000 per year

    CompanyQualcomm Canada ULCJob AreaEngineering Group, Engineering Group > Machine Learning EngineeringGeneral SummaryStaff Software Engineer – Qualcomm AI RuntimeAI is revolutionizing how we solve complex, cross-domain challenges—and Generative AI (GenAI) and Agentic AI is at the forefront of this transformation. As part of the AI Software team, you will...

  • Staff Software Engineer, AI Runtime

    1 day ago

    Markham, Ontario, Canada Qualcomm Full time $120,000 - $180,000 per year

    Company:Qualcomm Canada ULCJob Area:Engineering Group, Engineering Group > Machine Learning EngineeringGeneral Summary:Staff Software Engineer – Qualcomm AI RuntimeAI is revolutionizing how we solve complex, cross-domain challenges—and Generative AI (GenAI) and Agentic AI is at the forefront of this transformation. As part of the AI Software team, you...