AI Serving Platform Developer

1 day ago


Vancouver, British Columbia, Canada Huawei Full time
About the Role

We are seeking an experienced AI Serving Platform Developer to join our Big Data and Intelligence Platform lab at Huawei Canada.

Job Summary

The successful candidate will design, implement, and optimize a high-performance serving platform for large language models (LLMs), integrating SOTA open-source serving frameworks such as vLLM, sglang, or lmdeploy. The ideal candidate will have experience with distributed systems, serverless architectures, and cloud computing platforms, as well as strong proficiency in PyTorch and familiarity with multimodal architectures and serving requirements.

Key Responsibilities
  • Design and implement a high-performance serving platform for MLLMs
  • Integrate SOTA open-source serving frameworks
  • Develop techniques for efficient resource utilization and low-latency inference for MLLMs in serverless environments
  • Optimize memory usage, scalability, and throughput of the serving platform
  • Conduct experiments to evaluate and benchmark MLLM serving performance
Requirements
  • Bachelor's degree or higher in Computer Science, Electrical and Computer Engineering (ECE), or a related field
  • Experience with one or more SOTA LLM serving frameworks
  • Strong proficiency in PyTorch
  • Familiarity with distributed systems, serverless architectures, and cloud computing platforms
What You'll Bring to the Team
  • Previous experience in deploying AI platforms on cloud services
  • Familiarity with inference optimization for large-scale AI models

$120,000 - $150,000 per year, depending on experience



  • Vancouver, British Columbia, Canada Inworld AI Full time

    OverviewInworld AI is a leading developer of cutting-edge AI technologies, powering immersive experiences in games and interactive media.Our innovative platform enables developers to build responsive and personalized AI gaming experiences, orchestrate models to create intelligent game behaviors, and unlock enhanced productivity with AI-generated content.


  • Vancouver, British Columbia, Canada Amazon Full time

    About the RoleWe are seeking an experienced Software Developer to join our team, focusing on developing cutting-edge machine learning platforms for edge AI applications. This role will involve designing and implementing core components of our PyTorch-based ML platform, as well as collaborating with researchers and engineers to integrate state-of-the-art...


  • Vancouver, British Columbia, Canada Borealis AI Full time

    RBC Borealis is at the forefront of AI research and platform development, driving innovation in the financial services industry. As a key member of our organization, you will provide strategic leadership and direction to drive the effectiveness of your team, enabling them to deliver high-value business outcomes through the application of AI.About RBC...


  • Vancouver, British Columbia, Canada Inworld AI Full time

    We are seeking highly experienced professionals to lead the development of cutting-edge Machine Learning systems at Inworld AI. You will be responsible for researching and implementing innovative ML solutions, pushing the boundaries of generative AI products and agentic frameworks.About the RoleDesign and implement production-scale infrastructure to train,...


  • Vancouver, British Columbia, Canada Leonardo Interactive Pty Full time

    About UsAi is an Australian tech startup that has experienced rapid growth since launching our software 18 months ago, with over 16 million users worldwide.Job DescriptionWe're seeking highly skilled Senior Software Engineers with expertise in NodeJS to join our dynamic API team as a key contributor in designing, developing, and maintaining scalable and...


  • Vancouver, British Columbia, Canada mytorso Full time

    We are transforming how people manage chronic lower back tightness and improve their quality of life at mytorso, an early-stage startup with a big mission. Our cutting-edge platform combines E-textiles, wearables, wellness apps, and AI to deliver personalized wellness plans and data-driven progress feedback.About the RoleAs a Full Stack Engineer on our team,...


  • Vancouver, British Columbia, Canada Mindrift Full time

    About MindriftMindrift is a pioneering platform dedicated to advancing the field of artificial intelligence through collaborative online projects. We focus on creating data for Generative AI, offering a unique chance for freelancers to contribute to AI development from anywhere, at any time - without the need to be developers.Our mission is to ethically...


  • Vancouver, British Columbia, Canada Mindrift Full time

    About the CompanyMindrift is a pioneering platform dedicated to advancing artificial intelligence through collaborative online projects. We focus on creating data for Generative AI, offering a unique opportunity for freelancers to contribute to AI development from anywhere in the world.Estimated Salary$80,000 - $120,000 per year, depending on experience and...


  • Vancouver, British Columbia, Canada Inworld AI Full time

    About the RoleWe are seeking a highly skilled and experienced AI researcher to join our team at Inworld AI. As a Staff/Principal AI Researcher, you will be responsible for advancing our AI capabilities by developing state-of-the-art models and contributing to cutting-edge research in artificial intelligence.Key ResponsibilitiesConducting cutting-edge...


  • Vancouver, British Columbia, Canada Inworld AI Full time

    About Inworld AIWe are seeking a seasoned Software Development Engineer in Test to join our team at Inworld AI. As a Senior Automation Engineer, you will focus on designing, creating, and maintaining automation tools that support our test, build, and release processes across multiple platforms (Unreal, Unity, NodeJS, and WebSDK). Our ideal candidate has...


  • Vancouver, British Columbia, Canada Inworld AI Full time

    About the RoleWe are seeking an experienced Unreal Engine software engineer to join our team and work on Inworld SDK, empowering developers and creators to build games and virtual experiences. As a senior member of our engineering team, you will contribute to the development of demos and prototypes showcasing the features and capabilities of the Inworld AI...


  • Vancouver, British Columbia, Canada Secret Labs Full time

    Secret Labs Inc. is a forward-thinking company specializing in chatbot development within the companion sector. We are committed to creating highly sophisticated AI ChatBots.Job DescriptionAs a skilled software engineer, you will play a crucial role in shaping the future of AI companionship. Your primary responsibilities will include:Designing and...


  • Vancouver, British Columbia, Canada Inworld AI Full time

    About InworldInworld is a leading AI engine for games and interactive media, backed by top-tier investors including Intel Capital, Microsoft's M12 fund, Lightspeed Venture Partners, and Kleiner Perkins. Our suite of AI components enables developers to build interactive, responsive, and personalized AI gaming experiences.Why Choose Inworld?We are the...


  • Vancouver, British Columbia, Canada Microsoft Canada Full time

    Company Overview: Microsoft Research is a global network of research labs led by renowned scientists and engineers, focusing on innovation in various scientific and technical disciplines.Salary: $85,000 - $110,000 per year, based on qualifications and experience.Job Description: As an AI Infrastructure Developer at Microsoft Research, you will collaborate...


  • Vancouver, British Columbia, Canada Inworld AI Full time

    At Inworld AI, we are shaping the future of artificial intelligence by developing and executing on the vision for AI-driven video games and interactive experiences.This unique role as a Forward Deployed Engineer will have you working closely with high-profile partners to define, deploy, and launch groundbreaking immersive experiences. You will build 0 to 1...


  • Vancouver, British Columbia, Canada CoPilot AI Full time

    About the RoleWe are seeking an experienced Customer Success Strategist to join our team at CoPilot AI in Vancouver, BC. As a key member of our customer-facing team, you will be responsible for ensuring our customers achieve their goals using our AI-driven solutions.The ideal candidate will have a strong background in customer success, with experience...


  • Vancouver, British Columbia, Canada Electronic Arts Full time

    Electronics Arts AI Innovation CatalystWe are a global team of creators, storytellers, technologists, experience originators, innovators and so much more. We believe amazing games and experiences start with teams as diverse as the players and communities we serve.Ea Sports revolutionizes the world of gaming by driving transformational change in how games are...


  • Vancouver, British Columbia, Canada CoPilot AI Full time $70,000 - $110,000

    At CoPilot AI, an award-winning Vancouver-based SaaS startup, we're revolutionizing how businesses grow by humanizing digital interactions at scale. Our mission is built on the belief in the power of authentic, mutually beneficial human connections as the cornerstone of business growth. Through our innovative AI technology, we target qualified prospects on...

  • Software Engineer

    5 days ago


    Vancouver, British Columbia, Canada mytorso Full time

    Empower individuals to live healthier lives with our cutting-edge wellness platform. We're an early-stage startup developing a comprehensive system that combines AI, wearables, and E-textiles for personalized wellness plans.About MyTorsoWe're on a mission to transform how people manage chronic lower back tightness and improve their quality of life. Our...


  • Vancouver, British Columbia, Canada Inworld AI Full time

    Why Inworld AI is the Perfect Fit for YouIn a world where technology is rapidly advancing, Inworld AI stands out as a pioneer in the field of Artificial Intelligence and interactive media. With a valuation of $500 million and backing from top-tier investors, our company is poised for continued growth and success.As a leading provider of AI engines for games...