AI Runtime Engineer

1 week ago

US Canada Germany Norway EnCharge AI Full time US$125,000 - US$175,000 per year

EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge's robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today's best-in-class solutions. The high-performance architecture is coupled with seamless software integration and will enable the immense potential of AI to be accessible in power, energy, and space constrained applications. EnCharge AI launched in 2022 and is led by veteran technologists with backgrounds in semiconductor design and AI systems.

About the Role

EnCharge AI is seeking an AI Runtime Engineer to develop and optimize the execution stack for our next-generation AI accelerator. In this role, you will work on low-latency, high-performance runtime software that enables efficient execution of deep learning models on specialized hardware. You will collaborate with hardware, compiler, and AI framework teams to deliver optimized AI inference and training performance across cloud and edge environments. 

Responsibilities

  • Develop and optimize the AI runtime software stack for executing deep learning workloads on AI accelerators.
  • Implement task scheduling, memory management, and kernel execution strategies for efficient computation.
  • Optimize data movement between host and device using PCIe, DMA, shared memory.
  • Design and implement high-performance APIs for AI Inference frameworks such as OpenVino, ONNX Runtime, vLLM
  • Work on graph execution optimizations, including kernel fusion, pipelining, tensor tiling, and caching.
  • Integrate runtime components with AI compilers (LLVM, MLIR, XLA, TVM) for optimized execution.
  • Ensure scalability and reliability of the AI runtime for cloud-based and edge AI deployments. 

Qualifications

  • Bachelor's or Master's degree in Computer Science, Electrical Engineering, or a related field.
  • 3+ years of experience in developing low-level runtime software for AI accelerators, GPUs, or HPC systems.
  • Strong proficiency in C/C++ and low-level systems programming.
  • Deep understanding of task scheduling, concurrency, and memory hierarchy.
  • Experience with hardware-aware optimizations and dataflow architectures.
  • Familiarity with deep learning execution frameworks (ONNX Runtime, TensorRT, TVM, OpenVINO).
  • Experience with low-latency, high-throughput workload execution for AI models.
  • Strong debugging and profiling skills for optimizing AI execution performance.
  • Exposure to AI model deployment pipelines (Triton, TensorFlow Serving). 

EnchargeAI is an equal employment opportunity employer in the United States.

  • LLM Inference Deployment Engineer

    4 hours ago

    U.S., Canada, Germany, Norway EnCharge AI Full time US$120,000 - US$200,000 per year

    EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge's robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today's best-in-class solutions. The high-performance architecture is coupled with seamless software...

  • Embedded SW Engineer

    4 hours ago

    U.S., Canada, Germany, Norway EnCharge AI Full time US$120,000 - US$180,000 per year

    EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge's robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today's best-in-class solutions. The high-performance architecture is coupled with seamless software...

  • AI Compiler Engineer

    6 hours ago

    U.S., Canada, Germany, Norway EnCharge AI Full time US$120,000 - US$200,000 per year

    EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge's robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today's best-in-class solutions. The high-performance architecture is coupled with seamless software...

  • AI Research Engineer

    6 days ago

    Canada, Germany, Norway, United States EnCharge AI Full time $120,000 - $180,000 per year

    EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge's robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today's best-in-class solutions. The high-performance architecture is coupled with seamless software...

  • Device Driver Engineer

    8 hours ago

    U.S., Canada, Germany, Norway EnCharge AI Full time US$120,000 - US$200,000 per year

    EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge's robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today's best-in-class solutions. The high-performance architecture is coupled with seamless software...

  • NPU Architect

    1 week ago

    U.S., Canada, Germany EnCharge AI Full time $150,000 - $250,000 per year

    EnCharge AI is a leader in advanced AI hardware and software systems for edge-to-cloud computing. EnCharge's robust and scalable next-generation in-memory computing technology provides orders-of-magnitude higher compute efficiency and density compared to today's best-in-class solutions. The high-performance architecture is coupled with seamless software...

  • Senior NodeJS Engineer

    3 weeks ago

    , BC, Canada Inworld AI Full time

    Direct message the job poster from Inworld AI At Inworld, we believe the processes of building, scaling, and evolving applications are monsters that consume value before it can reach users. Our mission is to solve evolution and transform static software into AI systems that autonomously evolve to better serve their users. We are building an intelligent...

  • Researcher - Runtime Assurance

    2 hours ago

    Hagey Boulevard Waterloo, Ontario, NL A Canada Huawei Technologies Canada Co. Full time $120,000 - $180,000 per year

    Job description Huawei Canada has an immediate a 12-month contract opening for a Researcher.About the team:The Intelligent Complex Systems Team, currently a part of the Waterloo Research Centre, examines recent advancements in artificial intelligence (AI) and robotics to determine its potential for broader applications. This innovative team researches AI...

  • Senior Software Engineer

    2 weeks ago

    , , Canada Sysdig Full time

    At Sysdig, we believe cloud security isn't a compromise - it's a promise. From the start, our mission has been clear: to help organizations secure innovation in the cloud, the right way. We created Falco, the open standard for cloud threat detection, and continue to lead the cloud security market with runtime insights, open innovation, and agentic Al....

  • Senior Frontend Engineer

    2 weeks ago

    , BC, Canada Inworld AI Full time

    Senior Frontend (Web) Software Engineer At Inworld, we believe the processes of building, scaling, and evolving applications are monsters that consume value before it can reach users. Our mission is to solve evolution and transform static software into AI systems that autonomously evolve to better serve their users. We are building an intelligent runtime to...