Senior LLM Inference Performance Engineer
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
A senior machine learning systems engineer will optimize LLM inference performance with Python, PyTorch, and AWS Trainium remotely anywhere in Canada. The focus includes decode latency and throughput.
At Capgemini Engineering, this hands-on engineer improves production-grade model serving across Trainium2 and Trainium3. The work covers vLLM on AWS Neuron, Qwen-family models, speculative decoding, multi-token prediction, and reproducible benchmarking against GPUs. You will address long-context and multi-chip scaling.
Key Responsibilities:
- Improve decode latency, throughput, cost, and correctness on Trainium
- Implement speculative decoding and native multi-token prediction
- Design matched tests controlling prompts, concurrency, cache, and warm-up
- Scale long-context serving across multi-chip Trainium systems
- Create runbooks, guides, documentation, and hands-on workshops
Requirements:
- Five-plus years in machine learning or systems engineering
- Two-plus years in production model inference or serving
- Strong Python and PyTorch proficiency modifying model implementations
- Experience with vLLM, TensorRT-LLM, SGLang, or Triton
- Understanding of prefill, decode, batching, parallelism, and cost
Apply machine learning systems expertise to optimize AWS Trainium inference, benchmarking, and serving performance at Capgemini Engineering.
-
Toronto, ON, ON, Canada Capgemini Engineering Full-timeAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Toronto, ON, Canada Capgemini Engineering Remote Full-time $101,000 - $194,000 ContractAt Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world’s most innovative companies unleash their potential. From autonomous cars to life‑saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...
-
Toronto, ON, Canada FullStack Full-time $120,000 - $180,000 ContractFullStack is seeking a Senior AI Engineer to join our talent network and work with U.S. clients on flexible, project-based development. You will integrate directly into client teams and contribute to production-grade AI inference on GPU infrastructure.Requirements include 5+ years in AI/ML engineering, advanced English, a four-year degree, and hands-on...
-
Senior AI Engineer
2 days ago
Toronto, ON, Canada FullStack Full-timeAbout FullStack FullStack is your AI-native engineering partner, built to turn AI capability into certainty. Most companies can demo AI; few can get it to production and prove what it produced. We close that gap with three capabilities, AI built into your products from the start, elite vetted talent who apply it, and transparent execution that shows value...
-
Senior Inference Engineer
3 days ago
Toronto, ON, Canada Thomson Reuters Full-time $100,000 - $145,000 ContractThomson Reuters is seeking a Senior Inference Engineer, AI. This person will collaborate with platform teams to enhance capacity forecasting for AI workloads and work with Product, Data Science, Architecture, and Enterprise AI teams to onboard new research models into production. About The Role Within Platform Engineering and Enterprise AI Services, an AI...
-
Senior Software Engineer, LLM
3 days ago
Toronto, ON, Canada NVIDIA Full-timeNVIDIA's technology is at the heart of the AI revolution, touching people across the planet by powering everything from self-driving cars, robotics, and intelligent assistants. Come join the team and see how you can make a lasting impact on the world! We are looking for someone who's curious, tenacious, and passionate to join our applied research team. We...
-
Senior Software Engineer, LLM
3 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada NVIDIA Full-time €195,000 - €390,000 TemporaryNVIDIA's technology is at the heart of the AI revolution, touching people across the planet by powering everything from self-driving cars, robotics, and intelligent assistants. Come join the team and see how you can make a lasting impact on the world! We are looking for someone who's curious, tenacious, and passionate to join our applied research team. We...
-
Senior FE Engineer
4 days ago
Toronto, ON, Canada Cerebras Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...
-
Toronto, ON, Toronto Census Division, ON; Ontario, Canada FullStack Full-timeFullStack is seeking a Senior AI Engineer to join our talent network and work with U.S. clients on flexible, project-based development. You will integrate directly into client teams and contribute to production-grade AI inference on GPU infrastructure. Requirements include 5+ years in AI/ML engineering, advanced English, a four-year degree, and hands-on...
-
Senior FE Engineer
4 days ago
Toronto, ON, Toronto Census Division, ON; Ontario, Canada Cerebras Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...