Backend Engineer for Inference Optimization
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Candidates for this position must have over five years of backend engineering experience and strong programming skills in Go, Rust, or C++. You'll work on building backend services that enhance Cohere's enterprise API, focusing on batching strategies and performance optimization.
Key Responsibilities: • Establish low-latency serving infrastructure for model inference • Develop backend services for the enterprise-level API • Implement batching strategies to maximize throughput efficiency • Optimize model serving and inference processes • Collaborate within a remote-first culture
Requirements: • 5+ years of relevant backend engineering experience • Proficiency in Go, Rust, or C++ • Experience with low-latency and high-throughput systems • Knowledge of model serving optimization • Familiarity with gRPC, REST APIs, and microservices
Utilize your expertise in backend engineering to drive innovations in model inference at Cohere.
-
Backend Engineer — Model Inference
7 hours ago
Winnipeg, Manitoba, Canada Best AI Tools Wiki Full-timeCohere is hiring a Backend Engineer to optimize model inference systems. You will build low-latency serving infrastructure, implement batching strategies, and develop the backend services that power Cohere's enterprise API. Requirements5+ years of backend engineering experience Strong proficiency in Go, Rust, or C++ Experience with high-throughput,...
-
Staff Backend Engineer, Customer Value Optimization
10 hours ago
Winnipeg, Manitoba, Canada HelloFresh Full-timeThe Role We're looking for a Staff Backend Engineer to join our Customer Value Optimization (CVO) tribe at HelloFresh. This is a high-impact individual contributor role sitting at the intersection of Data Science and Backend Engineering. You'll be the technical bridge that turns ML models into reliable, scalable production systems.You'll work across squads...
-
Frontend Engineer
10 hours ago
Winnipeg, Manitoba, Canada Baseten Full-timeAbout Baseten Baseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're...
-
Software Engineer, Inference Platform
5 hours ago
Winnipeg, Manitoba, Canada Cerebras Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...
-
Staff Software Engineer, Inference API
10 hours ago
Winnipeg, Manitoba, Canada Engg Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...
-
AI Inference Engineer
3 hours ago
Winnipeg, Manitoba, Canada Urban Ridge Supplies Full-timeAbout BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're...
-
Staff Software Engineer, Inference API
10 hours ago
Winnipeg, Manitoba, Canada Cerebras Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...
-
Senior Software Engineer, Inference
7 hours ago
Winnipeg, Manitoba, Canada AssemblyAI, Inc. Full-timeWhy AssemblyAI AssemblyAI builds the best-in-class Voice AI models powering the next generation of voice applications. Our models serve 600M+ inference calls monthly, process 1M+ hours of audio daily, and power 2 billion+ end-user experiences. The Voice AI space is at an inflection point; we’re looking for folks truly excited to join a small team and help...
-
Senior FE Engineer
5 hours ago
Winnipeg, Manitoba, Canada Cerebras Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...
-
Staff AI Inference Systems Engineer
7 hours ago
Winnipeg, Manitoba, Canada Engg Full-timeCerebras Systems is building a new generation of disaggregated AI inference systems. We are hiring a Software Engineer to evolve the ML API layer for a heterogeneous serving system across models and accelerator backends. You will work across inference APIs, model integration, vLLM-based runtime, and Cerebras runtime components to deliver a consistent...