Senior Software Engineer for ML Inference APIs
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
In this versatile position, you will enhance existing infrastructure and design new APIs that facilitate real-time AI applications. The ideal candidate will thrive in a collaborative environment and contribute to optimizing performance while ensuring API integrity and user satisfaction.
Key Responsibilities: • Build and maintain ML inference APIs that support tool calling and multimodal inputs • Ensure a unified experience across diverse machine learning models • Collaborate on integrating library features with existing runtimes • Design robust testing and qualification measures for APIs • Optimize request handling and throughput for production systems
Requirements: • 5+ years in software engineering, with a focus on production APIs • Strong programming skills in Python, Go, and familiarity with C++ • Expertise in building reliable, performant APIs and distributed systems • Experience with cloud infrastructure and container orchestration • Excellent communication skills and ability to translate user needs into software solutions
Drive innovation at Cerebras by developing robust ML APIs that enhance AI capabilities and improve user interactions.
-
Staff Software Engineer, Inference API
15 hours ago
Winnipeg, Manitoba, Canada Cerebras Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...
-
Staff Software Engineer, Inference API
1 day ago
Winnipeg, Manitoba, Canada Engg Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services. This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...
-
Sr. Staff Software Engineer, Inference Platform
6 hours ago
Winnipeg, Manitoba, Canada Cerebras Full-timeCerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. This architecture allows Cerebras to deliver industry-leading training and inference speeds; over 10 times faster than GPU-based hyperscale cloud inference services.This order of magnitude increase in speed is transforming the user experience of AI applications, unlocking...
-
AI Inference Engineer
2 hours ago
Winnipeg, Manitoba, Canada Urban Ridge Supplies Full-timeAbout BasetenBaseten powers mission-critical inference for the world's most dynamic AI companies, like Cursor, Notion, OpenEvidence, Abridge, Clay, Gamma, and Writer. By uniting applied AI research, flexible infrastructure, and seamless developer tooling, we enable companies operating at the frontier of AI to bring cutting-edge models into production. We're...
-
Staff AI Inference Systems Engineer
1 day ago
Winnipeg, Manitoba, Canada Engg Full-timeCerebras Systems is building a new generation of disaggregated AI inference systems. We are hiring a Software Engineer to evolve the ML API layer for a heterogeneous serving system across models and accelerator backends. You will work across inference APIs, model integration, vLLM-based runtime, and Cerebras runtime components to deliver a consistent...
-
Senior Backend Engineer
10 hours ago
Winnipeg, Manitoba, Canada CL fe480788 2713 42d9 8438 0a179c82deb4 Full-timeSenior Backend Engineer - .NET and AI/ML (Backend Systems • Distributed Architecture • gRPC Microservices • Cloud Services • AI/ML & LLM Engineering)Full Time | HybridZonda is redefining the future of housing. We are perfectly placed in the heart of the fast-growing real estate industry. We are making big bets on the future of real-estate,...
-
Senior AI/ML Software Engineer
4 days ago
Winnipeg, Manitoba, Canada Socket.dev Full-timeGeneral Motors of Canada is seeking a Senior Software Developer for the SimCore team to build and deploy applied AI/ML solutions that support simulation workflows, internal tools, and mission-critical engineering use cases. You will work across exploration to production, delivering robust and high-performance inference pipelines. Ideal candidates have...
-
Senior / Staff ML Ops Engineer
2 hours ago
Winnipeg, Manitoba, Canada Waabi Full-timeWaabi, founded by AI visionary Raquel Urtasun, is the leader in Physical AI. With a world-class team, we’re unlocking the next era of autonomous transportation with technology that’s powering commercial autonomous trucks and robotaxis. Waabi is backed by and partners with world leaders in AI, automotive, logistics, and deep tech. With offices in Toronto,...
-
Principal AI/ML Engineer
10 hours ago
Winnipeg, Manitoba, Canada The Vanguard Group Full-timeAs a Principal AI Engineer, you will serve as a senior technical leader responsible for transforming state‑of‑the‑art AI research into scalable, production‑ready capabilities that create measurable value for our clients. You will lead the architecture, engineering, operationalization, and ongoing reliability of advanced AI systems, ensuring they can...
-
Principal AI/ML Engineer
15 hours ago
Winnipeg, Manitoba, Canada Vanguard Full-timeAs a Principal AI Engineer, you will serve as a senior technical leader responsible for transforming state-of-the-art AI research into scalable, production-ready capabilities that create measurable value for our clients. You will lead the architecture, engineering, operationalization, and ongoing reliability of advanced AI systems, ensuring they can scale...