Senior Machine Learning Api Engineer
3 days ago
Winnipeg MB, Winnipeg Census Division, MB; Manitoba, Canada
Cerebras
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Build machine learning APIs at Cerebras Systems using Python and distributed systems expertise to power heterogeneous AI inference services.
As a Senior Software Engineer, you will evolve the ML API layer across inference APIs, model integration, and request routing. The work spans API design, model serving, and distributed systems. You will translate model capabilities and customer requirements into reliable production software.
Key Responsibilities
Own inference features from design through production operationImplement chat, streaming, sampling, tool calling, and structured outputsIntegrate models, tokenizers, templates, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
Five or more years of software engineering experienceStrong Python programming and proficiency in another production languageExperience evolving production APIs and distributed componentsExperience with Linux, containers, Kubernetes, and CI/CDAbility to diagnose correctness, reliability, and performance issuesApply machine learning systems, API design, and distributed software expertise to advance Cerebras inference reliability and performance.
#J-18808-Ljbffr
As a Senior Software Engineer, you will evolve the ML API layer across inference APIs, model integration, and request routing. The work spans API design, model serving, and distributed systems. You will translate model capabilities and customer requirements into reliable production software.
Key Responsibilities
Own inference features from design through production operationImplement chat, streaming, sampling, tool calling, and structured outputsIntegrate models, tokenizers, templates, and generation configurationCoordinate routing between GPU prefill and Cerebras decodeBuild tests, benchmarks, metrics, and diagnostic toolsRequirements:
Five or more years of software engineering experienceStrong Python programming and proficiency in another production languageExperience evolving production APIs and distributed componentsExperience with Linux, containers, Kubernetes, and CI/CDAbility to diagnose correctness, reliability, and performance issuesApply machine learning systems, API design, and distributed software expertise to advance Cerebras inference reliability and performance.
#J-18808-Ljbffr