Staff Machine Learning Infrastructure Engineer
16 hours ago
Winnipeg, Manitoba, Canada
Cohere
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Build high-performance machine learning systems at Cohere with Kubernetes, distributed systems, and production infrastructure expertise. Work model details are not specified.
Cohere seeks Members of Technical Staff for its Model Serving team. You will develop, deploy, and operate the AI platform delivering large language models through easy-to-use API endpoints. The work supports optimized NLP models in low-latency, high-throughput, high-availability environments.
Key Responsibilities:
Develop the AI platform serving Cohere large language models Deploy optimized NLP models to production environments Operate low-latency, high-throughput, highly available systems Collaborate across teams on mission-critical infrastructure Create customized deployments for customer-specific needs Requirements:
5+ years running production infrastructure at large scale Design experience with distributed systems and Kubernetes Experience supporting GPU workloads on Kubernetes clusters Cloud experience with GCP, Azure, AWS, or OCI Golang, C++, or other high-performance server languages Apply machine learning infrastructure, Kubernetes, and distributed systems expertise to Cohere’s scalable Model Serving platform.
Develop the AI platform serving Cohere large language models Deploy optimized NLP models to production environments Operate low-latency, high-throughput, highly available systems Collaborate across teams on mission-critical infrastructure Create customized deployments for customer-specific needs Requirements:
5+ years running production infrastructure at large scale Design experience with distributed systems and Kubernetes Experience supporting GPU workloads on Kubernetes clusters Cloud experience with GCP, Azure, AWS, or OCI Golang, C++, or other high-performance server languages Apply machine learning infrastructure, Kubernetes, and distributed systems expertise to Cohere’s scalable Model Serving platform.