Senior Machine Learning Inference Engineer
2 hours ago
Winnipeg, Manitoba, Canada
raydar
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Optimize machine learning inference with GPU performance tuning while working remotely from Canada or the UK in a full-time position. Build dependable serving systems for high request volumes.
Raydar recruits for its software company client, seeking a senior engineer to move trained models from research into production. The work combines server-side software, inference optimization frameworks, systems programming, and distributed serving. You will improve model performance and operate services across GPUs and nodes.
Key Responsibilities:
Optimize model serving latency and throughput Containerize models for stable production deployment Profile and tune GPU-based code Design distributed serving across GPUs and nodes Apply quantization, batching, and caching methods Requirements:
Senior-level software or inference engineering experience Production experience with server-side or learning-based software Machine learning inference optimization framework experience C++, CUDA, Rust, or optimized Python proficiency Distributed systems and container orchestration familiarity Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.
Optimize model serving latency and throughput Containerize models for stable production deployment Profile and tune GPU-based code Design distributed serving across GPUs and nodes Apply quantization, batching, and caching methods Requirements:
Senior-level software or inference engineering experience Production experience with server-side or learning-based software Machine learning inference optimization framework experience C++, CUDA, Rust, or optimized Python proficiency Distributed systems and container orchestration familiarity Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.