Senior Machine Learning Inference Engineer

2 hours ago

Winnipeg, Manitoba, Canada raydar Full-time
Optimize machine learning inference with GPU performance tuning while working remotely from Canada or the UK in a full-time position. Build dependable serving systems for high request volumes. Raydar recruits for its software company client, seeking a senior engineer to move trained models from research into production. The work combines server-side software, inference optimization frameworks, systems programming, and distributed serving. You will improve model performance and operate services across GPUs and nodes. Key Responsibilities:

Optimize model serving latency and throughput Containerize models for stable production deployment Profile and tune GPU-based code Design distributed serving across GPUs and nodes Apply quantization, batching, and caching methods Requirements:

Senior-level software or inference engineering experience Production experience with server-side or learning-based software Machine learning inference optimization framework experience C++, CUDA, Rust, or optimized Python proficiency Distributed systems and container orchestration familiarity Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.