Senior Machine Learning Inference Engineer
2 days ago
winnipeg, manitoba, Canada
Raydar
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Optimize machine learning inference with GPU performance tuning while working remotely from Canada or the UK in a full-time position. Build dependable serving systems for high request volumes.
Raydar recruits for its software company client, seeking a senior engineer to move trained models from research into production. The work combines server-side software, inference optimization frameworks, systems programming, and distributed serving. You will improve model performance and operate services across GPUs and nodes.
Key Responsibilities: Optimize model serving latency and throughput
Containerize models for stable production deployment
Profile and tune GPU-based code
Design distributed serving across GPUs and nodes
Apply quantization, batching, and caching methods
Requirements: Senior-level software or inference engineering experience
Production experience with server-side or learning-based software
Machine learning inference optimization framework experience
C++, CUDA, Rust, or optimized Python proficiency
Distributed systems and container orchestration familiarity
Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.
Raydar recruits for its software company client, seeking a senior engineer to move trained models from research into production. The work combines server-side software, inference optimization frameworks, systems programming, and distributed serving. You will improve model performance and operate services across GPUs and nodes.
Key Responsibilities: Optimize model serving latency and throughput
Containerize models for stable production deployment
Profile and tune GPU-based code
Design distributed serving across GPUs and nodes
Apply quantization, batching, and caching methods
Requirements: Senior-level software or inference engineering experience
Production experience with server-side or learning-based software
Machine learning inference optimization framework experience
C++, CUDA, Rust, or optimized Python proficiency
Distributed systems and container orchestration familiarity
Use inference optimization, GPU programming, and distributed systems expertise to deliver reliable machine learning production serving.