Performance Systems Engineer at Baseten
5 hours ago
Montreal, Quebec, Canada
Baseten
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Transform AI infrastructure as a Performance Systems Engineer at Baseten. You'll be integral in building systems that gauge and enhance performance metrics for AI models, working in a fully remote capacity. As a part of our expansion, Baseten is looking for early-career engineers skilled in high-performance computing and Large Language Model engineering. You will build and automate tools for model evaluation and stress testing, ensuring that our systems are set for success. Your deep dive into performance profiling will be a game-changer in maximizing efficiencies.
Key Responsibilities
• Automate and execute LLM quality benchmarks for various workloads
• Implement tests validating GPU infrastructure’s performance
• Maintain and optimize GPU-enabled environments for development
• Build tools for calculating model performance and configurations
• Develop monitoring systems to track performance metrics in real-time
Requirements:
• Enthusiastic about hardware and AI system optimization
• Aptitude for automation and script creation for testing tasks
• Desire to understand math related to AI models comprehensively
• Proficient in Python, with a basic grasp of C++ preferred
• Keen interest in exploring optimization strategies for models Leverage your skills in performance engineering and GPU systems with Baseten to shape the landscape of AI technology.
Key Responsibilities
• Automate and execute LLM quality benchmarks for various workloads
• Implement tests validating GPU infrastructure’s performance
• Maintain and optimize GPU-enabled environments for development
• Build tools for calculating model performance and configurations
• Develop monitoring systems to track performance metrics in real-time
Requirements:
• Enthusiastic about hardware and AI system optimization
• Aptitude for automation and script creation for testing tasks
• Desire to understand math related to AI models comprehensively
• Proficient in Python, with a basic grasp of C++ preferred
• Keen interest in exploring optimization strategies for models Leverage your skills in performance engineering and GPU systems with Baseten to shape the landscape of AI technology.