Large Language Model Optimization Manager
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
By continuing, you agree to our Terms & Privacy Policy.
Optimize large language model systems at Capital One Canada with PyTorch, similarity search, and responsible AI engineering in a hybrid model.
As Manager AI Engineer, you will develop production capabilities that help reimagine banking through emerging AI technologies. You will investigate research, apply novel techniques, and improve hardware utilization across large-scale systems. Your partnerships will include engineers, scientists, product managers, and technical program managers.
Key Responsibilities:
- Train foundation models and develop large language model inference
- Implement similarity search, VectorDBs, memory, and guardrails
- Experiment with and evaluate responsible AI system performance
- Improve scalability, hardware utilization, latency, throughput, and cost
- Share technical ideas and clarify complex engineering problems
Requirements:
- Bachelor’s degree and four years of AI experience
- Master’s degree and two years of AI experience
- Four years programming in Python, Go, Scala, or Java
- AI and mathematics expertise supporting optimization opportunities
- Passion for current AI research and production application
Apply deep AI engineering and optimization expertise to large language model infrastructure at Capital One Canada.