Large Language Model Optimization Manager

17 hours ago

Toronto, ON, Canada Capital One - CA Full-time $173,000 - $197,000 Contract

Optimize large language model systems at Capital One Canada with PyTorch, similarity search, and responsible AI engineering in a hybrid model.

As Manager AI Engineer, you will develop production capabilities that help reimagine banking through emerging AI technologies. You will investigate research, apply novel techniques, and improve hardware utilization across large-scale systems. Your partnerships will include engineers, scientists, product managers, and technical program managers.

Key Responsibilities:

  • Train foundation models and develop large language model inference
  • Implement similarity search, VectorDBs, memory, and guardrails
  • Experiment with and evaluate responsible AI system performance
  • Improve scalability, hardware utilization, latency, throughput, and cost
  • Share technical ideas and clarify complex engineering problems

Requirements:

  • Bachelor’s degree and four years of AI experience
  • Master’s degree and two years of AI experience
  • Four years programming in Python, Go, Scala, or Java
  • AI and mathematics expertise supporting optimization opportunities
  • Passion for current AI research and production application

Apply deep AI engineering and optimization expertise to large language model infrastructure at Capital One Canada.