Current jobs related to Member of Technical Staff, Training and Inference - Toronto, Ontario - Boson AI
-
Member of Technical Staff, Agent Code
8 hours ago
Toronto, Ontario, Canada Cohere Full timeWho are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...
-
Member of Technical Staff
1 week ago
Toronto, Ontario, Canada Cohere Full timeWho are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...
-
Senior Product Manager – Inference
6 days ago
Toronto, Ontario, Canada BenchSci Full timeWe are looking for a Senior Product Manager to join our growing Product Management team. This is a challenging, highly strategic position that sits at the critical intersection of our predictive AI engine, external strategic partners, and internal product lines. You will act as the custodian of our core inference and prediction technology, balancing its...
-
Senior Product Manager – Inference
6 days ago
Toronto, Ontario, Canada BenchSci Full timeWe are looking for a Senior Product Manager to join our growing Product Management team.This is a challenging, highly strategic position that sits at the critical intersection of ourpredictive AI engine, external strategic partners, and internal product lines.You will act as the custodian of our core inference and prediction technology, balancing...
-
Senior Product Manager – Inference
6 days ago
Toronto, Ontario, Canada BenchSci Full timeWe are looking for a Senior Product Manager to join our growing Product Management team.This is a challenging, highly strategic position that sits at the critical intersection of ourpredictive AI engine, external strategic partners, and internal product lines.You will act as the custodian of our core inference and prediction technology, balancing...
-
Senior Product Manager – Inference
4 days ago
Toronto, Ontario, Canada BenchSci Full timeWe are looking for a Senior Product Manager to join our growing Product Management team. This is a challenging, highly strategic position that sits at the critical intersection of our predictive AI engine, external strategic partners, and internal product lines. You will act as the custodian of our core inference and prediction technology, balancing its...
-
Member of Technical Staff
2 weeks ago
Toronto, Ontario, Canada Wind River Full timeDescriptionPosition at Wind RiverMember of Technical Staff - Cloud Engineer (Analytics)About Wind RiverAt Wind River, we use analytics tools such as Elasticsearch and Kibana to accelerate the development of solutions that allow our customers to visualize their networks and act on issues. We have adopted these technologies into Wind River Cloud Analytics. The...
-
Toronto, Ontario, Canada Altera Full timeJob DetailsJob Description:Senior Hardware/Software ML Inference IP and Compiler DeveloperAltera is one of the world's leading providers of programmable solutions. With a renewed focus on agility and software-first useability, Altera is shaping the future of computing by providing flexible technology, empowering innovators with scalable products, from...
-
Data Scientist, Staff
6 days ago
Toronto, Ontario, Canada RBC Full timeAbout The CompanyRBC (Royal Bank of Canada) is one of the largest and most reputable financial institutions in Canada and globally, renowned for its commitment to innovation, customer service, and community support. With a rich history spanning over a century, RBC offers a wide range of financial services including personal banking, commercial banking,...
-
Toronto, Ontario, Canada Cohere Full timeWho are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...
Member of Technical Staff, Training and Inference
2 weeks ago
We are seeking research scientists and engineers to join our team full-time in our Santa Clara office. As part of your role, you will work on implementing and improving distributed optimization algorithms, performance tune architectures, improve inference and help us make Deep Networks perform efficiently on our cluster. The ideal candidate will possess a strong background in CUDA, Triton, PyTorch, distributed optimization and deep learning architectures.
We encourage you to apply even if you do not believe you meet every single qualification. As long as you are motivated to learn and join the development of foundation models, we'd love to chat. Responsibilities
- Optimize model architectures and loss objectives to handle combinations of images, video, text, speech, and audio data.
- Implement and optimize kernels for efficient training on Hopper and Blackwell GPUs
- Performance optimization (floating point formats, sparsity, systems level optimization)
- Distributed optimization and training
- Experience in writing clean and efficient codeMaster or Doctoral degree in computer science or equivalent.
- Proficiency in at least one deep learning framework, such as PyTorch or JAX.
- Participated in at least 1 research project related to distributed training or inference.
- Experience in implementing your own kernels in CUDA or another compiler/toolkit (Triton, ThunderKittens, PTX, etc.)
- Experience in distributed optimization (e.g. using DeepSpeed, FSDP), ideally designing performance optimizations
- Experience in computer networking (e.g. Infiniband, using SHARP)
- Experience in handling data at billions-scale
