Member of Technical Staff, Training and Inference

26 minutes ago

Toronto, Ontario, Canada Boson AI Full time

Boson AI is an early-stage startup building large audio models for everyone to enjoy and use. Our founders (Alex Smola,Mu Li), and a team of Deep Learning, Optimization, NLP, and Statistics scientists and engineers are working on high quality generative AI models for language and beyond.

We are seeking research scientists and engineers to join our team full-time in our Santa Clara office. As part of your role, you will work on implementing and improving distributed optimization algorithms, performance tune architectures, improve inference and help us make Deep Networks perform efficiently on our cluster. The ideal candidate will possess a strong background in CUDA, Triton, PyTorch, distributed optimization and deep learning architectures.

We encourage you to apply even if you do not believe you meet every single qualification. As long as you are motivated to learn and join the development of foundation models, we'd love to chat.

Responsibilities

  • Optimize model architectures and loss objectives to handle combinations of images, video, text, speech, and audio data
  • Implement and optimize kernels for efficient training on Hopper and Blackwell GPUs
  • Performance optimization (floating point formats, sparsity, systems level optimization)
  • Distributed optimization and training

You may be a good fit if you have:

  • Experience in writing clean and efficient codeMaster or Doctoral degree in computer science or equivalent.
  • Proficiency in at least one deep learning framework, such as PyTorch or JAX
  • Participated in at least 1 research project related to distributed training or inference

Strong candidates may also have:

  • Experience in implementing your own kernels in CUDA or another compiler/toolkit (Triton, ThunderKittens, PTX, etc.)
  • Experience in distributed optimization (e.g. using DeepSpeed, FSDP), ideally designing performance optimizations
  • Experience in computer networking (e.g. Infiniband, using SHARP)
  • Experience in handling data at billions-scale

We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

  • Member of Technical Staff, Training and Inference

    32 minutes ago

    Toronto, Ontario, Canada Boson AI Full time

    Boson AI is an early-stage startup building large audio models for everyone to enjoy and use. Our founders (Alex Smola,Mu Li), and a team of Deep Learning, Optimization, NLP, and Statistics scientists and engineers are working on high quality generative AI models for language and beyond. We are seeking research scientists and engineers to join our team...

  • Member of Technical Staff

    39 minutes ago

    Toronto, Ontario, Canada Bagel Labs Full time

    We are Bagel Labs, a distributed machine learning research lab working towards open-source superintelligence.We ignore years of experience and pedigree. If you have high agency, meaning your default assumption is that you can control the outcome of whatever situation you are in, we want to hear from you. Every requirement below is flexible for a candidate...

  • Member of Technical Staff, MLE

    10 minutes ago

    Toronto, Ontario, Canada Cohere Full time

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...

  • Member of Technical Staff

    34 minutes ago

    Toronto, Ontario, Canada Bagel Labs Full time

    Company DescriptionWe are Bagel Labs, a distributed machine learning research lab working toward open-source superintelligence. Our flagship product is a state-of-the-art image and video generation model and platform that lets users create visual content from text prompts and reference images.We ignore years of experience and pedigree. If you have high...

  • Member of Technical Staff, Synthetic Data

    24 minutes ago

    Toronto, Ontario, Canada Cohere Full time

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...

  • Senior Technical Program Manager

    9 minutes ago

    Toronto, Ontario, Canada Cerebras Systems Full time

    Cerebras Systems builds the world's largest AI chip, 56 times larger than GPUs. Our novel wafer-scale architecture provides the AI compute power of dozens of GPUs on a single chip, with the programming simplicity of a single device. This approach allows Cerebras to deliver industry-leading training and inference speeds and empowers machine learning users to...

  • Member of Technical Staff, Pre-Training Data

    21 minutes ago

    Toronto, Ontario, Canada Cohere Full time

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...

  • Member of Technical Staff

    17 minutes ago

    Toronto, Ontario, Canada Cockroach Labs Full time

      Category-defining tech. Career-defining work.Lots of tech companies disrupt. But, many fail when they try to scale. We're different. CockroachDB makes it easier for companies to build and scale apps. This is how and why we're helping some of the most innovative companies on the planet. We tackle problems head-on and focus on solutions that create lasting...

  • Member of Technical Staff

    18 minutes ago

    Toronto, Ontario, Canada Cockroach Labs Full time

    Category-defining tech. Career-defining work.Lots of tech companies disrupt. But, many fail when they try to scale. We're different. CockroachDB makes it easier for companies to build and scale apps. This is how and why we're helping some of the most innovative companies on the planet. We tackle problems head-on and focus on solutions that create lasting...

  • Member of Technical Staff, Pretraining evaluations

    4 minutes ago

    Toronto, Ontario, Canada Cohere Full time

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...