Member of Technical Staff, Training and Inference

1 week ago


Toronto, Ontario, Canada Boson AI Full time $150,000 - $600,000 per year
Boson AI is an early-stage startup building large audio models for everyone to enjoy and use. Our founders (Alex Smola,Mu Li), and a team of Deep Learning, Optimization, NLP, and Statistics scientists and engineers are working on high quality generative AI models for language and beyond.
We are seeking research scientists and engineers to join our team full-time in our Santa Clara office. As part of your role, you will work on implementing and improving distributed optimization algorithms, performance tune architectures, improve inference and help us make Deep Networks perform efficiently on our cluster. The ideal candidate will possess a strong background in CUDA, Triton, PyTorch, distributed optimization and deep learning architectures.
We encourage you to apply even if you do not believe you meet every single qualification. As long as you are motivated to learn and join the development of foundation models, we'd love to chat. Responsibilities
  • Optimize model architectures and loss objectives to handle combinations of images, video, text, speech, and audio data.
  • Implement and optimize kernels for efficient training on Hopper and Blackwell GPUs
  • Performance optimization (floating point formats, sparsity, systems level optimization)
  • Distributed optimization and training
You may be a good fit if you have:
  • Experience in writing clean and efficient codeMaster or Doctoral degree in computer science or equivalent.
  • Proficiency in at least one deep learning framework, such as PyTorch or JAX.
  • Participated in at least 1 research project related to distributed training or inference.
Strong candidates may also have:
  • Experience in implementing your own kernels in CUDA or another compiler/toolkit (Triton, ThunderKittens, PTX, etc.)
  • Experience in distributed optimization (e.g. using DeepSpeed, FSDP), ideally designing performance optimizations
  • Experience in computer networking (e.g. Infiniband, using SHARP)
  • Experience in handling data at billions-scale
$150,000 - $600,000 a year Total compensations includes base pay, equity, and benefits. We may use artificial intelligence (AI) tools to support parts of the hiring process, such as reviewing applications, analyzing resumes, or assessing responses. These tools assist our recruitment team but do not replace human judgment. Final hiring decisions are ultimately made by humans. If you would like more information about how your data is processed, please contact us.

  • Toronto, Ontario, Canada Boson AI Full time $120,000 - $180,000 per year

    Boson AI is an early-stage startup building large audio models for everyone to enjoy and use. Our founders (Alex Smola,Mu Li), and a team of Deep Learning, Optimization, NLP, and Statistics scientists and engineers are working on high quality generative AI models for language and beyond.We are seeking research scientists and engineers to join our team...


  • Toronto, Ontario, Canada Cohere Full time $60,000 - $80,000 per year

    Who are we? Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI. We obsess over what we...


  • Toronto, Ontario, Canada Cohere Full time $120,000 - $180,000 per year

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...


  • Toronto, Ontario, Canada EnamCo Full time $120,000 - $180,000 per year

    Who are we?Join us at the forefront of innovation in the AI sector. Our mission is to accelerate the future of work. We're not merely envisioning the future; we're actively constructing it. Our work is inspired by Ford's assembly line and Ohno's production system.We are a well-funded Silicon Valley based Series A startup backed by top-tier VCs.Our founding...


  • Toronto, Ontario, Canada b3f36179-ea87-4288-8f0b-815554f7141f Full time US$120,000 - US$180,000 per year

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...


  • Toronto, Ontario, Canada Cohere Full time $100,000 - $150,000 per year

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...


  • Toronto, Ontario, Canada Cohere Full time $120,000 - $200,000 per year

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...


  • Toronto, Ontario, Canada DeepRec Full time $120,000 - $180,000 per year

    Member of Technical Staff – Frontend , )Location: Toronto, Canada (Hybrid)Type: Full-time, PermanentOverviewOur client (Series A, GenAI Content Platform) is hiring a core frontend engineer in Toronto to architect and scale their browser-based animation and video generation interface. You'll own the / web app powering AI-driven content creation for a...


  • Toronto, Ontario, Canada b3f36179-ea87-4288-8f0b-815554f7141f Full time $80,000 - $120,000 per year

    Who are we?Our mission is to scale intelligence to serve humanity. We're training and deploying frontier models for developers and enterprises who are building AI systems to power magical experiences like content generation, semantic search, RAG, and agents. We believe that our work is instrumental to the widespread adoption of AI.We obsess over what we...


  • Toronto, Ontario, Canada Wind River Full time $120,000 - $180,000 per year

    DescriptionPosition at Wind RiverMember of Technical Staff - Cloud Engineer (Analytics)About Wind RiverAt Wind River, we use analytics tools such as Elasticsearch and Kibana to accelerate the development of solutions that allow our customers to visualize their networks and act on issues. We have adopted these technologies into Wind River Cloud Analytics. The...