Applied Researcher, Reinforcement Learning

6 months ago

Vancouver, Canada Sanctuary AI Full time

**Your New Role and Team**

Sanctuary is seeking an exceptional Applied Researcher, Reinforcement Learning (RL) to join our team in engineering and innovating unique robotic manipulation tasks.

As an Applied Researcher, you'll be responsible for selecting the most promising state of the art (SOTA) approaches, designing training and data-collection pipelines, supervising the process of testing these algorithms in simulation, and deploying them to our robots in real-world settings. With access to in-house robots, you'll also have a unique opportunity for impactful work with new haptic and proprioceptive sensing modalities.

**Success Criteria**:

- Design, implement, and improve SOTA RL algorithms and test them in real-world settings
- Keep up to date with SOTA RL methodologies and robotics
- Identify, communicate, and drive promising research directions to the team
- Find ways of improving existing implementations of RL learning pipelines with regards to standard metrics such as sample efficiency, speed, computational resource usage, and scalability
- Design RL training and data-collection pipelines to facilitate fast deployment on physical robots
- Work with a multidisciplinary team to develop novel algorithms and investigate sources of errors with existing implementations

**Your Experience**

**Qualifications**
- PhD in Machine Learning, Computer Science, Applied Math, or equivalent work experience in ML
- 4+ years' experience implementing a variety of ML methods with a focus in a specialization such as computer vision or robotics
- 2+ years' experience implementing and deploying (dexterous) robotic manipulation tasks in simulation and on physical robots
- Experience in simulation-to-reality transfer learning
- Experience taking ML R&D and trained models into production
- Hands-on experience integrating ML models onto a robotics platform
- Experience with computer vision systems
- Publications in leading AI conferences such as Neurips, ICLR, ICML and CORL

**Skills**
- Extensive knowledge of Reinforcement Learning principles and use
- Development with Python 3.6 or later
- Working knowledge of PyTorch and/or TensorFlow
- Familiarity with ROS2
- Experience with Atlassian tools; Jira, Confluence, or equivalent i.e. GitLab

**Traits**
- Above all else, a consistently positive attitude and a willingness to do whatever it takes to create robust solutions to complex problems
- Strong leadership skills in organizing R&D work for ML projects
- Eager to take on new challenges with tenacity and positivity
- Patience, persistence, and attention to detail when resolving performance issues
- Enthusiasm for bringing human-like intelligence to machines
- Ability to drive development of new functionalities from concept to production
- Ability to multitask and prioritize in a fast paced environment**Working at Sanctuary**

Sanctuary is an equal opportunity employer; employment with Sanctuary is governed based on skills, competence, and qualifications and will not be influenced in any way by race, color, religion, gender, national origin/ethnicity, veteran status, disability status, age, sexual orientation, gender identity, marital status, mental or physical disability, or any other legally protected status.

**Benefits**

Full time (non co-op) employees enjoy medical/dental/vision coverage, life insurance, wellness programs, stock options, paid time off (3 weeks vacation accrued annually, 12 paid holidays, 5 days of annual sick leave, and parental leave), scheduling and worksite flexibility by role, and more.

**About Sanctuary**

Founded in 2018 by Geordie Rose, Suzanne Gildert, Olivia Norton, and Ajay Agrawal, Sanctuary is a Vancouver, Canada-based company. Sanctuary is on a mission to create the world’s first human-like intelligence in general-purpose robots that will help us work more safely, efficiently, and sustainably. And in the not-too-distant future, help us explore, settle, and prosper in outer space.

Members of the Sanctuary team founded D-Wave (a pioneer in the quantum computing industry), Kindred (first use of reinforcement learning in a production robot), and the Creative Destruction Lab (pioneered a revolutionary method for the commercialization of science for the betterment of humankind). The team has experience launching market-defining innovations rooted in previously unsolved and deep scientific problems.

**Recruiting & Employment Agency Notice**:

- Recruitment and hiring is conducted internally by Sanctuary. We are not seeking or soliciting any new agency partnerships or agreements at this time_.

  • Intern Researcher

    1 month ago

    Vancouver, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate 12-month internship opening for an Intern Researcher.Responsibilities:Conduct cutting-edge research in large language models (LLMs), focusing on agent-building technologies. Leverage reinforcement learning techniques to enhance agent performance in specialized business applications. Design, develop and maintain research...

  • Applied Researcher

    4 months ago

    Vancouver, Canada Sanctuary AI Full time

    **Your New Role and Team** Sanctuary, a world leader in building AI-based control systems for humanoid robots, is seeking an exceptional Applied Researcher to join our team in engineering and innovating unique robotic manipulation tasks. As an Applied Researcher, you'll be responsible for selecting the most promising state of the art (SOTA) approaches,...

  • Applied Scientist

    7 months ago

    Vancouver, Canada Wayve Full time

    Who are we?  Our team is the first in the world to use autonomous vehicles on public roads using end-to-end deep learning, computer vision and reinforcement learning. Leveraging our multi-national world-class team of researchers and engineers, we’re using data to learn more intelligent algorithms to bring autonomy for everyone, everywhere. We aim to...

  • Staff Applied Scientist

    7 months ago

    Vancouver, Canada Wayve Full time

    Who are we?  Our team is the first in the world to use autonomous vehicles on public roads using end-to-end deep learning, computer vision and reinforcement learning. Leveraging our multi-national world-class team of researchers and engineers, we’re using data to learn more intelligent algorithms to bring autonomy for everyone, everywhere. We aim to...

  • Applied Scientist

    4 weeks ago

    Vancouver, Canada Wayve Full time

    At Wayve we're committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and perspectives, and regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, veteran status,...

  • Applied Scientist

    4 days ago

    Vancouver, Canada Wayve Full time

    At Wayve we're committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and perspectives, and regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, veteran status,...

  • Staff Applied Scientist

    4 weeks ago

    Vancouver, Canada Wayve Full time

    At Wayve we're committed to creating a diverse, fair and respectful culture that is inclusive of everyone based on their unique skills and perspectives, and regardless of sex, race, religion or belief, ethnic or national origin, disability, age, citizenship, marital, domestic or civil partnership status, sexual orientation, gender identity, veteran status,...

  • AI Robotics Research Scientist

    1 week ago

    Vancouver, British Columbia, Canada T-Net British Columbia Full time

    Estimated salary: $120,000 - $180,000 per annum.About the RoleWe are seeking an AI Robotics Research Scientist to join our team at T-Net British Columbia. This is a unique opportunity to contribute to cutting-edge research and development in artificial intelligence and robotics.Key ResponsibilitiesDesign, develop, and implement advanced reinforcement...

  • AI Researcher

    3 weeks ago

    Vancouver, British Columbia, Canada Wayve Full time

    About UsWayve is a pioneering developer of Embodied AI technology, revolutionizing the field with advanced AI software and foundation models. Our mission is to create autonomy that propels the world forward, enabling vehicles to perceive, understand, and navigate complex environments.The RoleWe are seeking an experienced researcher to join our Vancouver team...

  • Data Researcher

    4 weeks ago

    Vancouver, Canada T-Net British Columbia Full time

    h3>Applied Researcher, Dexterous ManipulationSanctuary AIYour New Role and TeamSanctuary AI - a multi award-winning LinkedIn Top Startup company - is seeking an exceptional Applied Researcher, Dexterous Manipulation to join our team in engineering and innovating unique robotic manipulation tasks.As an Applied Researcher, you'll be responsible for selecting...

  • Researcher – Artificial Specialized Intelligence, Microsoft Research

    6 months ago

    Vancouver, Canada Microsoft Full time

    Overview Microsoft Research (MSR), a leading industrial research laboratory comprised of over 1,000 computer scientists working across the United States, United Kingdom, China, India, Canada, and the Netherlands.  We are currently seeking a Researcher in the area of Artificial Specialized Intelligence located in Vancouver, British Columbia,...

  • Senior Researcher – Artificial Specialized Intelligence, Microsoft Research

    6 months ago

    Vancouver, Canada Microsoft Full time

    Overview Microsoft Research (MSR), a leading industrial research laboratory comprised of over 1,000 computer scientists working across the United States, United Kingdom, China, India, Canada, and the Netherlands.  We are currently seeking a Senior Researcher in the area of Artificial Specialized Intelligence located in Vancouver, British...

  • Research Associate in Applied Fire Ecology

    2 months ago

    Vancouver, Canada UBC Faculty of Forestry Full time

    At UBC, we believe that attracting and sustaining a diverse workforce is key to the successful pursuit of excellence in research, innovation, and learning for all faculty, staff, and students. Our commitment to employment equity helps achieve inclusion and fairness, brings rich diversity to UBC as a workplace, and creates the necessary conditions for a...

  • Advanced Robotics Researcher

    3 weeks ago

    Vancouver, British Columbia, Canada T-Net British Columbia Full time

    Transformative Robotics Research OpportunityWe are seeking an exceptional Advanced Robotics Researcher to spearhead the development of cutting-edge multimodal AI systems at Sanctuary AI, a pioneering robotics company based in T-Net British Columbia.Your Mission: Create Next-Generation Robotics SolutionsAs our Advanced Robotics Researcher, you will be...

  • Researcher - Artificial Specialized Intelligence

    6 months ago

    Vancouver, Canada Microsoft Full time

    Microsoft Research (MSR), a leading industrial research laboratory comprised of over 1,000 computer scientists working across the United States, United Kingdom, China, India, Canada, and the Netherlands. Over the past 30 years, our scientists have not only conducted world-class computer science research but also integrated advanced technologies into our...

  • Researcher - Artificial Specialized Intelligence

    6 months ago

    Vancouver, Canada Microsoft Canada Full time

    Overview Microsoft Research (MSR), a leading industrial research laboratory comprised of over 1,000 computer scientists working across the United States, United Kingdom, China, India, Canada, and the Netherlands. Over the past 30 years, our scientists have not only conducted world-class computer science research but also integrated advanced technologies...

  • Robotics Research Scientist

    3 weeks ago

    Vancouver, British Columbia, Canada Sanctuary AI Full time

    Expert Robot Manipulation EngineerSanctuary AI, a leading innovator in AI-based control systems for humanoid robots, seeks an experienced Robotics Research Scientist to drive the development of cutting-edge robotic manipulation tasks.In this role, you will be responsible for researching and implementing novel algorithms and techniques for robot manipulation,...

  • Advanced Robotics Research Scientist

    1 week ago

    Vancouver, British Columbia, Canada T-Net British Columbia Full time

    Sanctuary AI is a pioneering company in the field of robotics and artificial intelligence, dedicated to creating human-like intelligence in general-purpose robots.We are seeking an experienced Advanced Robotics Research Scientist to join our team in T-Net British Columbia. This role will involve leading cutting-edge research initiatives, developing and...

  • Senior Robotics Research Engineer

    1 week ago

    Vancouver, British Columbia, Canada T-Net British Columbia Full time

    Estimate Salary: $120,000 - $180,000 per yearAbout Sanctuary AISanctuary builds humanoid robots and a novel control system that integrates symbolic logic and reasoning with data-driven robot foundation models.We use our robots to collect vision, audio, touch, and proprioception data from the perspective of the robot while they perform real-world work tasks....

  • Machine Learning Research Scientist

    3 days ago

    Vancouver, Canada Huawei Technologies Canada Co., Ltd. Full time

    Our team has an immediate permanent opening for a Machine Learning Applied ScientistResponsibilities:Conducting research and analysis to solve complex problemsDeveloping and implementing machine learning models and algorithmsCollaborating with cross-functional teams to develop and deploy solutionsProviding technical guidance and support to...