Senior NN Kernel Engineer

2 weeks ago

Old Toronto, Canada Untether Full time

***Please note: While our engineering HQ is in Toronto, this is a remote opportunity and we welcome applicants from anywhere in North America.***

Untether AI is a rapidly growing Toronto startup building next generation hardware AI accelerators for neural net inference. We are investing in software in a big way in order to make it as seamless as possible for researchers and developers to successfully deploy neural networks on our hardware. It involves optimizing a variety of common neural networks to run on our architectures using our software optimization tool flow. We are looking for software developers who are highly motivated and innately curious. Successful candidate can expect to contribute to small agile teams in core areas and be provided with close mentoring and guidance from senior software engineers. Because we’re building new systems from the ground up, you’ll get to work on new and unsolved problems using state-of-the art technologies.

We are looking for an experienced Neural Network Kernel Software Development Engineer. The objective of the role is to build efficient implementations of real-world neural nets kernels specialized for our unique hardware architecture, as well as implementation of other computing algorithms, maximizing compute and communication throughput. The successful candidate will build a deep understanding of the hardware capabilities, limitations and details of our architecture and work closely with our architects and compiler engineers.

Responsibilities
  • Design, prototype and implement C++ low-level flexible programs (kernels) for various neural net operations
  • Design, document and communicate configuration APIs for these kernels to compiler team
  • Communicate performance optimization ideas both to compiler engineers and to architects working on future product generations
  • Design overall computation strategies across kernels for multikernel and multi-chip neural net implementations
Requirements
  • Computer Science, Engineering, Math, Physics or related degree, preferably MS or PhD
  • Deep knowledge of modern C++ with emphasis on code generation and low level compute optimizations
  • Knowledge of Neural Network basic operator algorithms - Convolutions, Transformers, RNNs
  • Demonstrated ability to work independently through challenging but tightly constrained problems
  • Interest and ability to work with both high level conceptual and very low-level technical details
  • Interest in problem-solving within highly structured and tightly constrained environments
Preferred Skills and Experience
  • Python experience
  • Experience with other AI accelerator programming
  • Strong mathematical skills
  • Enjoy solving very complex problems (like doing IQ tests, solving tricky math problems)
What are some of the perks that you will receive being part of Untether AI? Aligned to Untether’s philosophy, our employees enjoy the same perks, regardless of role or level. In part, these include:
  • Strong health and extended health benefits
  • Unlimited sick days
  • Stock options
  • Building chips and software that will change the world
Thinking about applying?
  • We’re a pretty welcoming bunch of people. If we’ve piqued your interest, you’re passionate about the same things we are but you aren’t sure if you check all the boxes, please apply anyway. We’re a great place to work, an even better place to learn and we focus on both capability and potential
  • Besides being a pretty friendly group, we’re also pretty diverse - ethnically, experientially and in our physical and mental abilities. If you are someone who needs accommodation during the interview process and/or in the workplace, please send a note along with your resume tocareers@untether.aiand we’ll be in touch.

A little bit more about Untether AI

Untether AI has developed a groundbreaking new architecture that brings neural net inference to new levels of performance and efficiency. We’ve already sold our product to smart clients who want to get in at ground zero. We’ve done this while continuing to improve our technology creating ultra-efficient, high performance AI chips that eliminates the data movement bottleneck that costs energy and performance in traditional architectures. We’re a team made up of scientists, engineers and entrepreneurs and have the support of tier one investors. We recently received $125 million in our series B funding round which enables us to expand our customer engagements, enhance our software offering, and build the next generation of industry leading AI inference products. Join us to be part of something big - a chance to create the future of AI.

#J-18808-Ljbffr

  • Senior NN Kernel Engineer

    Found in: Jooble CA O C2 - 2 weeks ago

    Toronto, ON, Canada Untether Full time

    ***Please note: While our engineering HQ is in Toronto, this is a remote opportunity and we welcome applicants from anywhere in North America.*** Untether AI is a rapidly growing Toronto startup building next generation hardware AI accelerators for neural net inference. We are investing in software in a big way in order to make it as seamless as possible for...

  • Machine Learning Kernels Engineer

    2 weeks ago

    Toronto, Canada Acceler8 Talent Full time

    We are seeking a Machine Learning Kernels Engineer to join a well-established and funded startup who are developing a ground-breaking at-memory AI chip architecture. This approach addresses the accuracy and efficiency challenges in running AI inference workloads. You'll join a team who's mission is to build implementations of real-world neural network...

  • Machine Learning Kernels Engineer

    2 weeks ago

    Toronto, Canada Acceler8 Talent Full time

    We are seeking a Machine Learning Kernels Engineer to join a well-established and funded startup who are developing a ground-breaking at-memory AI chip architecture. This approach addresses the accuracy and efficiency challenges in running AI inference workloads. You'll join a team who's mission is to build implementations of real-world neural network...

  • Machine Learning Kernels Engineer

    2 weeks ago

    Toronto, Canada Acceler8 Talent Full time

    We are seeking aMachine Learning KernelsEngineer to join a well-established and funded startup who are developing a ground-breaking at-memory AI chip architecture. This approach addresses the accuracy and efficiency challenges in running AI inference workloads.You'll join a team who's mission is to build implementations of real-world neural network kernels...

  • Machine Learning Kernels Engineer

    Found in: Adzuna CA C2 - 4 days ago

    Toronto, ON, C6A, Ontario, Canada Acceler8 Talent Full time

    We are seeking a Machine Learning Kernels Engineer to join a well-established and funded startup who are developing a ground-breaking at-memory AI chip architecture. This approach addresses the accuracy and efficiency challenges in running AI inference workloads.You'll join a team who's mission is to build implementations of real-world neural network...

  • Senior Compiler Engineer

    2 weeks ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler Engineer Our client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology. Their SPU (Spatial...

  • Senior Compiler Engineer

    2 weeks ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler Engineer Our client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology. Their SPU (Spatial...

  • Senior Compiler Engineer

    2 weeks ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler Engineer Our client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology. Their SPU (Spatial...

  • Senior Compiler Engineer

    2 weeks ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler EngineerOur client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology.Their SPU (Spatial...

  • Senior Compiler Engineer

    2 weeks ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler EngineerOur client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology.Their SPU (Spatial...

  • Senior Compiler Engineer

    Found in: Talent CA 2A C2 - 3 days ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler EngineerOur client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology.Their SPU (Spatial...

  • Senior Compiler Engineer

    Found in: Appcast CA C2 Glassdoor - 2 weeks ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler EngineerOur client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology.Their SPU (Spatial...

  • Senior Compiler Engineer

    Found in: Whatjobs CA C2 - 2 weeks ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler Engineer Our client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology. Their SPU (Spatial...

  • Senior Compiler Engineer

    Found in: Appcast CA A2 P - 2 weeks ago

    Toronto, Canada Oho Group Ltd Full time

    Senior Compiler EngineerOur client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology.Their SPU (Spatial...

  • Senior Engineer

    Found in: Jooble CA O C2 - 2 weeks ago

    Toronto, ON, Canada Oho Group Ltd Full time

    Senior Compiler Engineer Our client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology. Their SPU (Spatial...

  • Senior Compiler Engineer

    Found in: Jooble CA O C2 - 2 weeks ago

    Toronto, ON, Canada Oho Group Ltd Full time

    Senior Compiler Engineer Our client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology. Their SPU (Spatial...

  • Senior Compiler Engineer

    Found in: Adzuna CA C2 - 4 days ago

    Toronto, ON, M5P 2N7, City of Toronto, Canada Oho Group Ltd Full time

    Senior Compiler EngineerOur client aims to revolutionize hardware and systems through a software-first approach, empowering AI innovators to surpass previous limits. The goal is to alleviate computational burdens, streamline model training and deployment, and ultimately maximize societal benefits from this transformative technology.Their SPU (Spatial...

  • Senior Software Engineer

    5 days ago

    Old Toronto, Canada CentML Full time

    About UsWe believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at...

  • Senior Software Engineer

    5 days ago

    Old Toronto, Canada CentML Full time

    About UsWe believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at...

  • Senior Software Engineer

    5 days ago

    Old Toronto, Canada CentML Full time

    About UsWe believe AI will fundamentally transform how people live and work. CentML's mission is to massively reduce the cost of developing and deploying ML models so we can enable anyone to harness the power of AI and everyone to benefit from its potential.Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at...