Machine Learning Runtime Optimization Engineer

4 days ago


Waterloo, Ontario, Canada Interop Labs Full time
About the Role

We are seeking an Inference Engine Optimization Specialist to work on an innovative project at Interop Labs. This role involves focusing on backend optimizations for machine learning runtimes, including hardware acceleration and inference speed improvements.

Key Responsibilities
  • Experience with ML inference engines (ONNX Runtime, TensorRT, CoreML, etc.) and optimizing models for deployment is essential.
  • Proficiency in Mac/Linux-based runtimes and experience with heterogeneous compute environments (CPU/GPU/NPUs) is required.
  • A deep understanding of numerical optimization, compiler techniques, and low-level performance tuning is necessary.
Why Interop Labs?
  • We offer a collaborative environment with diverse teams worldwide.
  • The opportunity to contribute to high-impact work and make a difference in a decentralized protocol is unique.
  • You will have the chance to challenge yourself while learning heaps of new stuff in the process.
  • Our unlimited time off policy allows you to rest and recharge throughout the year.
  • Competitive compensation with stock options ensures your growth from the initial phase.


  • Waterloo, Ontario, Canada Interop Labs Full time

    About Your JobIn this role, you will be responsible for optimizing machine learning runtimes for improved performance and efficiency. This includes working with ML inference engines like ONNX Runtime, TensorRT, and CoreML to optimize model deployment.Key RequirementsExperience with ML inference engines and optimizing models for deployment is...


  • Waterloo, Ontario, Canada Interop Labs Full time

    About Our ProjectAt Interop Labs, we're working on an innovative project that redefines software. As a Machine Learning Runtime Optimization Engineer, you'll focus on backend optimizations for ML runtimes, including hardware acceleration and inference speed improvements.Your Key TasksYou will optimize models for deployment using ML inference engines like...


  • Waterloo, Ontario, Canada Interop Labs Full time

    About Your Future RoleWe're looking for a talented individual to join our team as a Machine Learning Runtime Optimization Engineer. You will work on an innovative project that redefines software and focuses on backend optimizations for ML runtimes.Key ResponsibilitiesOptimize models for deployment using ML inference engines like ONNX Runtime, TensorRT, and...


  • Waterloo, Ontario, Canada Borealis AI Full time

    RBC Borealis is at the forefront of artificial intelligence research and development, driving the innovative edge for the Royal Bank of Canada (RBC). Our team is dedicated to advancing the science of AI, delivering cutting-edge solutions that create substantial value for RBC and its customers. As part of RBC, you will have the opportunity to contribute to...


  • Waterloo, Ontario, Canada Google Full time

    **The Role:**As a Software Development Manager at Google, you will have the opportunity to lead complex projects and manage a team of software developers. You will optimize your own code and ensure that your team is able to optimize theirs. Your goal will be to set project goals, contribute to product strategy, and help develop your team.The Google Cloud AI...


  • Waterloo, Ontario, Canada AltaML Full time

    About Us:AltaML is a leading provider of applied AI solutions in North America, focused on building and operationalizing AI software. Our unique business model combines three key components: services, reusable IP, and product solutions.We are a company that values collaboration, innovation, and continuous improvement. Our ideal candidate is a creative...


  • Waterloo, Ontario, Canada AltaML Full time

    Associate Machine Learning Developer (Cohort 10)1 day ago Be among the first 25 applicantsAbout The GovLab.aiWe transform the way you think about applied AI. Teams are structured around projects for the public sector, guided by the Project Delivery Manager, Product Owner, and Senior machine learning developers, to provide working models to support informed...


  • Waterloo, Ontario, Canada AltaML Full time

    Associate Machine Learning DeveloperThis is a 4 month paid contract starting May 2025 and ending in August 2025. It may also be extended to an 8 or 12-month term.The role involves working on public sector ML projects, delivering real solutions to partners including Service Alberta and other departments. The goal is to set a global example of how to transform...


  • Waterloo, Ontario, Canada AltaML Inc. Full time

    About The GovLab.aiWe transform the way you think about applied AI. Our project-based teams are structured around public sector projects, guided by experienced professionals, to provide working models that support informed strategic decision-making.Job RoleAs an Associate Machine Learning Developer, you will have the opportunity to work on public sector ML...


  • Waterloo, Ontario, Canada AltaML Inc. Full time

    About The GovLab.aiWe're a leader in applied AI for the public sector, dedicated to driving positive change through innovative solutions. Our team is passionate about empowering individuals and organizations to harness the power of AI.Job OpportunityAs an Associate Machine Learning Developer, you'll join our dynamic team and contribute to the development of...


  • Waterloo, Ontario, Canada Huawei Full time

    Our team has an immediate 12-months contract opening for an Engineer.Responsibilities:- Participate in all the phases of the development of the project covering research, design, coding and testing.- Design state of the art AI architectures leveraging your knowledge on Recursive Neural Network and foundational models.- Enhance our capability to train our AI...

  • Software Engineer

    4 weeks ago


    Waterloo, Ontario, Canada Canonical Full time

    Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT.About CanonicalWe publish Ubuntu, one of the most important open source projects and...


  • Waterloo, Ontario, Canada Faire Full time

    Faire is an online wholesale marketplace built on the belief that the future is local — independent retailers around the globe are doing more revenue than Walmart and Amazon combined, but individually, they are small compared to these massive entities. At Faire, we're using the power of tech, data, and machine learning to connect this thriving community of...


  • Waterloo, Ontario, Canada Google Full time

    Software Developer III, AI/Machine Learningcorporate_fare Google place Waterloo, ON, CanadaApply- Bachelor's degree or equivalent practical experience.- 2 years of experience with software development in one or more programming languages, and with data structures or algorithms.- 2 years of experience with machine learning algorithms and tools (e.g.,...


  • Waterloo, Ontario, Canada IG Full time

    About the Role Our client is seeking a Software/Data Engineer to play a critical role in the development of cutting-edge agricultural robotics. This is a hybrid role primarily based on-site in Waterloo, with some remote flexibility. From April to September, the role will involve on-site testing at farms across Southern Ontario. Technical Requirements ...


  • Waterloo, Ontario, Canada IG Full time

    About the Role Our client is seeking a Software/Data Engineer to play a critical role in the development of cutting-edge agricultural robotics. This is a hybrid role primarily based on-site in Waterloo, with some remote flexibility. From April to September, the role will involve on-site testing at farms across Southern Ontario. Technical Requirements ...


  • Waterloo, Ontario, Canada Google Full time

    Senior Software Developer AI/Machine Learning, Applied AIcorporate_fare Google place Waterloo, ON, Canada ; Cambridge, MA, USAApplyMinimum Qualifications:- Bachelor's degree or equivalent practical experience.- 5 years of experience with software development in one or more programming languages, and with data structures/algorithms.- 3 years of experience...


  • Waterloo, Ontario, Canada Manifold Technologies Full time

    Manifold Technologies is a pioneering mid-frequency proprietary trading firm founded by a former student and professor at Harvey Mudd College. We are redefining the approach to quantitative trading by blending human-like pattern recognition with the speed of machine intelligence. As a startup getting ready to launch our groundbreaking trading product in...

  • Senior AI/ML Engineer

    4 weeks ago


    Waterloo, Ontario, Canada Aitopics Full time

    ManulifeManulife is a leading financial services group. We provide financial advice, insurance, as well as wealth and asset management solutions for individuals, groups and institutions.Join our Canadian Advanced Analytics (AA) team as a Senior Machine Learning Engineer and lead the charge in modernizing operations and reimagining automation through AI We...

  • Senior AI/ML Engineer

    4 weeks ago


    Waterloo, Ontario, Canada Aitopics Full time

    Job Title: Senior Machine Learning EngineerWe are a leading financial services group committed to bringing innovative technologies to drive business growth and innovation. Our Canadian Advanced Analytics (AA) team is seeking a Senior Machine Learning Engineer to lead the development of AI solutions in Operations, transforming how we operate and interact with...