ML Compiler Engineer

4 weeks ago

Toronto, Canada Amazon Web Services (AWS) Full time

Overview Join to apply for the ML Compiler Engineer, AWS Neuron, Annapurna Labs role at Amazon Web Services (AWS). At AWS our vision is to make deep learning pervasive for everyday developers and to democratize access to innovative infrastructure. In order to deliver on that vision, we’ve created innovative software and hardware solutions that make it possible. AWS Neuron is the SDK that optimizes the performance of complex neural net models executed on AWS Inferentia and Trainium, our custom chips designed to accelerate deep-learning workloads. The Neuron SDK consists of a compiler, run-time, and debugger, integrated with Tensorflow, PyTorch, and MXNet. It’s preinstalled in AWS Deep Learning AMIs and Deep Learning Containers for customers to quickly get started with running high performance and cost-effective inference. Role The Neuron team is hiring senior compiler engineers to solve our customers toughest problems. This is an opportunity to work on innovative products at the intersection of machine-learning, high-performance computing, and distributed architectures. You will architect and implement business-critical features, publish innovative research, and mentor a brilliant team of experienced engineers. We operate in spaces that are very large, yet our teams remain small and agile. There is no blueprint. We're inventing. We're experimenting. It is a very unique learning culture. Responsibilities As a senior deep learning compiler engineer on the Neuron team, you will be a thought leader supporting the development of a compiler targeting AWS Inferentia and Trainum. You will be developing and scaling the compiler to handle the world\'s largest ML workloads. You will leverage your technical communications skill as a hands-on partner to AWS ML services teams and you will be involved in pre-silicon design, bringing new products/features to market, and many other exciting projects. Qualifications Basic Qualifications 3+ years of non-internship professional software development experience 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience Experience programming with at least one software programming language Preferred Qualifications 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience Bachelor\'s degree in computer science or equivalent Experience in compiler design for CPU/GPU/Vector engines/ML-accelerators Experience with System Level performance analysis and optimization Experience with LLVM and/or MLIR Experience with the following technologies: PyTorch, OpenXLA, StableHLO, JAX, TVM, deep learning models, and algorithms Amazon is an equal opportunity employer and does not discriminate on the basis of protected veteran status, disability, or other legally protected status. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit for more information. If the country/region you’re applying in isn’t listed, please contact your Recruiting Partner. Company - Amazon Canada Fulfillment Services, ULC Job ID: A #J-18808-Ljbffr

  • ML Compiler Engineer

    2 weeks ago

    Toronto, Ontario, Canada Amazon Web Services (AWS) Full time

    DescriptionThe Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium.The Product: The AWS Machine Learning accelerators (Inferentia/Trainium) offer unparalleled ML inference and training...

  • ML Compiler Engineer

    5 days ago

    Toronto, Ontario, CAN, Canada Amazon Full time

    The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon's custom machine learning accelerators, Inferentia and Trainium. The Product: The AWS Machine Learning accelerators (Inferentia/Trainium) offer unparalleled ML inference and training performances....

  • ML Compiler Engineer

    5 days ago

    Toronto, Ontario, Canada Amazon Web Services (AWS) Full time

    DescriptionAt AWS our vision is to make deep learning pervasive for everyday developers and to democratize access to innovative infrastructure. In order to deliver on that vision, we've created innovative software and hardware solutions that make it possible.AWS Neuron is the SDK that optimizes the performance of complex neural net models executed on AWS...

  • ML Compiler Engineer

    5 days ago

    Toronto, Ontario, CAN, Canada Amazon Full time

    At AWS our vision is to make deep learning pervasive for everyday developers and to democratize access to innovative infrastructure. In order to deliver on that vision, we've created innovative software and hardware solutions that make it possible.AWS Neuron is the SDK that optimizes the performance of complex neural net models executed on AWS Inferentia and...

  • Ml Compiler Intern

    16 hours ago

    Toronto, Canada d-Matrix Full time

    **About us** d-Matrix is developing a novel hardware system and a full-stack software solution to accelerate large-scale modern deep neural network compute workloads for the cloud. Leveraging a combination of unique in-memory compute array design, digital signal processing system design, and on-chip and chip-to-chip interconnect fabric, d-Matrix's AI...

  • ML Compiler Engineer

    1 day ago

    Toronto, Canada Amazon Web Services (AWS) Full time

    OverviewJoin to apply for the ML Compiler Engineer, AWS Neuron, Annapurna Labs role at Amazon Web Services (AWS).At AWS our vision is to make deep learning pervasive for everyday developers and to democratize access to innovative infrastructure. In order to deliver on that vision, we’ve created innovative software and hardware solutions that make it...

  • ML Compiler Engineer

    2 days ago

    Toronto, Canada Amazon Web Services (AWS) Full time

    OverviewJoin to apply for the ML Compiler Engineer, AWS Neuron, Annapurna Labs role at Amazon Web Services (AWS).At AWS our vision is to make deep learning pervasive for everyday developers and to democratize access to innovative infrastructure. In order to deliver on that vision, we’ve created innovative software and hardware solutions that make it...

  • ML Compiler Engineer, AWS Neuron, Annapurna Labs

    2 weeks ago

    Toronto, Canada Amazon Development Centre Canada ULC Full time

    The Annapurna Labs team at Amazon Web Services (AWS) builds AWS Neuron, the software development kit used to accelerate deep learning and GenAI workloads on Amazon’s custom machine learning accelerators, Inferentia and Trainium. The Product: The AWS Machine Learning accelerators (Inferentia/Trainium) offer unparalleled ML inference and training...

  • ML Compiler Architect, Senior Principal

    3 weeks ago

    Toronto, Canada d-Matrix Full time

    Join to apply for the ML Compiler Architect, Senior Principal role at d-Matrix5 days ago Be among the first 25 applicantsJoin to apply for the ML Compiler Architect, Senior Principal role at d-MatrixAt d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and...

  • ML Compiler Architect, Senior Principal

    4 weeks ago

    Toronto, Canada d-Matrix Full time

    Join to apply for the ML Compiler Architect, Senior Principal role at d-Matrix 5 days ago Be among the first 25 applicants Join to apply for the ML Compiler Architect, Senior Principal role at d-Matrix At d-Matrix , we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and...