Current jobs related to ML Compiler Engineer, Staff - Old Toronto, Ontario - d-Matrix


  • Old Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a highly skilled Senior ML Compiler Engineer to join our team at Amazon Web Services (AWS). As a key member of our team, you will be responsible for designing, implementing, and maintaining complex software solutions that transform service performance, durability, cost, and security.Key ResponsibilitiesDesign and implement...


  • Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a highly skilled and experienced Manager III to lead our team of compiler engineers in developing, deploying, and scaling compilers for AWS Inferentia and Trainium. As a trusted AWS Neuron Manager, you will be responsible for innovating on behalf of our customers, leveraging your vision and technical communication skills to...


  • Old Toronto, Ontario, Canada Amazon Full time

    About the RoleThe AWS Neuron team is seeking a highly skilled and experienced Manager III to lead a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium. As a trusted AWS Neuron Manager, you will be responsible for innovating on behalf of our customers, leveraging your vision and technical...


  • Old Toronto, Ontario, Canada Amazon Full time

    About the RoleThe AWS Neuron team is responsible for building innovative software solutions for AWS customers. As a Manager III on this team, you will lead a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium. You will need to be technically capable, credible, and curious in your own right as a...


  • Old Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Compiler Engineer to join our AWS Neuron team. As a key member of our team, you will be responsible for designing and developing a compiler targeting AWS Inferentia and Trainium, our custom chips designed to accelerate deep-learning workloads.As a Senior Compiler Engineer, you will work closely with our...


  • Old Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Compiler Engineer to join our AWS Neuron team. As a key member of our team, you will be responsible for designing and developing a compiler targeting AWS Inferentia and Trainium, our custom chips designed to accelerate deep-learning workloads.As a Senior Compiler Engineer, you will work closely with our...


  • Old Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Compiler Engineer to join our AWS Neuron team. As a key member of our team, you will be responsible for designing, implementing, and maintaining cutting-edge compiler technology that optimizes the performance of complex neural net models executed on AWS Inferentia and Trainium.Key ResponsibilitiesDesign...


  • Old Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a highly skilled Senior Compiler Engineer to join our AWS Neuron team. As a key member of our team, you will be responsible for designing, implementing, and maintaining cutting-edge compiler technology that optimizes the performance of complex neural net models executed on AWS Inferentia and Trainium.Key ResponsibilitiesDesign...


  • Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a highly skilled and experienced Manager III to lead our team of compiler engineers in developing, deploying, and scaling compilers for AWS Inferentia and Trainium. As a key member of the AWS Neuron team, you will collaborate with AWS ML services teams to innovate and ensure the Neuron SDK meets customer needs for high...


  • Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a highly skilled and experienced Manager III to lead our team of compiler engineers in developing, deploying, and scaling compilers for AWS Inferentia and Trainium. As a key member of the AWS Neuron team, you will collaborate with AWS ML services teams to innovate and ensure the Neuron SDK meets customer needs for high...


  • Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a talented software engineer to join our Neuron team, where you will play a key role in developing a compiler targeting AWS Inferentia and Trainium, our custom Silicon ML accelerators.Key ResponsibilitiesDesign and implement business-critical features for our compiler, working closely with a brilliant team of experienced...


  • Toronto, Ontario, Canada Amazon Full time

    About the RoleWe are seeking a talented software engineer to join our Neuron team, where you will play a key role in developing a compiler targeting AWS Inferentia and Trainium, our custom Silicon ML accelerators.Key ResponsibilitiesDesign and implement business-critical features for our compiler, working closely with a brilliant team of experienced...


  • Toronto, Ontario, Canada Amazon Full time

    About the RoleAt Amazon, we're committed to making deep learning pervasive for everyday developers and democratizing access to cutting-edge infrastructure. To deliver on this vision, we've created innovative software and hardware solutions that make it possible.Job SummaryWe're looking for a talented Compiler Engineer to join our Neuron team, where you'll be...


  • Toronto, Ontario, Canada Amazon Full time

    About the RoleAt Amazon, we're committed to making deep learning pervasive for everyday developers and democratizing access to cutting-edge infrastructure. To deliver on this vision, we've created innovative software and hardware solutions that make it possible.Job SummaryWe're looking for a talented Compiler Engineer to join our Neuron team, where you'll be...

  • Senior Staff Engineer

    4 weeks ago


    Old Toronto, Ontario, Canada BenchSci Full time

    About the Role:We are seeking a highly skilled Staff Machine Learning Engineer to join our platform architecture team at BenchSci. As a key player in our mission to exponentially increase the speed and quality of life-saving research and development, you will be responsible for designing and implementing cutting-edge ML architectures that drive innovation...

  • Senior Staff Engineer

    4 weeks ago


    Old Toronto, Ontario, Canada BenchSci Full time

    About the Role:We are seeking a highly skilled Staff Machine Learning Engineer to join our platform architecture team at BenchSci. As a key player in our mission to exponentially increase the speed and quality of life-saving research and development, you will be responsible for designing and implementing cutting-edge ML architectures that drive innovation...


  • Toronto, Ontario, Canada Amazon Development Centre Canada ULC Full time

    About UsAmazon Development Centre Canada ULC is at the forefront of innovation in silicon and software, combining cloud scale with the world's most talented engineers. Our team covers multiple disciplines including silicon engineering, hardware design and verification, software and operations.Job DescriptionWe are seeking a highly skilled Manager III to lead...


  • Toronto, Ontario, Canada Amazon Full time

    Unlock the Power of Deep Learning with AWS NeuronAt Amazon, we're committed to making deep learning accessible to everyone. Our Neuron team is working on innovative software and hardware solutions to accelerate deep learning workloads. We're looking for talented students to join our team and contribute to the development of a compiler targeting AWS...


  • Toronto, Ontario, Canada Lightmatter Full time

    Job Title: Staff Software Engineer - ML Hardware ModelingLightmatter is a cutting-edge technology company that builds chips for extreme-scale artificial intelligence computing clusters. We're seeking a talented Staff Software Engineer to join our team and contribute to the development of the next generation of AI processors and large-scale systems.Key...


  • Toronto, Ontario, Canada Lightmatter Full time

    Job Title: Staff Software Engineer - ML Hardware ModelingLightmatter is a cutting-edge technology company that builds chips for extreme-scale artificial intelligence computing clusters. We're seeking a talented Staff Software Engineer to join our team and help us build the next generation of AI processors and large-scale systems.Key Responsibilities:Design,...

ML Compiler Engineer, Staff

2 months ago


Old Toronto, Ontario, Canada d-Matrix Full time
About d-Matrix

d-Matrix is a pioneering technology company that has revolutionized the field of memory-compute integration with its innovative digital in-memory compute (DIMC) engine. This groundbreaking technology has enabled the company to break through the memory wall, minimizing data movements and paving the way for large-scale generative inference acceleration.

With a strong foundation of over $154M in funding, including a significant Series B offering, d-Matrix is poised to make a significant impact in the industry. The company's mission is to advance the field of artificial intelligence by developing cutting-edge solutions that meet the energy and performance demands of large language models.

About the Role

We are seeking an exceptional ML Compiler Engineer, Staff to join our compiler team. The successful candidate will be responsible for developing the compiler backend, specifically focusing on the problem of assigning hardware resources in a spatial architecture to execute low-level instructions. This is a critical role that requires a strong understanding of algorithmic compiler problems, intricate details of hardware and software architectures, and the ability to deliver production-quality code in modern C++.

Key Responsibilities
  • Develop and optimize compiler infrastructure for large language models
  • Design and implement algorithms for model partitioning, tiling, resource allocation, memory management, scheduling, and optimization
  • Collaborate with the compiler team to develop and maintain a high-performance compiler backend
  • Work closely with the hardware team to ensure seamless integration with the DIMC engine
Requirements
  • Bachelor's degree in Computer Science with 7+ years of relevant industry experience, or MSCS with 5+ years of relevant industry experience
  • Strong understanding of modern compiler infrastructures, such as LLVM and MLIR
  • Experience with machine learning frameworks and interfaces, including ONNX, TensorFlow, and PyTorch
  • Excellent problem-solving skills and ability to deliver high-quality code
Preferred Qualifications
  • Algorithm design ability, from high-level conceptual design to actual implementation
  • Experience with relevant Open Source ML projects, such as Torch-MLIR, ONNX-MLIR, Caffe, and TVM
  • Passionate about working in a fast-paced and dynamic startup culture
About Our Culture

d-Matrix is committed to fostering an inclusive and diverse work environment where everyone feels welcome and empowered to do their best work. We value humility, kindness, dedication, and a willingness to learn and grow together. If you are a talented and motivated individual who is passionate about advancing the field of artificial intelligence, we encourage you to apply for this exciting opportunity.