Compiler Software Engineer Intern

2 weeks ago

Old Toronto, Canada d-Matrix Full time

d-Matrix has fundamentally changed the physics of memory-compute integration with our digital in-memory compute (DIMC) engine. The “holy grail” of AI compute has been to break through the memory wall to minimize data movements. We’ve achieved this with a first-of-its-kind DIMC engine. Having secured over $154M, $110M in our Series B offering, d-Matrix is poised to advance Large Language Models to scale Generative inference acceleration with our chiplets and In-Memory compute approach. We are on track to deliver our first commercial product in 2024. We are poised to meet the energy and performance demands of these Large Language Models.

The company has 100+ employees across Silicon Valley, Sydney, and Bengaluru. Our pedigree comes from companies like Microsoft, Broadcom, Inphi, Intel, Texas Instruments, Lucent, MIPS, and Wave Computing. Our past successes include building chips for all the cloud hyperscalers globally - Amazon, Facebook, Google, Microsoft, Alibaba, Tencent along with enterprise and mobile operators like China Mobile, Cisco, Nokia, Ciena, Reliance Jio, Verizon, AT&T. We are recognized leaders in the mixed signal, DSP connectivity space, now applying our skills to next generation AI.

Location: Hybrid, working onsite at our Toronto office 3 days per week.

Role: Compiler Software Engineer Intern

What you will do:

The Compiler Team at d-Matrix is responsible for developing the software that performs the logical-to-physical mapping of a graph expressed in an IR dialect (like Tensor Operator Set Architecture (TOSA), MHLO, or Linalg) to the physical architecture of the distributed parallel memory accelerator used to execute it. It performs multiple passes over the IR to apply operations like tiling, compute resource allocation, memory buffer allocation, scheduling, and code generation. You will be joining a team of exceptional people enthusiastic about developing state-of-the-art ML compiler technology. This internship position is for 3 months.

In this role, you will design, implement, and evaluate a method for managing floating point data types in the compiler. You will work under the guidance of two members of the compiler backend team. One is an experienced compiler developer based on the West Coast of the US.

You will engage and collaborate with the engineering team in the US to understand the mechanisms made available by the hardware design to perform efficient floating point operations using reduced precision floating point data types.

Successful completion of the project will be demonstrated by a simple model output by the compiler incorporating your code that executes correctly on the hardware instruction set architecture (ISA) simulator. This model incorporates various number format representations for reduced precision floating point.

What you will bring:

  • Bachelor’s degree in computer science or equivalent 3 years towards an Engineering degree with emphasis on computing and mathematics coursework.
  • Proficiency with C++ object-oriented programming is essential.
  • Understanding of fixed point and floating-point number representations, floating point arithmetic, reduced precision floating point representations, and sparse matrix storage representations and the methods used to convert between them.
  • Some experience in applied computer programming (e.g., prior internship).
  • Understanding of basic compiler concepts and methods used in creating compilers (ideally via a compiler course).
  • Data structures and algorithms for manipulating directed acyclic graphs.

Desired:

  • Familiarity with sparse matrix storage representations.
  • Hands-on experience with CNN, RNN, Transformer neural network architectures.
  • Experience with programming GPUs and specialized HW accelerator systems for deep neural networks.
  • Passionate about learning new compiler development methodologies like MLIR.
  • Enthusiastic about learning new concepts from compiler experts in the US and a willingness to defeat the time zone barriers to facilitate collaboration.

Equal Opportunity Employment Policy

d-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication, and a willingness to embrace challenges and learn together every day.

d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individuals interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of all applicants. Thank you for your understanding and cooperation.

#J-18808-Ljbffr

  • AWS Neuron Vision Compiler Software Engineer Intern

    3 weeks ago

    Old Toronto, Canada Amazon Full time

    AWS Neuron Vision: Our mission is to make deep learning pervasive for everyday developers and democratize access to cutting-edge infrastructure. We've created innovative software and hardware solutions to make it possible.AWS Neuron SDK: Optimizes performance of complex neural net models executed on AWS Inferentia and Trainium, custom chips designed to...

  • Neuron Compiler Software Engineer Intern, Annapurna ML

    3 months ago

    Old Toronto, Canada Amazon Full time

    At AWS our vision is to make deep learning pervasive for everyday developers and to democratize access to cutting edge infrastructure. In order to deliver on that vision, we’ve created innovative software and hardware solutions that make it possible.AWS Neuron is the SDK that optimizes the performance of complex neural net models executed on AWS Inferentia...

  • Senior Compiler Engineer

    3 weeks ago

    Toronto, Ontario, Canada Flexstaf IT Full time

    Job Title: Senior Compiler EngineerAbout the Role:We are seeking a skilled Senior Compiler Engineer to join our team at Flexstaf IT. As a Senior Compiler Engineer, you will be responsible for developing solutions to spatial architecture problems using a high-level graph compiler, low-level conventional compiler, and other tools.Key...

  • Neural Network Compiler Software Engineer Intern

    1 month ago

    Toronto, Ontario, Canada Amazon Full time

    Unlock the Power of Deep Learning with AmazonAt Amazon, we're committed to making deep learning accessible to everyone. To achieve this vision, we've developed innovative software and hardware solutions that accelerate deep learning workloads. Our team is looking for talented students to join us as a Compiler Engineer on the Neuron team.About the RoleAs a...

  • FPGA Compiler Software Engineer

    4 weeks ago

    Toronto, Ontario, Canada Intel Full time

    Job Title: FPGA Compiler Software EngineerJob Summary:We are seeking a highly skilled FPGA Compiler Software Engineer to join our team at Intel. As a key member of our Programmable Solutions Group, you will be responsible for developing and optimizing the software for Quartus, the tool that programs the latest FPGA devices.Key Responsibilities:Develop and...

  • Technical Lead for Compiler Engineering and Innovation

    2 weeks ago

    Old Toronto, Canada Amazon Full time

    Role OverviewThe Technical Lead for Compiler Engineering and Innovation will be responsible for leading a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium. This role requires technical expertise, credibility, and curiosity to innovate on behalf of customers.About the TeamThe Amazon Annapurna...

  • FPGA Compiler Software Engineer

    5 months ago

    Toronto, Canada Intel Full time

    Job Description In Q4 2023, Intel announced Altera® will be reported as a separate business unit beginning on January 1, 2024, with ongoing support from Intel. This position is associated to that standalone business strategy and is expected to fully transition to a standalone company at some time in the future. We are looking for a passionate and...

  • Senior Compiler Engineer Lead

    2 weeks ago

    Toronto, Ontario, Canada Flexstaf IT Full time

    Job Description:We are seeking a highly skilled Senior Compiler Engineer to join our team at Flexstaf IT in Canada. As a Senior Compiler Engineer, you will be responsible for developing solutions to complex problems presented by spatial architecture.This role requires expertise in combinatorial and graph optimization algorithms, as well as strong C and...

  • Senior Compiler Engineer

    2 months ago

    Toronto, Canada Flexstaf IT Full time

    Senior CompilerEngineer Remote CanadaComputer/Software In this role you will beexpected to develop solutions to the unique problems presented by aspatial architecture. Your playground would include a highlevelgraph compiler a lowlevel conventional compiler and everything inbetween. The problems are simultaneously similar enough to those ofconventional...

  • Senior Compiler Development Manager

    2 weeks ago

    Old Toronto, Canada Amazon Full time

    Amazon is at the forefront of innovation in silicon and software for its customers, combining cloud scale with the world's most talented engineers.About This RoleThis role involves leading a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium. As a trusted Manager III on the AWS Neuron team,...

  • Electrifying FPGA Compiler Software Engineer

    3 weeks ago

    Toronto, Ontario, Canada Intel Full time

    **About the Role**We are seeking a highly skilled FPGA Compiler Software Engineer to join our team at Intel. As part of our Programmable Solutions Group (PSG), you will be working on developing software for Quartus, a tool that programs the latest generation of FPGA devices.

  • Chief Technology Officer

    2 weeks ago

    Toronto, Ontario, Canada Amazon Development Centre Canada ULC Full time

    Amazon Development Centre Canada ULC is at the forefront of innovation in silicon and software development for AWS customers.We are seeking a seasoned Manager III to lead a team of compiler engineers developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium. About the RoleDevelop and implement a high-performance compiler for AWS...

  • Software Architect Compiler Expert

    2 weeks ago

    Toronto, Ontario, Canada Flexstaf IT Full time

    Job Summary:We are seeking a highly skilled Senior Compiler Engineer to join our team at Flexstaf IT.About the RoleIn this exciting role, you will have the opportunity to develop innovative solutions for spatial architecture challenges. You will work with high-level graph compilers, low-level conventional compilers, and everything in between. Your expertise...

  • Sr. Software Development Manager

    5 months ago

    Old Toronto, Canada Amazon Full time

    Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna LabsThe Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best-in-class ML training performance with the most teraflops (TFLOPS) of...

  • Sr. Software Development Manager

    3 months ago

    Old Toronto, Canada Amazon Full time

    Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna LabsThe Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best-in-class ML training performance with the most teraflops (TFLOPS) of...

  • Senior Compiler Engineering Manager

    2 weeks ago

    Toronto, Ontario, Canada Amazon Development Centre Canada ULC Full time

    **Job Summary:**We are seeking an experienced Senior Compiler Engineering Manager to lead a team of compiler engineers in developing, deploying, and scaling a compiler targeting AWS Inferentia and Trainium.The successful candidate will have 3+ years of engineering team management experience, 6+ years of working directly within engineering teams experience,...

  • Sr. Software Development Manager

    3 months ago

    Old Toronto, Canada Amazon Full time

    Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna LabsThe Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best-in-class ML training performance with the most teraflops (TFLOPS) of...

  • Sr. Software Development Manager

    3 months ago

    Old Toronto, Canada Amazon Full time

    Sr. Software Development Manager - Compiler, AWS Neuron, Annapurna LabsThe Product: AWS Machine Learning accelerators are at the forefront of AWS innovation. The Inferentia chip delivers best-in-class ML inference performance at the lowest cost in the cloud. Trainium will deliver the best-in-class ML training performance with the most teraflops (TFLOPS) of...

  • Senior Compiler Engineer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Oho Group Ltd Full time

    Staff Compiler Engineer - Start UpA truly innovative start-up who has just received Series A funding is looking for a Senior Compiler Engineer to join their top quality team. Recent hires have been from Google, Intel and NVIDIA as they aim to reduce the cost of AI models with a chip that provides the same power.Their aim is to reimagine accelerated computing...

  • Software Engineer, Systems ML

    4 weeks ago

    Old Toronto, Canada Meta Full time

    In this role, you will be a member of the MTIA (Meta Training & Inference Accelerator) Software team and part of the bigger industry-leading PyTorch AI framework organization. MTIA Software Team has been developing a comprehensive AI Compiler strategy that delivers a highly flexible platform to train & serve new DL/ML model architectures, combined with...