Current jobs related to ML Compiler Architect, Senior Principal - Toronto - d-Matrix


  • Toronto, Canada Altera Full time

    A leading technology company in Toronto seeks a Senior Hardware/Software ML Inference IP and Compiler Developer with extensive experience in hardware design and FPGA development. The ideal candidate will bridge hardware and software designs to optimize machine learning performance. Responsibilities include collaboration within a focused team to innovate in...


  • Toronto, Canada Altera Full time

    A leading technology company in Toronto seeks a Senior Hardware/Software ML Inference IP and Compiler Developer with extensive experience in hardware design and FPGA development. The ideal candidate will bridge hardware and software designs to optimize machine learning performance. Responsibilities include collaboration within a focused team to innovate in...


  • Toronto, Canada Altera Full time

    Altera .Senior Hardware/Software ML Inference IP and Compiler Developer page is loaded## Senior Hardware/Software ML Inference IP and Compiler Developerlocations: Toronto, Ontario, Canadatime type: Full timeposted on: Posted Yesterdayjob requisition id: R01816# **Job Details:**### ## **Job Description:**Altera is one of the world’s leading providers of...


  • Toronto, Canada Altera Full time

    Altera .Senior Hardware/Software ML Inference IP and Compiler Developer page is loaded## Senior Hardware/Software ML Inference IP and Compiler Developerlocations: Toronto, Ontario, Canadatime type: Full timeposted on: Posted Yesterdayjob requisition id: R01816# **Job Details:**### ## **Job Description:**Altera is one of the world’s leading...


  • Toronto, Canada Intel Corporation Full time

    A leading technology company in Toronto is seeking a Senior Compiler Architect to oversee the runtime architecture for their compiler stack, focusing on both CPU and GPU/accelerators. The ideal candidate will have extensive experience in compiler development, particularly with LLVM.org, and a background in performance tuning for accelerated computing. This...


  • Toronto, Canada Intel Corporation Full time

    A leading technology firm in Toronto is seeking a Senior Compiler Architect to drive the runtime architecture for their open-source compiler stack. The successful candidate will lead delivery of innovative features for high-performance offload and collaborate with external communities. Required qualifications include 8+ years in compiler development,...


  • Toronto, Canada IC Resources Full time

    3 days ago Be among the first 25 applicants Get AI-powered advice on this job and more exclusive features. This range is provided by IC Resources. Your actual pay will be based on your skills and experience — talk with your recruiter to learn more. Base pay range CA$150,000.00/yr - CA$200,000.00/yr Direct message the job poster from IC Resources Senior /...


  • Toronto, Canada Altera Full time

    Principal FPGA Compiler Software Engineer page is loaded Principal FPGA Compiler Software Engineer Apply locations Toronto, Ontario, Canada time type Full time posted on Posted 4 Days Ago job requisition id R01093 Job Details: Job Description: Become a member of our world-class software research and development team! Altera develops programmable logic...


  • Toronto, Canada Lemurian Labs Inc. Full time

    About Us At Lemurian Labs, we're on a mission to bring the power of AI to everyone—without leaving a massive environmental footprint. We care deeply about the impact AI has on our society and planet, and we're building a solid foundation for its future, ensuring AI grows sustainably and responsibly. Innovation should help the world, not harm it. We are...


  • Toronto, Canada Lemurian Labs Inc. Full time

    About Us At Lemurian Labs, we're on a mission to bring the power of AI to everyone—without leaving a massive environmental footprint. We care deeply about the impact AI has on our society and planet, and we're building a solid foundation for its future, ensuring AI grows sustainably and responsibly. Innovation should help the world, not harm it. We are...

ML Compiler Architect, Senior Principal

2 hours ago


Toronto, Canada d-Matrix Full time

Join to apply for the ML Compiler Architect, Senior Principal role at d-Matrix5 days ago Be among the first 25 applicantsJoin to apply for the ML Compiler Architect, Senior Principal role at d-MatrixAt d-Matrix, we are focused on unleashing the potential of generative AI to power the transformation of technology. We are at the forefront of software and hardware innovation, pushing the boundaries of what is possible. Our culture is one of respect and collaboration.We value humility and believe in direct communication. Our team is inclusive, and our differing perspectives allow for better solutions. We are seeking individuals passionate about tackling challenges and are driven by execution. Ready to come find your playground? Together, we can help shape the endless possibilities of AI.Location:Hybrid, working onsite at our Toronto, Ontario, Canada headquarters 3-5 days per week.Role: Software Compiler Architect – MLIR/LLVM for Cloud InferenceWhat You Will DoAs a hands-on Front-End Software Compiler Architect focused on cloud-based AI inference, you will drive the design and implementation of a scalable MLIR-based compiler framework optimized for deploying large-scale NLP and transformer models in cloud environments. You will architect the end-to-end software pipeline that translates high-level AI models into efficient, low-latency executables on a distributed, multi-chiplet hardware platform featuring heterogeneous compute elements such as in-memory tensor processors, vector engines, and hierarchical memory.Your compiler designs will enable dynamic partitioning, scheduling, and deployment of inference workloads across a cloud-scale infrastructure, supporting both statically compiled and runtime-optimized execution paths. You will focus on compiler strategies that minimize inference latency, maximize throughput, and efficiently utilize compute and memory resources in data center environments, in addition to your work on developing the compiler.You will collaborate cross-functionally with systems architects, ML framework teams, runtime developers, performance engineers, and cloud orchestration groups to ensure seamless integration and optimized inference delivery at scale.Key ResponsibilitiesArchitect the MLIR-based compiler for cloud inference workloads, focusing on efficient mapping of large-scale AI models (e.g., LLMs, Transformers, Torch-MLIR) onto distributed compute and memory hierarchies.Lead the development of compiler passes for model partitioning, operator fusion, tensor layout optimization, memory tiling, and latency-aware scheduling.Design support for hybrid offline/online compilation and deployment flows with runtime-aware mapping, allowing for adaptive resource utilization and load balancing in cloud scenarios.Define compiler abstractions that interoperate efficiently with runtime systems, orchestration layers, and cloud deployment frameworks.Drive scalability, reproducibility, and performance through well-designed IR transformations and distributed execution strategies.Mentor and guide a team of compiler engineers to deliver high-performance inference-optimized software stacks.What You Will BringBS 15+ Yrs / MS 12+ Yrs / PhD 10+ Yrs Computer Science or Electrical Engineering, with 12+ years of experience in Front End Compiler and systems software development, with a focus on ML inference.Deep experience in designing or leading compiler efforts using MLIR, LLVM, Torch-MLIR, or similar frameworks.Strong understanding of model optimization for inference: quantization, fusion, tensor layout transformation, memory hierarchy utilization, and scheduling.Expertise in deploying ML models to heterogeneous compute environments, with specific attention to latency, throughput, and resource scaling in cloud systems.Proven track record working with AI frameworks (e.g., PyTorch, TensorFlow), ONNX, and hardware backends.Experience with cloud infrastructure, including resource provisioning, distributed execution, and profiling tools.Preferred QualificationsExperience targeting inference accelerators (AI ASICs, FPGAs, GPUs) in cloud-scale deployments.Knowledge of cloud deployment orchestration (e.g., Kubernetes, containerized AI workloads).Strong leadership skills with experience mentoring teams and collaborating with large-scale software and hardware organizations.Excellent written and verbal communication; capable of presenting complex compiler architectures and trade-offs to both technical and executive stakeholders.This role is a cornerstone of our cloud AI software strategy. You'll shape the way inference workloads are deployed, optimized, and scaled across data center infrastructure.Equal Opportunity Employment Policyd-Matrix is proud to be an equal opportunity workplace and affirmative action employer. We’re committed to fostering an inclusive environment where everyone feels welcomed and empowered to do their best work. We hire the best talent for our teams, regardless of race, religion, color, age, disability, sex, gender identity, sexual orientation, ancestry, genetic information, marital status, national origin, political affiliation, or veteran status. Our focus is on hiring teammates with humble expertise, kindness, dedication and a willingness to embrace challenges and learn together every day.d-Matrix does not accept resumes or candidate submissions from external agencies. We appreciate the interest and effort of recruitment firms, but we kindly request that individual interested in opportunities with d-Matrix apply directly through our official channels. This approach allows us to streamline our hiring processes and maintain a consistent and fair evaluation of al applicants. Thank you for your understanding and cooperation.Seniority levelSeniority levelMid-Senior levelEmployment typeEmployment typeFull-timeJob functionJob functionDesign, Art/Creative, and Information TechnologyIndustriesSemiconductor ManufacturingReferrals increase your chances of interviewing at d-Matrix by 2xGet notified about new Senior Architect jobs in Toronto, Ontario, Canada.Architect - Healthcare Projects - Western CanadaSenior Architect/Technologist QA/QC and Contract AdministratorMississauga, Ontario, Canada CA$153,000.00-CA$170,000.00 2 weeks agoSenior/Lead System Architect (PEGA Certified)We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI. #J-18808-Ljbffr