Software Engineer

3 weeks ago

Toronto ON, Canada CentML Inc. Full time

About Us

We are a small team with a big ambition of making modern machine learning accessible for everyone. At CentML, our mission is to enable anyone with an idea to deploy ML models without breaking the bank. We believe that modern AI will fundamentally transform how people work and live and we're here to help bring that future sooner.

Our founding team is made up of experts in AI, compilers, and ML hardware and has led efforts at companies like Amazon, Google, Microsoft Research, Nvidia, Intel, Qualcomm, and IBM. Our co-founder and CEO, Gennady Pekhimenko, is a world-renowned expert in ML systems with a publication history of top papers and multiple academic and industry research awards from Google, Amazon, and Facebook.

About the Position:

As a member of the LLM inference team, you will help build state-of-the-art software with the goal of enabling LLM inference to become more efficient, scalable, and accessible. Are you interested in architecting and implementing the best inference stacks in the LLM world? Work and collaborate with a diverse set of teams involving resource orchestration, distributed systems, inference engine optimization, and writing high-performance GPU kernels.

Come join our team and contribute towards democratizing Machine Learning for the world

Responsibilities:
  • Write safe, scalable, modular, and high-quality (C++/Python) code for our core backend software.
  • Perform benchmarking, profiling, and system-level programming for GPU applications.
  • Provide code reviews, design docs, and tutorials to facilitate collaboration among the team.
  • Conduct unit tests and performance tests for different stages of the inference pipeline.
Who you are:
  • Bachelor's degree in Computer Science, Computer Engineering, relevant technical field, or equivalent practical experience.
  • Strong coding skills in Python and C/C++.
  • 2+ years of industry experience in software engineering.
  • Knowledgeable and passionate about machine learning and performance engineering.
Nice to haves:
  • Solid fundamentals in machine learning and deep learning.
  • Solid fundamentals in operating systems, computer architecture, and parallel programming.
  • Research experience in systems or machine learning.
  • Industry experience in building enterprise-scale large distributed systems.
  • Experience with training, deploying, or optimizing the inference of LLMs in production is a plus.
  • Experience with performance modeling, profiling, debugging, and code optimization or architectural knowledge of CPU and GPU is a plus.

We strongly encourage you to include sample projects (e.g. Github) that demonstrate the qualifications above.

For recent graduates, you can optionally submit your unofficial transcripts.

Benefits & Perks

- An open and inclusive culture and work environment

- Fully stocked kitchen at the office

- Full health and dental benefits

- Parental Leave top-up for 6 months

- Continuous education budget

- Generous vacation - we're not saying unlimited, but if you need extra time to recharge, just ask

At CentML, we celebrate our differences and value cultivating an inclusive environment for all. We welcome applications of all kinds and are committed to providing an equal opportunity process.

#J-18808-Ljbffr

  • Software Test Engineer

    1 week ago

    Toronto, Canada Iris Software Inc. Full time

    Iris's Fortune 100 direct client is looking for QA Engineer with Automation and Data(ETL/SQL) . Please find below Job description and share me your updated resume at Rajneesh.bhardwaj01@Irissoftware.comRole : QA Engineer with Automation and Data(ETL/SQL)Key Skills : Automation and Data(ETL/SQL)ResponsibilitiesSelenium, Automation Should be Good With...

  • Software Engineer

    5 days ago

    Cambridge, ON, Canada Intelliswift Software Full time

    Title: Software Engineer - Power Systems Location: Cambridge ON / Onsite Role Duration: 12+ Months RESPONSIBILITIES Design, develop, and implement software applications using C++ and Java programming languages, ensuring maintainable code following coding standards and best practices. Interface with PLC and RTAC systems to develop software modules that...

  • Software Engineer

    5 days ago

    Cambridge, ON, Canada Intelliswift Software Full time

    Title: Software Engineer - Power Systems Location: Cambridge ON / Onsite Role Duration: 12+ Months RESPONSIBILITIES Design, develop, and implement software applications using C++ and Java programming languages, ensuring maintainable code following coding standards and best practices. Interface with PLC and RTAC systems to develop software modules that...

  • Supplier Industrial Engineer

    3 weeks ago

    Toronto, ON, Canada Dew Software Full time

    Dew Software Supplier Industrial Engineer Position Dew Software is seeking a highly motivated and experienced Supplier Industrial Engineer to join our team. As a leading software solutions company, we work with Fortune 500 clients to optimize their supply chain operations. The Supplier Industrial Engineer will play a crucial role in ensuring the efficiency...

  • Full Stack Software Engineer

    4 weeks ago

    Toronto, ON, Canada Incognito Software Systems Inc Full time

    Full Stack Software Engineer (BiblioCore) page is loaded Full Stack Software Engineer (BiblioCore) Apply locations Canada - Toronto Remote, Canada time type Full time posted on Posted 30+ Days Ago job requisition id R37517 Job Summary: Job Description: Are you interested in being a part of a company that has a positive social impact? Do you want to...

  • Supplier Industrial Engineer

    3 weeks ago

    Toronto, ON, Canada Dew Software Full time

    Dew Software Supplier Industrial Engineer Position Dew Software is seeking a highly motivated and experienced Supplier Industrial Engineer to join our team. As a leading software solutions company, we work with Fortune 500 clients to optimize their supply chain operations. The Supplier Industrial Engineer will play a crucial role in ensuring the efficiency...

  • Software Engineer

    4 weeks ago

    Toronto, ON, Canada GuruLink Full time

    Location: REMOTE / Toronto, Ontario This job allows you to work remotely. Are you a seasoned Fullstack Software Engineer with a strong affinity for Functional Programming vs OOP. Are you eager to apply your deep understanding of computer science concepts to complex real-world challenges? If your answers are a resounding yes, then we have the perfect role...

  • Software Engineer

    4 weeks ago

    Toronto, ON, Canada Brunel Full time

    Software Engineer, Machine Learning (6-month contract) Toronto, ON Introduction We are hiring a Software Engineer for Machine Learning within our clients Digital R&D Large Molecule Research Team. The Software Engineer will be responsible for leveraging large scale ML systems to augment the drug discovery process while also scaling up the company’s AI...

  • Engineer, Software Engineering

    4 weeks ago

    Toronto, ON, Canada Theorem, LLC Full time

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them. As an Android engineer, you will be...

  • Senior Software Engineer

    3 weeks ago

    Toronto, Canada Brightly Software Canada, Inc. Full time

    Who weare Build a brighter future while learning and growing with a Siemens company at the intersection of technology, community and sustainability. Our global team of innovators is always looking to create meaningful solutions to some of the toughest challenges facing our world. Find out how far your passion can take you.  Whatyou’ll be doing ...

  • Software Engineer

    4 weeks ago

    Toronto, ON, Canada B3 Systems Full time

    Company Overview B3 is a native cloud-native data experiences innovator that puts data to work for everyone. Underpinned by AI, data science, and a secure data foundation, our platform makes data actionable with user-friendly integration and dashboard technologies. With, B3, companies get intuitive, agile data experiences that power exponential business...

  • Software Engineer

    3 weeks ago

    Toronto, ON, Canada Equifax, Inc. Full time

    Synopsis of the role The individual in this position will be responsible for end-to-end delivery and maintenance of high-quality software engineered for cloud-nativity and scale. Working closely with local and global technology and business teams, he/she will be taking the lead on designing, coding, delivering, and supporting highly available, secure...

  • Project Software Engineer

    3 weeks ago

    Toronto, ON, Canada Attabotics Inc. Full time

    You are driven, view work as more than just a job, and are never satisfied with a project left half-done. You have a mad scientist mentality where you want to be part of the robots building robots revolution. Attabotics is the world’s first 3D robotics supply chain system for modern commerce. By empowering retailers to place fulfillment centers near...

  • Software Engineer/ Performance Engineer

    3 weeks ago

    Toronto, ON, Canada Collage HR Full time

    We are at the forefront of revolutionizing the financial landscape by building a distributed system that brings order and clarity to the vast and decentralized world of financial service providers. As a dynamic team with an ambitious vision, we are on the lookout for individuals who are passionate about software engineering, eager to shape the future of...

  • Staff Software Engineer

    3 weeks ago

    Toronto, ON, Canada Alphawave IP Inc Full time

    Staff Software Engineer – Software Infrastructure page is loaded Staff Software Engineer – Software Infrastructure Apply locations Toronto time type Full time posted on Posted 6 Days Ago job requisition id JR100235 The Opportunity We're looking for the Wavemakers of tomorrow. Alphawave Semi enables tomorrow’s future by accelerating the...

  • Software Engineering Manager

    3 weeks ago

    Toronto, ON, Canada Adevinta 2021 Full time

    Our technology team is charged with developing, testing, and operating one of the largest e-commerce sites in the country. We are seeking a highly skilled and experienced Software Engineering Manager to lead our talented team of software engineers. The ideal candidate will be passionate about technology, possess strong leadership abilities, and have a...

  • Software Engineer

    3 weeks ago

    Oshawa, ON, Canada Studyincanada Full time

    Software engineers and designers research, design, evaluate, integrate and maintain software applications, technical environments, operating systems, embedded software, information warehouses and telecommunications software. They are employed in information technology consulting firms, information technology research and development firms, and information...

  • Software Engineer/ Performance Engineer

    3 weeks ago

    Toronto, ON, Canada Rivalry Limited Full time

    Software Engineer - Platform, DevOps / SRE (Remote) Department: Engineering Employment Type: Full Time Location: Remote Description Reporting to: VP Engineering Working closely with: Engineering / Product Seniority: Senior TL/DR: We are looking to hire a Software Engineer with a deep passion for solving complex platform and...

  • Software Engineer/ Performance Engineer

    2 weeks ago

    Toronto, ON, Canada Boosted.ai Full time

    ai is a fintech company headquartered in Toronto, Canada with offices in New York City. We provide AI tools to asset managers to augment their equity capital markets research. Boosted.ai empowers finance professionals to use AI and machine learning to sort through massive amounts of data to find stock opportunities. We are a well funded, post Series-B...

  • Manager of Software Engineering

    4 weeks ago

    Toronto, ON, Canada Jobber Full time

    Are you as passionate about the development of people as you are about product? We’re looking for a Manager, Software Engineering to be part of our Backend Foundations System team department. Jobber exists to help people in small businesses be successful. As featured in the Globe and Mail , we work with home and field service companies to help them...