Principal Software Engineering Manager

2 weeks ago


Vancouver, Canada Microsoft Full time
Principal Software Engineering Manager - AI Performance

We own inference performance of OpenAI and other state of the art Large Language Models (LLMs) and work directly with OpenAI on the models hosted on the Azure OpenAI service serving some of the largest workloads on the planet with trillions of inferences per day in major Microsoft products, including Office, Windows, Bing, SQL Server, and Dynamics.

As a Principal Software Engineering Manager on the team, you will have the opportunity to work on multiple levels of the AI software stack, including the fundamental abstractions, programming models, compilers, runtimes, libraries and APIs to enable large scale training and inferencing of models. You will benchmark OpenAI and other LLMs for performance on GPUs and Microsoft HW, debug and optimize performance, monitor performance and enable these models to be deployed in the shortest amount of time and the least amount of HW possible helping achieve Microsoft Azure's capex goals.

This is a technical management role: it requires managing an engineering team, helping set the technical direction of the team, and hands-on software design and development skills. We’re looking for someone who has a demonstrated history of solving hard technical problems and is motivated to tackle the hardest problems in building a full end-to-end AI stack. An entrepreneurial approach and ability to take initiative and move fast are essential.

Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

#J-18808-Ljbffr

  • Vancouver, British Columbia, Canada Microsoft Full time

    Job SummaryWe are seeking a highly skilled Principal Software Engineering Manager to lead our team of software engineers in delivering high-quality software solutions for Azure Data Engineering.As a key member of our team, you will be responsible for mentoring software engineers, collaborating with cross-functional teams, and driving technical excellence and...


  • Vancouver, British Columbia, Canada Microsoft Corporation Full time

    Job SummaryWe are seeking a Principal Software Engineer Manager to lead a team of software engineers in the Fabric Shell team within Azure Data. The ideal candidate will have a strong background in web application development, including JavaScript, TypeScript, HTML, CSS, and at least one popular web frontend framework.ResponsibilitiesLead and mentor a team...


  • Vancouver, British Columbia, Canada WineDirect Full time

    Software Engineering PrincipalWe are the leading provider of software and fulfillment services for wineries, enabling them to create and manage successful direct-to-consumer (DTC) programs. Our e-commerce, wine club management, point-of-sale, and order fulfillment solutions help our clients thrive in the dynamic and profitable sales channel. With over 15...


  • Vancouver, British Columbia, Canada Microsoft Full time

    Job SummaryMicrosoft is a company where passionate innovators come to collaborate, envision what can be, and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world.We are looking for a skilled technical leader to join our Azure Data Engineering team. As a...


  • Vancouver, BC, Canada Microsoft Full time €135,800 - €253,000

    The Experience plus Devices (E+D) Growth team is seeking a Principal Software Engineering Manager (EM) to help accelerate the adoption of Copilot and Microsoft 365. Our team is uniquely positioned at the strategic epicenter of E+D for revolutionizing the productivity business by delivering embedded experiences across the Microsoft 365 suite (Teams, Outlook,...


  • Vancouver, British Columbia, Canada Microsoft Full time

    Job DescriptionWe are seeking a highly skilled Principal Software Engineering Lead to join our team at Microsoft. As a key member of our organization, you will be responsible for leading the development of our Windows networking stack, with a focus on network security.As a Principal Software Engineering Lead, you will be responsible for designing features in...


  • Vancouver, British Columbia, Canada Demonware Full time

    Job Title: Principal Software EngineerJob Summary:Demonware is seeking a highly skilled Principal Software Engineer to join our data engineering team. As a key member of our team, you will be responsible for designing, developing, and supporting scalable and efficient data applications, tools, and frameworks.Key Responsibilities:Design and develop scalable...


  • Vancouver, British Columbia, Canada Microsoft Canada Full time

    Job OverviewMicrosoft Canada is seeking a highly skilled Principal Software Engineering Lead to join our Core OS team. As a key member of our team, you will be responsible for designing and developing features in the Windows networking stack that enhance network security. You will work closely with global teams to collaborate on design and development...


  • Vancouver, British Columbia, Canada Microsoft Canada Full time

    Job OverviewMicrosoft Canada is seeking a highly skilled Principal Software Engineering Lead to join our Core OS team. As a key member of our team, you will be responsible for designing and developing features in the Windows networking stack that enhance network security. You will work closely with global teams to collaborate on design and development...


  • Vancouver, British Columbia, Canada Later Full time

    We are seeking an exceptional Principal Software Engineer to contribute to our dynamic team. As a Principal Software Engineer, you will be responsible for designing and developing scalable, high-performance software solutions. You will collaborate with our product development team to translate business requirements into technical solutions, and you will play...


  • Vancouver, Canada Microsoft Corporation Full time

    Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of...


  • Vancouver, British Columbia, Canada Aerospace Talent Group LLC Full time

    Aerospace Talent Group LLC seeks a highly skilled Principal Automation Software Engineer to join their team in Vancouver, BC. This exciting opportunity is ideal for individuals with a strong background in software engineering and automation technology.Estimated Salary: CAD $100,000 - $140,000 per yearAbout the RoleThe successful candidate will play a key...


  • Vancouver, British Columbia, B6B, British Columbia, Canada Microsoft Canada Full time

    Microsoft Dynamics 365 is a suite of easy-to-learn and easy-to-use business solutions tailored to any market, designed for any business size, and dedicated to grocuttingwing business through delighted customers. The Project Operations team builds business applications on top of two different platforms that run on Azure and pull together Dynamics 365, Office...


  • Vancouver, British Columbia, Canada Splunk Inc. Full time

    Splunk's mission is to build a safer and more resilient digital world. To achieve this, we need talented engineers who can help us develop innovative solutions. As a Principal Software Engineer, you will be part of our Data Management development area, working on the Platform Experience team.Role:We build software that enables our customers to search,...


  • Vancouver, Canada Amazon Full time

    Principal Software Engineer, AWS DynamoDBAre you interested in building and operating some of the largest distributed systems on the planet? In AWS DynamoDB, our mission is to provide customers with best-in-class cloud data services to store, query, and analyze the enormous datasets that their businesses generate. We build distributed storage, index, and...


  • Vancouver, Canada Microsoft Full time

    Principal Software Engineer - Teams Premium ServicesIn Teams Premium Experiences team, people are at the center of everything we do. Our tech moves beyond screens and pixels, creating a new reality aimed at bringing us closer together — from remote coworkers socializing to build deeper connections to global leaders collaborating on the biggest challenges...


  • Vancouver, Canada Microsoft Full time

    The Experience plus Devices (E+D) Growth team is seeking a Principal Software Engineering Manager (EM) to help accelerate the adoption of Copilot and Microsoft 365. Our team is uniquely positioned at the strategic epicenter of E+D for revolutionizing the productivity business by delivering embedded experiences across the Microsoft 365 suite (Teams, Outlook,...


  • Vancouver, British Columbia, Canada Sierra Space Full time

    About the RoleWe are seeking a highly skilled Principal Flight Software Engineer to join our team at Sierra Space. As a key member of our Orbital Mission and Services division, you will be responsible for designing and developing flight software and algorithms solutions for spacecraft missions. Your primary responsibility will be to ensure that our...

  • Principal Engineer

    4 months ago


    Vancouver, Canada WineDirect Full time

    Principal Engineer WineDirect is the only fully integrated Direct-to-Consumer platform purpose-built for wineries. We are the clear leader in software and fulfillment services enabling wineries to create and manage successful DTC programs. With e-commerce, wine club management, point-of-sale, and order fulfillment – we offer everything our clients need to...


  • Vancouver, British Columbia, Canada Microsoft Full time

    Job SummaryWe are seeking a talented Principal Software Engineer Lead to join our Linux Platform Group within Core OS. As a member of this team, you will have the opportunity to design and implement solutions that improve the Operating System (OS) platform and deliver value to our customers.Key ResponsibilitiesDesign and develop new automation solutions for...