Lead Principal Engineer – Edge AI Solutions

4 weeks ago


Old Toronto, Ontario, Canada Extreme Networks, Inc. Full time

Lead Principal Engineer – Edge AI Solutions

Extreme Networks, Inc. is on the lookout for a skilled Lead Principal Engineer specializing in Edge AI, particularly in the realm of GPU/TPU acceleration. The successful candidate will possess a wealth of practical experience in deploying Local Large Language Models (LLM) inference within embedded GPU/TPU frameworks. In this pivotal role, you will significantly influence the development of cutting-edge Edge AI solutions, harnessing the capabilities of GPU/TPU acceleration and large-scale edge computing.

Your blend of technical prowess and leadership will be instrumental in driving project success and fostering a collaborative team environment.

Key Responsibilities:
  • Architectural Design and Strategy
  • Shape the Edge AI vision by offering expert insights on system design and architecture.
  • Make pivotal decisions concerning technical strategies, scalability, and overall system efficiency.
  • Develop and refine AI inference models tailored for edge devices equipped with GPU/TPU accelerators, emphasizing local Low Latency Model (LLM) inference.
  • Establish and optimize low-latency inference pipelines to satisfy real-time operational demands.
  • Work alongside cross-disciplinary teams to embed AI inference capabilities into edge computing solutions and applications.
  • Collaborate with the GPU Hardware Design Team to innovate and enhance GPUs that drive next-generation technology.
  • Conduct performance evaluations and optimizations to maximize the effectiveness of GPU/TPU acceleration for local LLM inference.
  • Engage in micro-architecture development, ensuring the efficient execution of graphics, compute, and AI tasks within defined energy and area constraints.
  • Stay abreast of advancements in GPU/TPU technologies and edge AI frameworks, integrating relevant innovations into solution designs.
  • Provide technical guidance and support to project teams, ensuring the successful rollout of edge AI initiatives.
Leadership and Team Development:
  • Inspire and lead a team of engineers, offering mentorship, establishing objectives, and promoting teamwork.
  • Oversee project planning, execution, and delivery, ensuring alignment with organizational goals.
  • Manage all stages of technical projects, from inception to final delivery.
  • Develop project specifications, monitor progress, and manage budgets effectively.
  • Encourage a positive workplace culture that fosters professional development and knowledge sharing.
Qualifications:
  • Bachelor's degree in Computer Science, Engineering, or a related discipline; a Master's degree is preferred.
  • 5+ years of practical experience in AI model development and deployment, with a focus on edge computing and local LLM inference.
  • Strong programming capabilities in languages such as Python and C++.
  • Expertise in LLM frameworks (e.g., vLLM, Text Generation Inference, OpenLLM, Ray Serve, and HuggingFace Transformers) and deep learning libraries.
  • Extensive experience with GPU/TPU acceleration for AI inference, including optimization techniques and performance tuning.
  • Hands-on experience with GPU frameworks such as CUDA, Vulkan, or OpenCL.
  • Deep understanding of GPU memory architecture and familiarity with relevant SoC configurations.
  • Knowledge of parallel processing, memory scheduling, and structural optimization.
  • Exceptional problem-solving and analytical abilities, with a commitment to innovation and continuous improvement.
Preferred Additional Skills:
  • Experience with the integration of hardware and software for edge devices.
  • Familiarity with edge computing architectures and IoT platforms.
  • Experience in edge AI applications across sectors such as robotics, autonomous vehicles, or industrial automation.
  • If you are a dedicated Edge AI Engineer eager to advance the frontiers of edge computing and GPU/TPU acceleration, we invite you to consider this opportunity to contribute to the evolution of AI at the edge.



  • Toronto, Ontario, Canada Extreme Networks, Inc. Full time

    Job Summary:Extreme Networks, Inc. is seeking a highly skilled Senior Staff Engineer to lead our Edge AI Engineering team. As a key member of our team, you will be responsible for designing, developing, and deploying cutting-edge Edge AI solutions that drive business growth and innovation.Key Responsibilities:Develop and optimize AI inference models for...


  • Toronto, Ontario, Canada Extreme Networks, Inc. Full time

    Job Summary:Extreme Networks, Inc. is seeking a highly skilled Senior Staff Engineer to lead our Edge AI Engineering team. As a key member of our team, you will be responsible for designing, developing, and deploying cutting-edge Edge AI solutions that drive business growth and innovation.Key Responsibilities:Develop and optimize AI inference models for...


  • Old Toronto, Ontario, Canada Seismic Full time

    About the RoleWe are seeking a highly skilled Principal Software Engineer to lead our AI search technology and architectural directions at Seismic. As a key member of our team, you will define and drive the AI search technology and architectural directions, ensuring alignment with business goals and product roadmaps.Key ResponsibilitiesTechnology and...


  • Old Toronto, Ontario, Canada Seismic Full time

    About the RoleWe are seeking a highly skilled Principal Software Engineer to lead our AI search technology and architectural directions at Seismic. As a key member of our team, you will define and drive the AI search technology and architectural directions, ensuring alignment with business goals and product roadmaps.Key ResponsibilitiesTechnology and...

  • Lead Developer

    1 week ago


    Old Toronto, Ontario, Canada Canadian Imperial Bank of Commerce Full time

    About the RoleWe are seeking a highly skilled Senior AI Systems Engineer to lead our Application Engineering team in the development of cutting-edge AI solutions. As a key member of our team, you will be responsible for designing, implementing, and supporting AI-based systems using Python and other technologies.Key ResponsibilitiesDesign and Planning:...

  • Lead Developer

    7 days ago


    Old Toronto, Ontario, Canada Canadian Imperial Bank of Commerce Full time

    About the RoleWe are seeking a highly skilled Senior AI Systems Engineer to lead our Application Engineering team in the development of cutting-edge AI solutions. As a key member of our team, you will be responsible for designing, implementing, and supporting AI-based systems using Python and other technologies.Key ResponsibilitiesDesign and Planning:...


  • Toronto, Ontario, Canada Seismic Full time

    Important Notice: We have observed a rise in hiring scams that may target candidates. Please refer to our official statement on our Careers page for more information.About Seismic:Seismic is a rapidly expanding company recognized in the Forbes Cloud 100, serving as the premier global leader in sales enablement. Our mission is to enhance the productivity of...

  • DevOps Engineer

    3 days ago


    Old Toronto, Ontario, Canada Nestbox AI Inc Full time

    Job Title: DevOps Engineer - Generative AI PlatformNestbox AI Inc is a leading technology company that specializes in developing cutting-edge generative AI solutions. We are seeking a highly skilled DevOps Engineer to join our team and contribute to the development and maintenance of our AI infrastructure.Key Responsibilities:Design and Implement AI...

  • DevOps Engineer

    3 days ago


    Old Toronto, Ontario, Canada Nestbox AI Inc Full time

    Job Title: DevOps Engineer - Generative AI PlatformNestbox AI Inc is a leading technology company that specializes in developing cutting-edge generative AI solutions. We are seeking a highly skilled DevOps Engineer to join our team and contribute to the development and maintenance of our AI infrastructure.Key Responsibilities:Design and Implement AI...


  • Toronto, Ontario, Canada Blue J Legal Inc. Full time

    Join Our Team - Innovators in AI TechnologyAt Blue J Legal Inc., we aspire to lead the industry in AI-driven solutions for tax professionals. Our cutting-edge tax research software is recognized as a leader in the field. We are seeking a Lead Software Engineer to become a vital part of our dynamic team and contribute to the evolution of AI-enhanced tax...


  • Toronto, Ontario, Canada Loblaw Digital Full time

    About UsAt Loblaw Digital, we are dedicated to providing outstanding experiences for our customers. Our vision is to create innovative online shopping solutions and develop impactful applications that enhance lives across the nation. As the digital team behind Canada's largest and most successful retailer, we thrive in a fast-paced, collaborative...


  • Toronto, Ontario, Canada Intuit Full time

    About Intuit Intuit is a leading global financial technology platform dedicated to empowering individuals and communities by providing innovative solutions. With a customer base of over 100 million worldwide, including users of TurboTax, QuickBooks, and Credit Karma, our mission is to create opportunities for everyone to thrive. Your Role: Director of...


  • Toronto, Ontario, Canada Autodesk Full time

    Job DescriptionPosition OverviewAre you a seasoned software development professional looking to make a significant impact in the Architecture, Engineering, and Construction (AEC) industry? Do you have a passion for leading teams and driving innovation in AI and data engineering? If so, we have an exciting opportunity for you to join our team at Autodesk as a...


  • Toronto, Ontario, Canada Autodesk Full time

    Job DescriptionPosition OverviewAre you a seasoned software development professional looking to make a significant impact in the Architecture, Engineering, and Construction (AEC) industry? Do you have a passion for leading teams and driving innovation in AI and data engineering? If so, we have an exciting opportunity for you to join our team at Autodesk as a...


  • Toronto, Ontario, Canada Seismic Full time

    Important Notice: We have observed a rise in hiring scams that may target candidates. Please refer to our official statement on our Careers page for more information. About Seismic: Seismic is a fast-growing company recognized in the Forbes Cloud 100, specializing in enablement solutions that enhance the productivity of sales teams and improve buyer...


  • Toronto, Ontario, Canada Seismic Full time

    About SeismicSeismic is a rapidly growing company that specializes in sales enablement. We help make sales teams better by becoming more productive and engaging with buyers in a compelling way. Our platform provides continuous guidance to improve behavior, content, and skills to win more deals and deliver better experiences.Job DescriptionWe are seeking a...


  • Toronto, Ontario, Canada Seismic Full time

    About SeismicSeismic is a rapidly growing company that specializes in sales enablement. We help make sales teams better by becoming more productive and engaging with buyers in a compelling way. Our platform provides continuous guidance to improve behavior, content, and skills to win more deals and deliver better experiences.Job DescriptionWe are seeking a...


  • Toronto, Ontario, Canada Seismic Full time

    Important Notice: We have observed a rise in hiring scams targeting candidates. Please refer to our official statement on our Careers page for more information.About Seismic:Seismic is a leading company in the enablement sector, recognized in the Forbes Cloud 100. Our mission is to enhance the productivity of sales teams by providing them with tools that...


  • Toronto, Ontario, Canada Dreamwell AI Full time

    About Dreamwell AIWe are a leading influencer marketing platform focused on delivering high-performance and revenue-driven solutions for top brands worldwide. Our mission is to revolutionize the industry by leveraging cutting-edge technology and innovative strategies.Job SummaryWe are seeking an experienced Frontend Software Engineer to join our team at...

  • Lead Data Engineer

    3 weeks ago


    Toronto, Ontario, Canada Royal Bank of Canada> Full time

    About the Opportunity RBC BOREALIS is seeking a talented Lead Data Engineer to join our dynamic team. As a key contributor, you will play a vital role in developing and maintaining cutting-edge data solutions that deliver actionable insights for various business units within the Bank. This is an exciting opportunity to work at the forefront of AI...