Principal Engineer – Team Lead

1 week ago

Old Toronto, Ontario, Canada Extreme Networks, Inc. Full time

Principal Engineer – Team Lead (Edge AI LLM)

We are seeking a talented Edge AI Principal Engineer with specialized expertise in GPU/TPU acceleration to join our team. The ideal candidate will have extensive hands-on experience in local Large Language Models (LLM) inference with embedded GPU/TPU architectures. As Principal Engineer specializing in Edge AI, you will play a crucial role in shaping the future Edge AI solution, leveraging the power of GPU/TPU acceleration and enterprise grade, large scale edge compute.

The successful candidate will combine technical excellence with effective leadership, creating a positive impact on both projects and team dynamics.

Key Responsibilities:
  • High-Level Design and Architecture
  • Influence the Edge AI strategy by providing expert advice on design and architecture.
  • Make critical decisions regarding technical directions, scalability, and system performance.
  • Develop and optimize AI inference models for deployment on edge devices with embedded GPU/TPU accelerators, focusing on local Low Latency Model (LLM) inference.
  • Implement and fine-tune low-latency model inference pipelines to meet real-time performance requirements.
  • Collaborate with cross-functional teams to integrate AI inference solutions into edge computing platforms and applications.
  • Collaborate with the GPU Hardware Design Team to design and optimize GPUs that power next-generation devices.
  • Conduct performance profiling and optimization to maximize the efficiency of GPU/TPU acceleration for local LLM inference.
  • Work on micro-architecture development, ensuring efficient execution of graphics, compute, and AI workloads within energy and area constraints.
  • Stay current with advancements in GPU/TPU technologies and edge AI frameworks, incorporating them into solution designs as appropriate.
  • Provide technical expertise and support to project teams, ensuring successful implementation and deployment of edge AI solutions.
Team Leadership:
  • Lead and inspire a team of engineers, providing guidance, setting goals, and ensuring collaboration.
  • Oversee project planning, execution, and delivery, ensuring alignment with business objectives.
  • Manage all phases of technical projects, from conception to completion.
  • Develop project specifications, track progress, and control costs.
  • Foster a positive work environment, encouraging professional growth and knowledge sharing.
Qualifications:
  • Bachelor's degree in computer science, Engineering, or a related field; Master's degree preferred.
  • 5+ years of hands-on experience in AI model development and deployment, with a focus on edge computing and local LLM inference.
  • Strong programming skills in languages such as Python and C++
  • Proficiency in LLM frameworks (e.g., vLLM, Text generation inference, OpenLLM, Ray Serve, and HuggingFace Transformers) and deep learning libraries.
  • Extensive experience with GPU/TPU acceleration for AI inference, including optimization techniques (tensor, pipeline, data, sharded data parallelism) and performance tuning,
  • Hands on experience with one or more GPU frameworks: CUDA, Vulkan, OpenCL
  • Deep knowledge of GPU memory layout, familiarity with NVIDIA Jatison, ARM Mali or relevant SoC configurations.
  • Knowledge of parallel computation, memory scheduling, and structural optimization
  • Excellent problem-solving and analytical skills, with a passion for innovation and continuous learning.
Additional Skills (Preferred):
  • Experience with edge device hardware and software integration.
  • Familiarity with edge computing architectures and IoT platforms.
  • Experience with edge AI applications in domains such as robotics, autonomous vehicles, or industrial automation.
  • If you are a skilled Edge AI Engineer with a passion for pushing the boundaries of edge computing and GPU/TPU acceleration, particularly in local LLM inference, we want to hear from you Join us in shaping the future of AI at the edge and revolutionizing industries with innovative edge AI solutions. Apply now to be part of our dynamic and collaborative team

#J-18808-Ljbffr

  • Principal Software Engineer – Team Lead

    1 week ago

    Old Toronto, Ontario, Canada Extreme Networks, Inc. Full time

    Principal Software Engineer – Team Lead (Edge compute -Containerization)Key Responsibilities:We are seeking a highly skilled Edge Compute Principal Engineer with strong leadership, communication, and collaboration abilities to join our dynamic team. The ideal candidate will have expertise in cloud-native technologies, with a focus on distributed Kubernetes...

  • Coordinator/team Lead

    1 week ago

    Toronto, Ontario, Canada TEAM DFF Full time

    Coordinator/Team LeadRole and ResponsibilitiesThe Coordinator/Team Lead is responsible for the daily operations of the home. Leading a small team of personal support workers supporting a young man in his own home. You are responsible for attending to hiring, training, supervising and leading a team of dedicated associates and staffing supports. The...

  • principal engineer

    1 week ago

    Toronto, Ontario, Canada Mani Wonders Inc. Full time

    Mani Wonders Inc. is an emerging product design brand paving a niche in the fashion technology space. The precision-engineered lifestyle products are designed in Toronto and are manufactured and distributed worldwide by Mani Wonders Inc. At Mani Wonders Inc., we believe in making products that bring simplicity and inspiration to your everyday life. We are...

  • Principal Software Engineer

    1 week ago

    Old Toronto, Ontario, Canada GuruLink Full time

    Location: REMOTE / Toronto, OntarioThis job allows you to work remotely.The Principal Software Engineer will be a major contributor to the organization, leading the technical direction and implementation of complex software projects, and will collaborate with cross-functional teams to design, develop, and deploy high-quality software solutions that meet...

  • Principal SystemC Modelling Engineer

    1 week ago

    Old Toronto, Ontario, Canada Alphawave IP Inc Full time

    Principal SystemC Modelling EngineerWe are in search of the Wave Changers of tomorrow at Alphawave Semi, a company that fuels innovation in data communication for various industries. As a Principal SystemC Modelling Engineer, you will take the lead in developing high-level models of complex systems for simulation and verification purposes. Your role will...

  • Senior Principal, Cloud Platform Engineer

    2 weeks ago

    Old Toronto, Ontario, Canada Questrade Full time

    Questrade Financial Group (QFG) of Companies is committed to helping our customers become much more financially successful and secure. We are everything a traditional financial institution is not. At QFG, you will be constantly moving forward, bringing the future of fintech into existence. You will be a part of a collaborative team that cares deeply about...

  • Principal Software Engineer, Rider

    1 week ago

    Old Toronto, Ontario, Canada li Full time

    Lime is the world's largest shared electric vehicle company. We're on a mission to build a future where transportation is shared, affordable and carbon-free. Our electric bikes and scooters have powered 400+ million rides in 250+ cities on 5 continents, replacing an estimated 100+ million car trips. Named a Time 100 Most Influential Company and Fast Company...

  • Engineering Team Lead

    4 weeks ago

    Toronto, Ontario, Canada Localcoin Full time

    ABOUT USLocalcoin, founded in 2017 with headquarters in Toronto, is on a mission to simplify the process and experience of buying or selling digital currencies across Canada. We envision bringing digital currency to the mainstream financial market through partnerships with leading corporate and franchised retail spaces. With terminals across Canada and...

  • Engineering Team Lead

    1 month ago

    Toronto, Ontario, Canada Localcoin Full time

    ABOUT USLocalcoin, founded in 2017 with headquarters in Toronto, is on a mission to simplify the process and experience of buying or selling digital currencies across Canada. We envision bringing digital currency to the mainstream financial market through partnerships with leading corporate and franchised retail spaces. With terminals across Canada and...

  • Principal Software Engineer

    1 week ago

    Old Toronto, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? Principle Full Stack Java Software Engineer – Toronto (hybrid) First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities...

  • Team Lead, Engineering

    1 week ago

    Toronto, Ontario, Canada Zensurance Full time

    Zensurance is an innovative InsurTech company reshaping the commercial insurance sector. At Zensurance, our aim is to support small businesses in Canada by providing a transparent, simplified, and contemporary insurance approach. Our winning formula blends cutting-edge technology and insurance expertise brought to life by our skilled team members. ...

  • Principal Software Engineer, AI/ML Platform

    1 week ago

    Old Toronto, Ontario, Canada Autodesk, Inc. Full time

    Principal Software Engineer, AI/ML Platform page is loaded Principal Software Engineer, AI/ML Platform Apply locations Toronto, ON, CAN time type Full time posted on Posted 2 Days Ago job requisition id 24WD76045 Job Requisition ID # 24WD76045Position OverviewWe are seeking a dynamic and enthusiastic software engineer to develop our next-generation AI/ML...

  • Quality Team Lead

    1 week ago

    Old Toronto, Ontario, Canada Innio Group Full time

    Description In this position you will be reporting directly to the Director of Quality and will be responsible for driving quality in machining/assembly. You will lead improvement initiatives to ensure product compliance with engineering speculations in all phases of engine manufacturing, test and dispatch. You will use sound Lean Six Sigma quality...

  • Principal Mining Engineer

    4 weeks ago

    Toronto, Ontario, Canada Mining Plus Full time

    About the jobWho are We?We are the leading mining technical services provider, consisting of professionals specializing in geology, mining engineering (Surface & Underground), geotechnical engineering, mine ventilation, and operations optimization. We cover the full mining lifecycle from Due Diligence and Financing ('Define'), project technical studies...

  • Principal Mining Engineer

    1 month ago

    Toronto, Ontario, Canada Mining Plus Full time

    About the jobWho are We?We are the leading mining technical services provider, consisting of professionals specializing in geology, mining engineering (Surface & Underground), geotechnical engineering, mine ventilation, and operations optimization. We cover the full mining lifecycle from Due Diligence and Financing ('Define'), project technical studies...

  • Team Lead

    1 week ago

    Old Toronto, Ontario, Canada ACV Full time

    If you are looking for a career at a dynamic company with a people-first mindset and a deep culture of growth and autonomy, ACV is the right place for you Competitive compensation packages and learning and development opportunities, ACV has what you need to advance to the next level in your career. We will continue to raise the bar every day by investing in...

  • Principal Mining Engineer

    4 weeks ago

    Toronto, Ontario, Canada Mining Plus Full time

    Who are We?We are the leading mining technical services provider, consisting of professionals specializing in geology, mining engineering (Surface & Underground), geotechnical engineering, mine ventilation, and operations optimization. We cover the full mining lifecycle from Due Diligence and Financing ('Define'), project technical studies ('Plan') through...

  • Principal Mining Engineer

    1 month ago

    Toronto, Ontario, Canada Mining Plus Full time

    Who are We?We are the leading mining technical services provider, consisting of professionals specializing in geology, mining engineering (Surface & Underground), geotechnical engineering, mine ventilation, and operations optimization. We cover the full mining lifecycle from Due Diligence and Financing ('Define'), project technical studies ('Plan') through...

  • Engineering Team Lead

    1 week ago

    Toronto, Ontario, Canada Bechtel Corporation Full time

    We are seeking a highly skilled and detail-oriented Technical Delivery Manager to oversee the technical delivery and integration of Elevated Guideway & Stations Project, individual contracts pertaining to different segments of the north segment, and the Project/System-wide contract for the Ontario Line Project. Integration and handovers between engineering,...

  • Principal Software Engineering Manager

    1 week ago

    Old Toronto, Ontario, Canada Microsoft Full time

    OverviewThe team at Azure Compute is responsible for creating a robust and scalable system to host cloud applications on virtual machines. They strive to make resources appear limitless, flexible, and constantly accessible.This position is part of the Availability Platform team within Azure Compute, which ensures that every Azure VM is up and running with an...