Current jobs related to Engineering Manager - Waterloo - Huawei Technologies Canada Co., Ltd.


  • Waterloo, Canada Altair Engineering Full time

    Transforming the Future with Convergence of Simulation and Data Software Engineer Senior Job Summary: Our client in Waterloo, ON is looking for a Software Engineer Senior. This is a contract position. What You Will Do: The Software Developer will join a team that manages and maintains our rapidly growing vehicle analytics framework. You will be working as...


  • Waterloo, Ontario, Canada Altair Engineering Full time

    Job Title: Senior Software Development EngineerWe are seeking a skilled Senior Software Development Engineer to join our team at Altair Engineering in Waterloo, ON. This is a contract position.The successful candidate will be responsible for developing and managing various pieces of software that run on multiple components in vehicles to capture, aggregate,...

  • FPGA Design Engineer

    2 weeks ago


    Waterloo, Ontario, Canada Nuvation Engineering Full time

    Nuvation Engineering seeks a highly skilled FPGA Designer to join our team in Waterloo, Ontario. This is a full-time position that requires strong technical expertise, project leadership, and collaboration skills.About NuvationNuvation Engineering provides complex electronic design services to various industries. Founded in 1997, we have completed over 1000...


  • Waterloo, Canada MEDA Engineering and Technical Services, LLC Full time

    We are recruiting an experienced Senior Software Engineer to join our team to support our client in the automotive industry. NOTE: Hybrid RESPONSIBILITIES: Manages and maintains our rapidly growing vehicle analytics framework Developing and managing various pieces of software that run on multiple components in vehicles to capture, aggregate, and...


  • Waterloo, Ontario, Canada MEDA Engineering and Technical Services, LLC Full time

    We are seeking an experienced Senior Software Engineer to support our client in the automotive industry.Key Responsibilities:Manage and maintain a rapidly growing vehicle analytics frameworkDevelop and manage various software components that capture, aggregate, and transmit data to server infrastructureRequired Skills and Qualifications:Bachelor's degree in...


  • Waterloo, Ontario, Canada Nuvation Engineering Full time

    Senior FPGA DesignerWe are seeking a seasoned Senior FPGA Designer to join our engineering team at Nuvation Engineering. As a critical member and leader in our group, you will be responsible for designing and developing complex digital systems, leading project teams, and collaborating with cross-functional teams to deliver high-quality products.About the...


  • Waterloo, Ontario, Canada Cedent Consulting Full time

    About the Role:Software Engineering Manager at Cedent ConsultingWe are seeking a highly skilled and experienced Software Engineering Manager to lead our software development team.Key Responsibilities:Build and manage a high-performing software development team.Collaborate with Product Management to define product vision and strategy.Work with Product Owners...


  • Waterloo, Canada Tower Engineering Professionals Full time

    **Fiber Construction Inspector** **Location**: Waterloo, Peterborough, Barrie, and Ottawa **TEP Canada** is seeking a full-time** Fiber Construction Inspector.** As a Fiber Construction Inspector, you will serve as an integral member of our construction team. TEP Engineering Canada offers a comprehensive benefits package including medical and dental...

  • Senior FPGA Designer

    6 months ago


    Waterloo, Canada Nuvation Engineering Full time

    JOB SUMMARY Nuvation is looking for a talented, innovative Senior FPGA Designer , who successfully combines architecture skills, deep technical expertise, and project leadership. This is a full-time position in our Waterloo Office. The ideal candidate has demonstrated experience working with multi-discipline teams, has sound knowledge of in FPGA...


  • Waterloo, Canada Compass Minerals Full time

    Our people are essential — to their families, their communities and our success. p>Job Description - Soft Rock Engineering and Capital Manager (24000067)Explore the potential of being part of something Clearly Essential!Compass Minerals (NYSE: CMP) is a leading global provider of essential minerals focused on safely delivering where and when it matters to...


  • Waterloo, Ontario, Canada Raytheon Full time

    We are seeking a highly skilled Principal Systems Engineering Manager to join our team. In this role, you will be responsible for leading the planning, coordination, and execution of system engineering activities within an integrated product/project team composed of customers, internal, and subcontract members.The primary focus of this position is on system...


  • Waterloo, Canada CEDENT Full time

    Title: Software Engineering Manager @ Waterloo, On, Canada. Terms of Hire: Full Time. Salary: $Open / yr + Benefits. Job Summary: Seeking a dynamic leader and great team player who enjoys technical challenges in a fast-paced environment, has a vision of where the products should go, knows how to develop strategy, applies sound judgement in successful...


  • Waterloo, Canada CEDENT Full time

    Title: Software Engineering Manager @ Waterloo, On, Canada. Terms of Hire: Full Time. Salary: $Open / yr + Benefits. Job Summary: Seeking a dynamic leader and great team player who enjoys technical challenges in a fast-paced environment, has a vision of where the products should go, knows how to develop strategy, applies sound judgement in successful...


  • Waterloo, Canada Cedent Consulting Full time

    Title: Software Engineering Manager @ Waterloo, On, Canada. Terms of Hire: Full Time. Salary: $Open /yr + Benefits.Job Summary:Seeking a dynamic leader and great team player who enjoys technical challenges in a fast-paced environment, has a vision of where the products should go, knows how to develop strategy, applies sound judgement in successful planning...


  • Waterloo, Canada Cedent Consulting Full time

    Title: Software Engineering Manager @ Waterloo, On, Canada. Terms of Hire: Full Time. Salary: $Open /yr + Benefits.Job Summary:Seeking a dynamic leader and great team player who enjoys technical challenges in a fast-paced environment, has a vision of where the products should go, knows how to develop strategy, applies sound judgement in successful planning...


  • Waterloo, Canada Cedent Consulting Inc Full time

    Software Engineering Manager (Waterloo, ON) Title: Software Engineering Manager @ Waterloo, On, Canada.Terms of Hire: Full Time.Salary: $Open / yr + Benefits.Job Summary: Seeking a dynamic leader and great team player who enjoys technical challenges in a fast-paced environment, has a vision of where the products should go, knows how to develop strategy,...


  • Waterloo, Canada Cedent Consulting Inc Full time

    Software Engineering Manager (Waterloo, ON)Title: Software Engineering Manager @ Waterloo, On, Canada.Terms of Hire: Full Time.Salary: $Open / yr + Benefits.Job Summary:Seeking a dynamic leader and great team player who enjoys technical challenges in a fast-paced environment, has a vision of where the products should go, knows how to develop strategy,...


  • Waterloo, Canada Cedent Consulting Inc Full time

    Software Engineering Manager (Waterloo, ON)Title: Software Engineering Manager @ Waterloo, On, Canada.Terms of Hire: Full Time.Salary: $Open / yr + Benefits.Job Summary:Seeking a dynamic leader and great team player who enjoys technical challenges in a fast-paced environment, has a vision of where the products should go, knows how to develop strategy,...


  • Waterloo, Canada Compass Minerals Full time

    At Compass Minerals, our teams are made of hardworking miners, scientists and explorers who are guided by our compass. Careers at Compass Minerals are challenging, rewarding and make a difference. Our people are essential — to their families, their communities and our success. They're Compass to the Core. Job Description - Soft Rock Engineering and Capital...


  • Waterloo, Canada CARTA Full time

    The Company You’ll Join Carta is a platform that helps people manage equity, build businesses, and invest in the companies of tomorrow. Our mission is to unlock the power of equity ownership for more people in more places.  Carta is trusted by more than 40,000 companies and over two million people in nearly 160 countries to manage cap tables,...

Engineering Manager

1 month ago


Waterloo, Canada Huawei Technologies Canada Co., Ltd. Full time
Principal Engineer - AI Inference Performance

Our team has an immediate permanent opening for a Principal Engineer.

Responsibilities:

  • Develop and maintain real-time and historical performance monitoring tools for AI inference workloads, including profiling tools for various AI model types (small models, LLMs, VLMs, and multimodal systems) in applications like conversational AI, video processing, and real-time analytics.
  • Analyze and classify inference workloads based on characteristics like profile, decode, pre/post-processing overheads, and computational complexity to develop tailored optimization strategies.
  • Develop performance models that consider the systematic factors of AI inference, including model size, architecture (e.g., transformers, CNNs), application-specific constraints (e.g., latency for conversational AI), and compute resource characteristics (GPU, TPU, CPU, and specialized accelerators).
  • Optimize inference workloads across various hardware resources by reducing latency, minimizing memory overhead, and improving throughput. Techniques include quantization, pruning, fusion, and caching. Ensure that models can scale efficiently across diverse compute platforms, from edge devices to large-scale cloud infrastructures.
  • Lead efforts in creating benchmarks for different types of inference tasks. Utilize tools such as NVIDIA Nsight, PyTorch Profiler, and TensorBoard to gain insights into inference performance across diverse hardware platforms.
  • Conduct benchmarking and performance comparisons across various hardware platforms (e.g., GPUs, TPUs, edge accelerators) to identify bottlenecks and optimization opportunities. Provide recommendations for software and hardware improvements based on inference throughput, latency, and power consumption.
  • Work closely with AI research, software engineering, and DevOps teams to improve the end-to-end AI inference pipeline, ensuring optimized deployments across different production environments. Collaborate with system architects to incorporate resource-aware optimizations into design practices.
  • Develop strategies to ensure the scalability of inference workloads in production environments, considering both model performance and resource scaling, whether in on-premises environments, cloud infrastructure, or edge computing devices.

What you’ll bring to the team:

  • Ph.D. or Master’s degree in Computer Science, Electrical Engineering, Machine Learning, or related field.
  • Minimum 5+ years of experience in AI/ML engineering with a focus on inference performance, workload analysis, and system optimization.
  • Extensive experience with AI frameworks (e.g., TensorFlow, PyTorch, ONNX) and model optimization techniques (e.g., quantization, pruning, kernel fusion, and hardware-aware tuning).
  • Proficient with profiling tools (e.g., TensorBoard, PyTorch Profiler, NVIDIA Nsight) and workload analysis for diverse AI models and applications.
  • Expertise in optimizing small models, large language models (LLMs), VLMs, and multimodal models for inference.
  • Strong programming skills in Python, C++, CUDA, and experience with low-level hardware performance tuning.
  • Familiarity with performance modeling methodologies and frameworks for predicting inference workload performance under varying conditions.
  • Proven expertise in data parallelism, model parallelism, pipeline parallelism, and other distributed systems for performance improvements at scale.
#J-18808-Ljbffr