Machine Learning Engineer

3 weeks ago


Halifax, Canada Prodigy Labs a UST Company Full time

We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high performance and reusable APIs.

The ideal candidate is someone who has strong ML fundamentals and can also apply them in real production settings. In particular, this role has a core focus on optimizing inference and fine tuning for LLMs. They should also be comfortable with infrastructure and large scale system design, as well as diagnosing both model performance and system failures.


You will:

Responsibilities

Architect/Enable distributed compute aligning workloads to Small/Mid/High end GPUs.

Leverage appropriate storage hardware and data formats to improve read/re-read efficiency.

Identify and remediate latency contributors esp. IO bottlenecks, Inefficient Data shuffling, under/over utilized compute.

Scale models by employing Distributed training using Data / Model Parallelism techniques. Parallelize inference processing to improve prediction latency.

Provide Subject Matter Expertise in Graph and Vector databases for a variety of use cases that include Knowledge Graphs, RAG etc.

Implement LLM observability and monitoring solutions.


Required Education and Experience

Degree in Computer Science or Engineering

Prior Experience with:-

Docker, Kubernetes, and containerization.

Distributed systems.

Databricks ML

Machine Learning Engineering

Cloud (Azur Preferred)

Expert level – Python, SQL


Preference will be given to candidates who in addition to required experience have:-

Experience/Expertise with LLM Fine tuning, LLM Ops, Model Evaluation and Prompt Engineering

Experience (or knowledge of) Mosaic ML, Ray Framework.

Experience with Lang Chain or LlamaIndex

Experience with any vector database.



Job Specifications:-


Authorities, Impact, Risk


Influence the data, AI and cloud journey for the bank. Influence the Sustainability roadmap for the bank.


Impact


  • Revenue generation thru New Business for Alternative Data
  • Innovation
  • 6 years of AI, Big Data and cloud expertise
  • 3-4 years of Alternative data experience




Risk


  • Mitigate reputation risk thru AI driven Data Quality to ensure highest quality data and services are offered to clients


Mandatory Skillsets:-


  • 2+ years of experience building machine learning training pipelines or inference services in a production setting.
  • Experience with LLM deployment, fine tuning, training, prompt engineering, etc.
  • Experience with LLM inference latency optimization techniques, e.g. kernel fusion, quantization, dynamic batching, etc.
  • Experience with CUDA, model compilers, and other model-specific optimizations.



Preferred


  • Experience working with a cloud technology stack (eg. Azure or AWS).
  • Experience building, deploying, and monitoring complex microservice architectures.
  • Experience with Python, Docker, Kubernetes, and Infrastructure as code (e.g. terraform).
  • Experience with LLMs, MLops
  • Experience with distributed notebook environments like Databricks
  • Experience building AI driven Data Quality frameworks and other data governance tools and capabilities
  • Experience building meta data driven AI and statistical models for repeatable insight generation
  • Experience building front to back data pipelines comprising of data ingestion , enrichment , data quality , Analytics and reporting
  • Experience with Agile development methodology
  • Experience with company KPIs and back testing of alternative data factors against company KPIs.
  • Experience with NLP techniques and transfer learning frameworks like BERT
  • Experience with using HuggingFace Model Artifacts



  • Halifax, Canada Prodigy Labs a UST Company Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...

  • Manager, Data Science

    5 hours ago


    Halifax, Canada Launch Potato Full time

    YOUR ROLE You will be developing deep personalization models for our users and complex optimization algorithms to bridge our customer experiences with new products/services. You will be pivotal to the growth of our data science team and instrumental as we continue to build a team of data scientists and machine learning engineers that can increase customer...

  • Data Scientist

    4 weeks ago


    Halifax, Canada PTTOR Group Full time

    We are looking for a Data Scientist to analyze large amounts of raw information to find patterns that will help improve our company. We will rely on you to build data products to extract valuable business insights. In this role, you should be highly analytical with a knack for analysis, math and statistics. Critical thinking and problem-solving skills are...

  • Data Scientist

    3 days ago


    Halifax, Canada Mazij Group Full time

    We are looking for a Data Scientist to analyze large amounts of raw information to find patterns that will help improve our company. We will rely on you to build data products to extract valuable business insights. In this role, you should be highly analytical with a knack for analysis, math and statistics. Critical thinking and problem-solving skills are...

  • Projet Manager

    6 days ago


    Halifax, NS, Canada Serendeputy Full time

    Launch Potato connects the world's fastest growing brands to customers at all parts of the consumer journey. Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of advertisers to customers at all parts of the consumer journey, from awareness to...

  • Senior Data Scientist

    3 weeks ago


    Halifax, Canada SAVORMETRICS Full time

    WHAT DOES THIS JOB ENTAIL?The Senior Data Scientist will contribute to the development of Artificial Intelligence driven sensing solutions designed for the food and agriculture sector. The successful individual will immediately contribute to the development and implementation of Artificial Intelligence Platforms that include various machine learning...


  • Halifax, Canada MCW Group of Companies Full time

    Primary Objective: Responsible for the development and management of assigned project work during all phases, from inception through planning, design, and construction, in accordance with the project scope, schedule, and budget.Responsibilities: The Responsibilities of this position include but are not limited to the following:Prepare the concept design...

  • Mechanical Engineer

    11 hours ago


    Halifax, Nova Scotia, Canada Nova Scotia Healthcare Infrastructure Division Full time

    Build NS is currently recruiting a Mechanical Engineer to join the Build NS Healthcare Infrastructure Team.Reporting to the Project Director, the Mechanical Engineer will be a key part of the Build NS Healthcare Infrastructure Team, uniquely qualified to provide guidance and strategy regarding the development of mechanical building system requirements in...

  • Mechanical Engineer

    7 hours ago


    Halifax, Canada Nova Scotia Healthcare Infrastructure Division Full time

    Build NS is currently recruiting a Mechanical Engineer to join the Build NS Healthcare Infrastructure Team.Reporting to the Project Director, the Mechanical Engineer will be a key part of the Build NS Healthcare Infrastructure Team, uniquely qualified to provide guidance and strategy regarding the development of mechanical building system requirements in...


  • Halifax, Canada Dillon Consulting Full time

    Responsibilities What your day will look like Project Management & Waste Management Engineering Design (preliminary and detailed) of civil infrastructure and solid waste projects related to solid waste facility design (landfill, transfer station, compost facilities), facility evaluation, facility operations, landfill gas management, leachate...


  • Halifax, Canada Iris Software Inc. Full time

    Iris's Fortune 100 direct client is looking for Sr. Software Engineer . Please find below Job description and share me your updated resume at amarpreet.singh@irissoftware.com. Position: Sr. Software Engineer Locations: Primary - Halifax, NS; Secondary - Toronto, ON Duration: 24+ Months (Open ended SoW) Design, implement and carry out the development...


  • Halifax, Canada Iris Software Inc. Full time

    Iris's Fortune 100 direct client is looking for Sr. Software Engineer . Please find below Job description and share me your updated resume at amarpreet.singh@irissoftware.com. Position: Sr. Software Engineer Locations: Primary - Halifax, NS; Secondary - Toronto, ON Duration: 24+ Months (Open ended SoW) Design, implement and carry out the development...


  • Halifax, Canada Iris Software Inc. Full time

    Iris's Fortune 100 direct client is looking for Sr. Software Engineer . Please find below Job description and share me your updated resume at amarpreet.singh@irissoftware.com. Position: Sr. Software Engineer Locations: Primary - Halifax, NS; Secondary - Toronto, ON Duration: 24+ Months (Open ended SoW) Design, implement and carry out the development...


  • Halifax, Canada Dovre Group, Inc. Full time

    IntroductionDovre Canada Limited is pleased to offer the following opportunity: Engineer, Industrial Engineering, Continuous Improvement, located in Halifax, NSThis is a permanent full-time position.FunctionOur client is seeking an Engineer to work in the Industrial Engineering department on the Continuous Improvement team. This role will be to improve...


  • Halifax, Canada Iris Software Inc. Full time

    Iris's Fortune 100 direct client is looking forSr. Software Engineer . Please find below Job description and share me your updated resume at amarpreet.singh@irissoftware.com.Position: Sr. Software Engineer Locations: Primary - Halifax, NS; Secondary - Toronto, ON Duration: 24+ Months (Open ended SoW)Design, implement and carry out the development necessary...

  • Civil Engineer

    3 weeks ago


    Halifax, Canada Dillon Consulting Full time

    Responsibilities What your day will look like Project Management and Design  Technical lead and design on projects related to municipal and/or land development infrastructure including water supply, sewers, roads, site servicing and storm water management Contribute technical expertise to functional design, detailed design and construction...


  • Halifax, Canada Nova Scotia Power Full time

    Senior Dam Safety Engineer/Engineering Specialist Location CA-NS-Halifax ID 2024-2728 Category Engineering Position Type Full-Time Logistics Job Title: Senior Dam Safety Engineer/Engineering SpecialistCompany, Department: Nova Scotia Power, Power...


  • Halifax, Canada Nova Scotia Power Full time

    Senior Dam Safety Engineer/Engineering Specialist Location CA-NS-Halifax ID 2024-2728 Category Engineering Position Type Full-Time Logistics Job Title: Senior Dam Safety Engineer/Engineering Specialist Company, Department: Nova Scotia Power, Power Production – Hydro, Wind & Solar Location: Lakeside, NS – Halifax – On-site Type of...


  • Halifax, NS, Canada Dovre Group, Inc. Full time

    Engineer, Industrial Engineering, Continuous Improvement, located in Halifax, NS This is a permanent full-time position. Our client is seeking an Engineer to work in the Industrial Engineering department on the Continuous Improvement team. This role will be to improve production procedures, processes, and controls by executing improvement initiatives...


  • Halifax, Canada Ccwestt Full time

    The Faculty of Engineering invites applications for a career stream faculty position at the rank of Instructor or Senior Instructor. The successful candidate will play an integral part in the teaching of undergraduate courses, with a focus on design-based and mechanics courses, in Year 1 of the Bachelor of Engineering degree program. It is expected that the...