Machine Learning Engineer

3 weeks ago


Halifax, Canada Prodigy Labs Full time
We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high performance and reusable APIs. The ideal candidate is someone who has strong ML fundamentals and can also apply them in real production settings. In particular, this role has a core focus on optimizing inference and fine tuning for LLMs. They should also be comfortable with infrastructure and large scale system design, as well as diagnosing both model performance and system failures.

You will: Responsibilities Architect/Enable distributed compute aligning workloads to Small/Mid/High end GPUs. Leverage appropriate storage hardware and data formats to improve read/re-read efficiency. Identify and remediate latency contributors esp. IO bottlenecks, Inefficient Data shuffling, under/over utilized compute. Scale models by employing Distributed training using Data / Model Parallelism techniques. Parallelize inference processing to improve prediction latency. Provide Subject Matter Expertise in Graph and Vector databases for a variety of use cases that include Knowledge Graphs, RAG etc. Implement LLM observability and monitoring solutions.

Required Education and Experience Degree in Computer Science or Engineering Prior Experience with:- Docker, Kubernetes, and containerization. Distributed systems. Databricks ML Machine Learning Engineering Cloud (Azur Preferred) Expert level – Python, SQL

Preference will be given to candidates who in addition to required experience have:- Experience/Expertise with LLM Fine tuning, LLM Ops, Model Evaluation and Prompt Engineering Experience (or knowledge of) Mosaic ML, Ray Framework. Experience with Lang Chain or LlamaIndex Experience with any vector database.

Job Specifications:-

Authorities, Impact, Risk

Influence the data, AI and cloud journey for the bank. Influence the Sustainability roadmap for the bank.

Impact

Revenue generation thru New Business for Alternative Data Innovation 6 years of AI, Big Data and cloud expertise 3-4 years of Alternative data experience

Risk

Mitigate reputation risk thru AI driven Data Quality to ensure highest quality data and services are offered to clients

Mandatory Skillsets:-

2+ years of experience building machine learning training pipelines or inference services in a production setting. Experience with LLM deployment, fine tuning, training, prompt engineering, etc. Experience with LLM inference latency optimization techniques, e.g. kernel fusion, quantization, dynamic batching, etc. Experience with CUDA, model compilers, and other model-specific optimizations.

Preferred

Experience working with a cloud technology stack (eg. Azure or AWS). Experience building, deploying, and monitoring complex microservice architectures. Experience with Python, Docker, Kubernetes, and Infrastructure as code (e.g. terraform). Experience with LLMs, MLops Experience with distributed notebook environments like Databricks Experience building AI driven Data Quality frameworks and other data governance tools and capabilities Experience building meta data driven AI and statistical models for repeatable insight generation Experience building front to back data pipelines comprising of data ingestion , enrichment , data quality , Analytics and reporting Experience with Agile development methodology Experience with company KPIs and back testing of alternative data factors against company KPIs. Experience with NLP techniques and transfer learning frameworks like BERT Experience with using HuggingFace Model Artifacts



  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs a UST Company Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs a UST Company Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs a UST Company Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Nova Scotia, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, NS, Canada Launch Potato Full time

    Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of advertisers to customers at all parts of the consumer journey, from awareness to consideration to purchase. The company is headquartered in vibrant downtown Delray Beach, Florida , with a...

  • Machine Operators

    1 week ago


    Halifax Regional Municipality, Canada Kelly Services, Inc. Full time

    We at Kelly Services are looking for recent graduates of Machining or Mechanical Engineering Technology programs to work with our client Pratt & Whitney Canada on a 2-year contract in Enfield, NS!? As the successful candidate, you will be required to work 12-hour rotating shifts in a 24-7 environment.? You have great attention to detail, enjoy completing...

  • Machine Operators

    3 weeks ago


    Halifax Regional Municipality, Canada Kelly Services, Inc. Full time

    We at Kelly Services are looking for recent graduates of Machining or Mechanical Engineering Technology programs to work with our client Pratt & Whitney Canada on a 2-year contract in Enfield, NS!? As the successful candidate, you will be required to work 12-hour rotating shifts in a 24-7 environment.? You have great attention to detail, enjoy completing...


  • Halifax, Canada Serendeputy Full time

    Launch Potato The Discovery and Conversion Company. Launch Potato connects the world's fastest growing brands to customers at all parts of the consumer journey. View company page Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of...


  • Halifax, Canada Serendeputy Full time

    Launch Potato The Discovery and Conversion Company. Launch Potato connects the world's fastest growing brands to customers at all parts of the consumer journey. View company page Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of...


  • Halifax, Canada Serendeputy Full time

    Launch Potato The Discovery and Conversion Company. Launch Potato connects the world's fastest growing brands to customers at all parts of the consumer journey. View company page Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of...


  • Halifax, Canada Serendeputy Full time

    Launch Potato The Discovery and Conversion Company. Launch Potato connects the world's fastest growing brands to customers at all parts of the consumer journey. View company page Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of...


  • Halifax, Canada Serendeputy Full time

    Launch Potato The Discovery and Conversion Company. Launch Potato connects the world's fastest growing brands to customers at all parts of the consumer journey. View company page Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of...


  • Halifax, Canada Serendeputy Full time

    Launch Potato The Discovery and Conversion Company. Launch Potato connects the world's fastest growing brands to customers at all parts of the consumer journey. View company page Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of...


  • Halifax, Canada IMP Group Full time

    **Learning & Development Facilitator**: **Requisition ID**:1059** **Why Choose IMP Aerospace & Defence**: IMP Aerospace & Defence is not only one of the leading companies in the Aerospace field, but we are also one of the most engaging and equality advocating companies to work for. We believe that regardless of where you work at IMP Aerospace & Defence, you...