Machine Learning Engineer

4 weeks ago


Halifax, Canada Prodigy Labs Full time

We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high performance and reusable APIs and can also apply them in real production settings.

Responsibilities
  • Architect/Enable distributed compute aligning workloads to Small/Mid/High end GPUs
  • Leverage appropriate storage hardware and data formats to improve read/re-read efficiency
  • Identify and remediate latency contributors especially IO bottlenecks, inefficient data shuffling, under/over utilized compute
  • Scale models by employing distributed training using Data / Model Parallelism techniques
  • Parallelize inference processing to improve prediction latency.
  • Provide Subject Matter Expertise in Graph and Vector databases for various use cases including Knowledge Graphs, RAG etc.
  • Implement LLM observability and monitoring solutions
  • Manage infrastructure and large-scale system design and diagnose both model and system failures
  • Mitigate reputation risk through AI driven Data Quality to ensure highest quality data and services are offered to clients

Please Note: This is a hybrid position and will require at least 2 days in the office per week. Successful candidates will need to complete a background check.

  • 5-6 years of AI, Big Data and cloud expertise
  • 3-4 years of Alternative data experience
  • 2+ years of experience building machine learning training pipelines or inference services in a production setting
  • Experience with LLM deployment, fine tuning, training, prompt engineering, etc
  • Experience with LLM inference latency optimization techniques, e.g. kernel fusion, quantization, dynamic batching, etc.
  • Experience with CUDA, model compilers, and other model-specific optimizations
  • Experience building, deploying, and monitoring complex microservice architectures.
  • Degree in Computer Science or Engineering
  • Prior Experience with: -Docker, Kubernetes, Infrastrure as code (Terraform)and containerization, Agile Methodology, Distributed systems, Databricks ML, Cloud (Azure (preferred) or AWS)
  • Expert level - Python, SQL
  • Experience (or knowledge of) Mosaic ML, Ray Framework
  • Experience with Lang Chain or LlamaIndex
  • Experience with any vector database

Nice to have

  • Experience building front to back data pipelines comprising of data ingestion, enrichment, data quality, Analytics and reporting
  • Experience with company KPIs and back testing of alternative data factors against company KPIs
  • Experience with NLP techniques and transfer learning frameworks like BERT
  • Experience with using HuggingFace Model Artifacts

Why You'll Love Working at Prodigy

  • We are a collective group of people and collaboration is key to our process
  • We don't work for our clients, we work with them
  • A Flexible Hybrid Working Environment
  • Easily accessible downtown location
  • Competitive compensation commensurate with experience
  • Everyone brings something valuable to the table in our supportive, challenging, and collaborative, diverse work environment


All Employees Can Participate in:

  • Company paid health benefits: 100% medical, dental and vision coverage
  • Corporate-discounted Gym Membership through GoodLife
  • Company discount program including Travel, Shopping, Attractions, Wellness, & Sporting events, just to name a few
  • Access to an Employee & Family Assistance program (EAP)
  • Employee Referral Program
  • Employee Opportunity Program
  • Professional Development Program
  • Town Halls
  • Philanthropic Events
  • Social Events

Accessibility

Prodigy is committed to providing equitable treatment and accommodation to ensure a barrier-free recruitment process and workplace. If you require accommodation at any stage during the recruitment process, please contact us at or call ext. 4

Inclusion & Diversity

At Prodigy we foster an inclusive and diverse workforce, believing our strength stems from our individual differences. Our employees, partners, and clients continuously benefit from the innovation and creativity grounded in these values. We strive to be a company that attracts a diverse group of highly skilled people who know that their contributions will be valued and that they will be heard. We are committed to building a corporate culture with people who are excited to join our team, do their best work, and grow with us



  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs a UST Company Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs a UST Company Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Canada Prodigy Labs a UST Company Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Nova Scotia, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high...


  • Halifax, Nova Scotia, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, Nova Scotia, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, Nova Scotia, Canada Launch Potato Full time

    Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of advertisers to customers at all parts of the consumer journey, from awareness to consideration to purchase. The company is headquartered in vibrant downtown Delray Beach, Florida , with a...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, Canada Prodigy Labs Full time

    We are looking for a Machine Learning Engineer who has strong experience in building systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply strong ML fundamentals to build high...


  • Halifax, NS, Canada Launch Potato Full time

    Launch Potato is a digital media company with a portfolio of brands and technologies. As The Discovery and Conversion Company, Launch Potato is a leading connector of advertisers to customers at all parts of the consumer journey, from awareness to consideration to purchase. The company is headquartered in vibrant downtown Delray Beach, Florida , with a...

  • Machine Operators

    1 week ago


    Halifax Regional Municipality, Canada MyKelly Full time

    We at Kelly Services are looking for recent graduates of Machining or Mechanical Engineering Technology programs to work with our client Pratt & Whitney Canada on a 2-year contract in Enfield, NS!? As the successful candidate, you will be required to work 12-hour rotating shifts in a 24-7 environment.? You have great attention to detail, enjoy completing...

  • Machine Operators

    4 weeks ago


    Halifax Regional Municipality, Canada Kelly Services, Inc. Full time

    We at Kelly Services are looking for recent graduates of Machining or Mechanical Engineering Technology programs to work with our client Pratt & Whitney Canada on a 2-year contract in Enfield, NS!? As the successful candidate, you will be required to work 12-hour rotating shifts in a 24-7 environment.? You have great attention to detail, enjoy completing...

  • Machine Operators

    3 weeks ago


    Halifax Regional Municipality, Canada Kelly Services, Inc. Full time

    We at Kelly Services are looking for recent graduates of Machining or Mechanical Engineering Technology programs to work with our client Pratt & Whitney Canada on a 2-year contract in Enfield, NS!? As the successful candidate, you will be required to work 12-hour rotating shifts in a 24-7 environment.? You have great attention to detail, enjoy completing...


  • Halifax, Nova Scotia, Canada Marshalls plc Full time

    Multi-Skilled Maintenance Engineer - Electrical Bias Multi-Skilled Maintenance Engineer (Electrical Engineer) Halifax, West Yorkshire £44,678 + benefits + overtime 40 hours per week - Alternating days and nights (Monday - Friday) Our Natural Stone site in Halifax processes over 250 tonnes of stone daily, and you could be part of this winning team We're...


  • Halifax, Nova Scotia, Canada Lloyds Banking Group Full time

    We support agile working Click here for more information on agile working options. Agile Working Options Agile Working Options Hybrid WorkingJOB TITLE :Engineering Lead LOCATION ( S): Halifax or LondonHOURS :Full time Our work style is hybrid, which involves spending at least two days per week, or 40% of our time, at our office site. The Identity &...


  • Halifax, Nova Scotia, Canada ResMed Inc Full time

    Senior Engineer, Software Engineering (Front-end focused) page is loaded Senior Engineer, Software Engineering (Front-end focused) Apply locations Halifax, Canada time type Full time posted on Posted 5 Days Ago job requisition id JR_032838 ResMed has always applied the best of technology to improve people's lives. Now our SaaS technology is fueling a new...