Machine Learning Engineer

4 weeks ago


Toronto ON, Canada Prodigy Labs Full time

We are looking for a Machine Learning Engineer to join our team to help build systems that accelerate the development and deployment of machine learning models, especially large language models (LLMs). You will partner closely with Machine Learning researchers and internal users to understand requirements and apply your own domain expertise to build high performance and reusable APIs.The ideal candidate is someone who has strong ML fundamentals and can also apply them in real production settings. In particular, this role has a core focus on optimizing inference and fine tuning for LLMs. They should also be comfortable with infrastructure and large scale system design, as well as diagnosing both model performance and system failures.You will:ResponsibilitiesArchitect/Enable distributed compute aligning workloads to Small/Mid/High end GPUs.Leverage appropriate storage hardware and data formats to improve read/re-read efficiency.Identify and remediate latency contributors esp. IO bottlenecks, Inefficient Data shuffling, under/over utilized compute.Scale models by employing Distributed training using Data / Model Parallelism techniques. Parallelize inference processing to improve prediction latency.Provide Subject Matter Expertise in Graph and Vector databases for a variety of use cases that include Knowledge Graphs, RAG etc.Implement LLM observability and monitoring solutions.Required Education and ExperienceDegree in Computer Science or EngineeringPrior Experience with:-Docker, Kubernetes, and containerization.Distributed systems.Databricks MLMachine Learning EngineeringCloud (Azur Preferred)Expert level – Python, SQLPreference will be given to candidates who in addition to required experience have:- Experience/Expertise with LLM Fine tuning, LLM Ops, Model Evaluation and Prompt EngineeringExperience (or knowledge of) Mosaic ML, Ray Framework.Experience with Lang Chain or LlamaIndexExperience with any vector database.Job Specifications:-Authorities, Impact, RiskInfluence the data, AI and cloud journey for the bank. Influence the Sustainability roadmap for the bank.ImpactRevenue generation thru New Business for Alternative DataInnovation6 years of AI, Big Data and cloud expertise3-4 years of Alternative data experienceRiskMitigate reputation risk thru AI driven Data Quality to ensure highest quality data and services are offered to clientsMandatory Skillsets:-2+ years of experience building machine learning training pipelines or inference services in a production setting.Experience with LLM deployment, fine tuning, training, prompt engineering, etc.Experience with LLM inference latency optimization techniques, e.g. kernel fusion, quantization, dynamic batching, etc.Experience with CUDA, model compilers, and other model-specific optimizations.PreferredExperience working with a cloud technology stack (eg. Azure or AWS).Experience building, deploying, and monitoring complex microservice architectures.Experience with Python, Docker, Kubernetes, and Infrastructure as code (e.g. terraform).Experience with LLMs, MLopsExperience with distributed notebook environments like DatabricksExperience building AI driven Data Quality frameworks and other data governance tools and capabilitiesExperience building meta data driven AI and statistical models for repeatable insight generationExperience building front to back data pipelines comprising of data ingestion , enrichment , data quality , Analytics and reportingExperience with Agile development methodologyExperience with company KPIs and back testing of alternative data factors against company KPIs.Experience with NLP techniques and transfer learning frameworks like BERTExperience with using HuggingFace Model Artifacts



  • Toronto, ON, Canada The Institute for Performance and Learning Full time

    Boosted.ai is a fintech company headquartered in Toronto, Canada with offices in New York City. We provide AI tools to asset managers to augment their equity capital markets research. Boosted.ai empowers finance professionals to use AI and machine learning to sort through massive amounts of data to find stock opportunities. We are a well funded, post...


  • Old Toronto, Canada The Institute for Performance and Learning Full time

    Boosted.ai is a fintech company headquartered in Toronto, Canada with offices in New York City. We provide AI tools to asset managers to augment their equity capital markets research. Boosted.ai empowers finance professionals to use AI and machine learning to sort through massive amounts of data to find stock opportunities. We are a well funded, post...


  • Old Toronto, Canada The Institute for Performance and Learning Full time

    Boosted.ai is a fintech company headquartered in Toronto, Canada with offices in New York City. We provide AI tools to asset managers to augment their equity capital markets research. Boosted.ai empowers finance professionals to use AI and machine learning to sort through massive amounts of data to find stock opportunities. We are a well funded, post...


  • Old Toronto, Canada The Institute for Performance and Learning Full time

    Boosted.ai is a fintech company headquartered in Toronto, Canada with offices in New York City. We provide AI tools to asset managers to augment their equity capital markets research. Boosted.ai empowers finance professionals to use AI and machine learning to sort through massive amounts of data to find stock opportunities. We are a well funded, post...


  • Toronto, ON, Canada Limitless Staffing Full time

    ATTENTION: LinkedIn is the only acceptable method to apply for this position. Limitless will contact the candidates selected. Please do not contact Limitless personnel via email or telephone. No other resumes will be considered using an alternative submission process.Our client is a well-established financial institution with a significant presence in North...


  • Toronto, ON, Canada Limitless Staffing Full time

    ATTENTION: LinkedIn is the only acceptable method to apply for this position. Limitless will contact the candidates selected. Please do not contact Limitless personnel via email or telephone. No other resumes will be considered using an alternative submission process.Our client is a well-established financial institution with a significant presence in North...


  • Toronto, ON, Canada Quincus Pte. Ltd. Full time

    “Make every logistics journey your best one yet” The Company. Founded in 2014, Quincus is a B2B supply chain operating SaaS platform headquartered inSingapore. We solve today's global supply chain challenges with groundbreaking technology. Using AI and machine learning, we have digitized and optimized the logistics process while giving customers...


  • Toronto, ON, Canada ShopThing Full time

    About This Role:The ShopThing team is looking for a talented junior to mid-level Machine Learning Engineer to join our growing team! This role is a 6-8 month fixed term contract to cover a maternity leave with the possibility of full- time employment at the end of the term. The successful candidate will be responsible for maintaining and improving our...


  • Toronto, ON, Canada ShopThing Full time

    About This Role:The ShopThing team is looking for a talented junior to mid-level Machine Learning Engineer to join our growing team! This role is a 6-8 month fixed term contract to cover a maternity leave with the possibility of full- time employment at the end of the term. The successful candidate will be responsible for maintaining and improving our...


  • Toronto, ON, Canada ShopThing Full time

    About This Role:The ShopThing team is looking for a talented junior to mid-level Machine Learning Engineer to join our growing team! This role is a 6-8 month fixed term contract to cover a maternity leave with the possibility of full- time employment at the end of the term. The successful candidate will be responsible for maintaining and improving our...


  • Toronto, ON, Canada ShopThing Full time

    About This Role:The ShopThing team is looking for a talented junior to mid-level Machine Learning Engineer to join our growing team! This role is a 6-8 month fixed term contract to cover a maternity leave with the possibility of full- time employment at the end of the term. The successful candidate will be responsible for maintaining and improving our...


  • Toronto, ON, Canada ShopThing Full time

    About This Role:The ShopThing team is looking for a talented junior to mid-level Machine Learning Engineer to join our growing team! This role is a 6-8 month fixed term contract to cover a maternity leave with the possibility of full- time employment at the end of the term. The successful candidate will be responsible for maintaining and improving our...


  • Toronto, ON, Canada ShopThing Full time

    About This Role:The ShopThing team is looking for a talented junior to mid-level Machine Learning Engineer to join our growing team! This role is a 6-8 month fixed term contract to cover a maternity leave with the possibility of full- time employment at the end of the term. The successful candidate will be responsible for maintaining and improving our...


  • Toronto, ON, Canada ShopThing Full time

    About This Role:The ShopThing team is looking for a talented junior to mid-level Machine Learning Engineer to join our growing team! This role is a 6-8 month fixed term contract to cover a maternity leave with the possibility of full- time employment at the end of the term. The successful candidate will be responsible for maintaining and improving our...


  • Toronto, ON, Canada ShopThing Full time

    About This Role:The ShopThing team is looking for a talented junior to mid-level Machine Learning Engineer to join our growing team! This role is a 6-8 month fixed term contract to cover a maternity leave with the possibility of full- time employment at the end of the term. The successful candidate will be responsible for maintaining and improving our...


  • Toronto, ON, Canada DeepRec.ai Full time

    Machine Learning EngineerHealthcare, AIDeepRec.ai are hiring for a talented Machine Learning Engineer to join a fantastic organisation in Canada who are using AI to improve patient experiences and the clinical workflow. This is an innovative and inspiring organisation who have specific clinical tasks they need to perform, where they use AI to execute them.As...


  • Toronto, ON, Canada DeepRec.ai Full time

    Machine Learning EngineerHealthcare, AIDeepRec.ai are hiring for a talented Machine Learning Engineer to join a fantastic organisation in Canada who are using AI to improve patient experiences and the clinical workflow. This is an innovative and inspiring organisation who have specific clinical tasks they need to perform, where they use AI to execute them.As...


  • Toronto, ON, Canada DeepRec.ai Full time

    Machine Learning Engineer Healthcare, AI DeepRec.ai are hiring for a talented Machine Learning Engineer to join a fantastic organisation in Canada who are using AI to improve patient experiences and the clinical workflow. This is an innovative and inspiring organisation who have specific clinical tasks they need to perform, where they use AI to execute...


  • Toronto, Canada Bitstrapped Full time

    We are seeking a highly skilled and experienced Machine Learning Engineer to join our team. As a Machine Learning Engineer, you will play a key role in developing and deploying machine learning models on Google Cloud, with a focus on generative AI and large language models, primarily text-based. This is an opportunity to work on cutting-edge projects and...


  • Toronto, Canada Bitstrapped Full time

    We are seeking a highly skilled and experienced Machine Learning Engineer to join our team. As a Machine Learning Engineer, you will play a key role in developing and deploying machine learning models on Google Cloud, with a focus on generative AI and large language models, primarily text-based. This is an opportunity to work on cutting-edge projects and...