Senior Machine Learning Engineer

At Klue, We're Building the Future of Competitive Intelligence Klue Engineering is hiring

We're looking for a Senior Machine Learning Engineer to join our team in Toronto, focusing on building and optimizing state-of-the-art LLM-powered agents that can reason, plan and automate workflows for users. You will be leading the design and development of search and retrieval agent systems that enable users to generate compete insights for their business. In this role, you will own projects end-to-end, guiding architecture decisions, experimentation strategy, and production readiness for LLM-powered retrieval and generation workflows.

You will shape how we integrate retrieval-augmented generation (RAG), dense retrieval, query understanding, and agentic reasoning loops to deliver fast, accurate, and trusted search experiences at scale.

What You'll Do

• Architect, design, and implement retrieval pipelines and agentic workflows, including hybrid retrieval, re-ranking, and post-retrieval synthesis.

• Lead the development of evaluation frameworks (offline and human-in-the-loop) to measure and improve relevance, quality, and latency.

• Drive experimentation with query rewriting, expansion, and classification to enhance retrieval effectiveness.

• Optimize LLM workflows by designing prompt structures, retrieval strategies, and caching for low-latency, high-accuracy responses.

• Collaborate cross-functionally with product and infrastructure teams to align technical direction with product goals.

• Mentor and provide technical guidance to team members, establishing best practices for building production-ready ML systems.

• Every day, our services process millions of data points, including news articles, press releases, webpage changes, Slack posts, emails, reviews, CRM opportunities, and user actions. You will own data strategy for retrieval and design pipelines to automatically extract insights about competitors from both public and internal data sources

• Evaluate and integrate advancements in LLMs, retrieval architectures, and agentic reasoning into our production systems.
  

What You Bring

• 5+ years of industry experience building and deploying ML systems, with at least 2+ years working on search, retrieval, or ranking systems.

• Expert-level programming skills in Python, with experience using frameworks such as PyTorch, TensorFlow, or JAX.

• Deep understanding of information retrieval (BM25, dense retrieval, hybrid retrieval) and relevance tuning.

• Experience with LLMs, retrieval-augmented generation pipelines, and prompt engineering.

• Track record of designing and delivering production-grade ML systems at scale, balancing experimentation with reliability.

• Deep understanding of data pipelines, preprocessing, and large-scale data handling.

• Familiarity with evaluation methodologies for search systems (recall, MRR, nDCG) and user-facing evaluations.

• Experience working with vector database infrastructure (FAISS, Milvus, Weaviate, Pinecone, PGVector) and traditional search engines (Elasticsearch, OpenSearch)

• Familiarity with scalable cloud ML infrastructure (AWS, GCP, Azure).

• Develop and implement CI/CD pipelines. Automate the deployment and monitoring of ML models.

• Knowledge of query understanding, document summarization and other content enrichment strategies

• Ability to lead projects independently while providing technical direction to others.
  

Nice-to-Haves:

• Experience designing agentic LLM systems and multi-step retrieval workflows.

• Background in conversational search

• Contributions to open-source search, retrieval, or LLM-related projects.

• Interest in publishing or sharing learnings with the broader community.

What Success Looks Like

We're looking for builders who:

• Take ownership and run with ambiguous problems

• Jump into new areas and rapidly learn what's needed to deliver solutions

• Bring scientific rigor while maintaining a pragmatic delivery focus

• See unclear requirements as an opportunity to shape the solution

Our Tech Stack

• LLM platforms: OpenAI, Anthropic, open-source models

• ML frameworks: PyTorch, Transformers, spaCy

• Search/Vector DBs: Elasticsearch, Pinecone, PostgreSQL

• MLOps tools: Weights & Biases, MLflow, Langfuse

• Infrastructure: Docker, Kubernetes, GCP

• Development: Python, Git, CI/CD

Not ticking every box? That's okay. We take potential into consideration. An equivalent combination of education and experience may be accepted in lieu of the specifics listed above. If you know you have what it takes, even if that's different from what we've described, be sure to explain why in your application.

At Klue, we're committed to building a high-performing team where people feel a strong sense of belonging, can be their authentic selves, and are able to reach their full potential. If there's anything we can do to make our hiring process more accessible or to better support you, please let us know, we're happy to accommodate.

Why Klue Might Be the Perfect Fit For You

At Klue, you'll push the boundaries of what's possible. For yourself, your team, and our customers. The environment here feels more startup than corporate. You'll roll up your sleeves, build, iterate, and level up. This is a place where your ideas matter, you can shape what comes next, and leave your mark.

If you're looking to join a category-defining company… where you own big outcomes, influence real customers, and work with smart, gritty people… you'll thrive here.

Unlock Your Potential. Take Risks. Take Action. Innovate

How We Work at Klue

We love the balance of connection and flexibility. We work hybrid, spending at least 2-3 days a week in-office to collaborate, brainstorm, and build together.

• Our main hubs are in:

  • Vancouver (HQ)

  • Toronto

  • London

Our Commitment to You

• High Performance Culture. We reward high performance and growth through career development, coaching, and annual performance reviews.

• Comprehensive benefits: Extended health & dental coverage that starts on Day 1. Fun perks like discounts at Goodlife and Perkopolis are gravy.

• Ownership: All full-time employees have the opportunity to participate in our Employee Stock Option Plan.

• Our Vacation Policy is Take The Time You Need. We just ask that you give notice and don't leave your team hanging.

• Top-tier tools. All employees will receive a Mac (or PC, if that's your jam) and access to A+ tooling.

• AI First. All employees are encouraged to lean into AI to work smarter and faster. Built something cool lately? Show us at our Friday Show, Don't Tell Meetings.

• Growth / Leadership. Direct access to our leadership team, including our CEO, and opportunities to connect with incredible people across the company.

• Social connection. There's no shortage of ways to stay connected and have fun. We get together once a year in Vancouver for a company- wide kickoff. Throughout the year our Hubs hold regular social events.

• Dog-friendly spaces. Bring your four-legged friend along in Vancouver or Toronto, as our offices are pup-approved.

About Klue

We're on a mission to help organizations stop losing winnable deals. Klue's AI agents generate market, competitor, and buyer insights in a unified platform. We ensure it's trustworthy, automated, and activated across every department, so they have the answers they need to own their market.

Here's what makes us tick:

• Klue is AI-first at its core. It's wired deep into our internal processes and tooling, powering our small but mighty team. It drives Klue's autonomous agents that handle the heavy lifting for customers: collecting intel, generating insights, and ensuring content is updated and available across departments. Our agents help them scale their impact, stay ahead of the market, and reclaim the time that used to be consumed by manual, repetitive busywork.

• Competitor Insights. Klue helps revenue teams win more competitive deals by turning market, competitor, and buyer signals into insights teams can actually use. Our AI analyzes calls, CRM data, and real buyer feedback to give product marketers and sellers a clear picture of what's happening in their market and why deals are won or lost. We're a curious, collaborative team building a platform that helps companies compete with confidence, and we're looking for people who want to do meaningful work alongside others who care about craft and impact.

• A culture of curiosity, ownership and winning together. We're a fast-growing, globally-distributed team based in Vancouver (with hubs like Toronto), scaling quicker than ever. We value people who own their domain, act boldly, stay curious and thrive in a collaborative, high-performance environment.

Explore More

• Klue Blog

• Ignition Acquisition (2025)

• Acquisition (2025)

• Win-Loss Acquisition (2023)

• Series A (2020)

• Series B (2021)

• Culture, culture, culture

• Customer Stories

• Glassdoor

• About Us

• Instagram

• LinkedIn

• Wellfound (AngelList)

• Product Demo Arena

By submitting your application, you agree that Klue may collect your personal data for recruiting, global organization planning, and related purposes.

---