Senior Lakehouse Ai Platform Engineer

1 day ago

Toronto ON, Toronto Census Division, ON; Ontario, Canada Recruiting in Motion Full-time

Engineer enterprise Lakehouse and AI foundations in Azure Databricks across the Greater Toronto Area, with a hybrid four-day onsite schedule.

As a Senior Data Engineer, you will enable production AI pipelines alongside enterprise data architecture. Your work spans RAG, vector search, LLM integrations, custom MCP servers, and Medallion layers. You will connect technical delivery with business analytics and AI use cases.

Key Responsibilities:
  • Build RAG pipelines with document ingestion and embeddings
  • Index enterprise data for vector search and retrieval
  • Develop MCP servers and secure LLM API integrations
  • Expose Lakehouse data to AI agents and applications
  • Bridge data engineering with business analytics and AI uses
Requirements:
  • Production Azure Databricks Lakehouse delivery experience
  • Advanced Python, PySpark, Spark SQL, and Delta Lake skills
  • Experience developing production RAG workflows and vector search
  • Hands-on MCP server or enterprise AI integration experience
  • Confident communication with stakeholders and executive leadership

Bring senior data engineering depth to RAG, vector search, LLM integrations, MCP servers, and Azure Databricks architecture.

#J-18808-Ljbffr