Databricks Architect

4 days ago

Brampton, Peel Region, Canada KData Inc. Full-time $130,000 - $190,000 Contract

We are seeking aDatabricks Architectto lead the vision, design, and execution of large-scale, enterprise-grade Databricks Lakehouse architectures across multi-cloud and hybrid environments. In this role, you will advise executive leadership (CIOs/CTOs), drive pre-sales and technical solution design, and lead hands-on architecture for modern data and GenAI platforms.

The ideal candidate brings 12+ years of technology experience, combining deep technical expertise in Databricks, multi-cloud strategy (AWS, Azure, GCP), TOGAF governance, data virtualization, and hands-on experience guiding enterprise modernization initiatives.

Key Responsibilities

  • Lead architectural design and hands-on technical oversight forDatabricks Lakehouse, Delta Lake, streaming pipelines, and AI-ready platforms.
  • Define enterprise infrastructure reference architectures spanning cloud networking, compute, storage, security, observability, platform resiliency, disaster recovery, and compliance.
  • Build end-to-end multi-cloud data integration layers and dynamic pipelines connecting legacy systems, cloud data lakes, and modern AI/ML frameworks.
  • Establish governance models, architecture guiding principles, and standard frameworks (e.g., TOGAF) for enterprise platforms.
  • Drive data virtualization and semantic layer strategies to streamline business intelligence and self-service analytics.
  • Serve as a trusted advisor to C-suite executives and CIOs on cloud modernization, data platform resiliency, cost optimization, and AI-enabled operational transformations.
  • Partner with Sales and Account teams on pre-sales activities, RFP responses, solution design, and high-value deal shaping.
  • Conduct discovery workshops, present technical blueprints (SAD, DDD), and defend technical solutions to enterprise clients.
  • Architect solutions incorporating Generative AI, automated document parsing/reformatting pipelines, advanced analytics, and machine learning models within the Databricks ecosystem.
  • Oversee migrations from legacy databases/Big Data infrastructure (Hadoop, Oracle, Cloudera, Netezza) to modern cloud-native Lakehouses (AWS, Azure, GCP) using structured acceleration frameworks (e.g., AWS MAP).
  • Establish robust security controls, encryption protocols, enterprise authentication mechanisms (Unity Catalog, Kerberos), and performance tuning for high-throughput environments.

Requirements

Required Qualifications & Experience

  • Experience:12+ years of technology experience in Enterprise Infrastructure, Data Engineering, Multi-Cloud Architecture, and AI Strategy.
  • Databricks Expertise:Strong hands-on architectural experience with Databricks Lakehouse, Delta Lake, Spark, Unity Catalog, and AI/ML integrations.
  • Multi-Cloud Expertise:Proven track record architecting and deploying solutions across AWS, Azure, and GCP platforms.
  • Legacy Modernization:Solid background transitioning traditional database/Hadoop environments (Oracle RAC/ASM, Cloudera/Hortonworks, Netezza, HBase) into cloud-native architectures.
  • Domain Exposure:Architecture experience supporting industries such asHealthcare, Insurance & Risk, Banking & Finance, Media, Retail, or Life Sciences.

Technical Stack & Skills

  • Observability, Operations & Tools:Grafana, SumoLogic, Git/GitStash, Jira, Bamboo, DB Visualizer.
  • Languages & Scripting:Python, SQL, PL/SQL, Unix Shell Scripting, Perl Scripting.

Education

  • Master’s or Bachelor’s degree in Business Administration, Computer Science, Software Engineering, or a related technical discipline.