Databricks Engineer

7 days ago


Toronto, Ontario, Canada Cognizant Full time

We are seeking an experienced Databricks Support Lead to join our team at Cognizant. The ideal candidate will have expertise in Spark in Scala, Kafka, Azure DevOps, Python, Databricks SQL, and Databricks Workflows.

About the Role:
  • Design and implement scalable data processing solutions using Spark in Scala and PySpark.
  • Support existing code base across various environments.
  • Provide L2/L3 support of the applications and on-call support as applicable.

Main Responsibilities:

  • Develop and maintain Kafka-based data pipelines to ensure real-time data processing.
  • Use Azure DevOps for continuous integration and deployment (CI/CD) processes.
  • Create and manage Databricks SQL queries to extract and analyze data.

Requirements:

  • Must have 5+ years of strong experience in Spark in Scala and PySpark.
  • Must have 6+ years of hands-on experience in Python programming.
  • Must have hands-on experience with Kafka and Azure DevOps.

What Will Help You Stand Out:

  • Nice to have experience in the Property & Casualty Insurance domain.
  • Experience using support ticket systems like Jira or ServiceNow
  • Basic networking knowledge (TCP/IP, DNS, etc.)

  • Databricks Engineer

    1 week ago


    Toronto, Ontario, Canada ShyftLabs Full time

    ShyftLabs is seeking a skilled Databricks Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to drive data-driven...

  • Databricks Engineer

    3 days ago


    Toronto, Ontario, Canada Shyftlabs Full time

    Position Overview:ShyftLabs is seeking a skilled Databricks Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to...

  • Databricks Engineer

    4 weeks ago


    Toronto, Ontario, Canada Presto Recruiting Solutions Full time

    With our client, you will work at the forefront of data innovation, collaborating with top-tier teams and stakeholders to craft solutions that drive real-world impact. With a focus on modern tools like Databricks, Unity Catalog, and Azure Cloud, you'll have the opportunity to shape the future of our data infrastructure. What You'll Do: Build Next-Level...

  • Databricks Engineer

    1 week ago


    Toronto, Ontario, Canada Nous Infosystems Full time

    Skilled Databricks Engineer with expertise in Python and PySpark to design, develop, and optimize data pipelines and workflows. Experience working with Apache Spark, ETL processes, and big data architectures in an Azure environment.Key Responsibilities:Develop and maintain scalable data pipelines using Databricks, PySpark, and PythonWork with structured and...

  • Databricks Engineer

    4 weeks ago


    Greater Toronto Area, Canada, Ontario Presto Recruiting Solutions Full time

    With our client, you will work at the forefront of data innovation, collaborating with top-tier teams and stakeholders to craft solutions that drive real-world impact. With a focus on modern tools like Databricks, Unity Catalog, and Azure Cloud, you’ll have the opportunity to shape the future of our data infrastructure.What You’ll Do:Build Next-Level...


  • Toronto, Ontario, Canada Themesoft Inc. Full time

    **Job Description**Lead the analysis and interpretation of complex data to support business objectives.Oversee the development and implementation of data models using Azure Databricks.Provide expertise in Databricks SQL to optimize data queries and enhance data processing efficiency.Our ideal candidate will have a strong background in data engineering, with...


  • Toronto, Ontario, Canada Creative Solutions Services, LLC Full time

    Role: Databricks Engineer with Python, PySpark ExperienceLocation: Canada/RemoteContractSkilled Databricks Engineer with expertise in Python and PySpark to design, develop, and optimize data pipelines and workflows. Experience working with Apache Spark, ETL processes, and big data architectures in Azure environment.Key Responsibilities:1. Develop and...

  • Databricks Expert

    16 hours ago


    Toronto, Ontario, Canada Tactable Full time

    Senior Data Engineer PositionTactable is looking for an experienced Senior Data Engineer with strong expertise in Databricks. As a key member of our data team, you will design and maintain scalable ETL/ELT pipelines, integrate data from various sources, and optimize Databricks workloads for cost efficiency and performance.This role requires collaboration...


  • Toronto, Ontario, Canada Shyftlabs Full time

    Designing Big Data Solutions">As a Databricks Engineer at ShyftLabs, you will be responsible for designing, implementing, and optimizing big data pipelines in Databricks.">You will develop scalable ETL workflows to process large datasets and leverage Apache Spark for distributed data processing and real-time analytics.">Additionally, you will implement data...


  • Toronto, Ontario, Canada Themesoft Inc. Full time

    About the RoleWe are seeking an experienced Azure Databricks Expert to join our team at Themesoft Inc. As a key member of our organization, you will be responsible for overseeing the development and implementation of data models using Azure Databricks.Key Responsibilities:Lead the analysis and interpretation of complex data to support business...

  • Databricks Developer

    2 weeks ago


    Toronto, Ontario, Canada Apex Systems Full time

    Databricks Developer (Azure) Client: Big 5 Bank Location: Downtown Toronto Hybrid: Every Thursday and 1 Friday of the month (1-2 days a week) Terms: 6-month contract to hire (conversion to FTE) FTE Package: Upon conversion – FTE Salary, Bonus, Health Benefits, Perks & more Hours/week: 37.5 hours/week Start date: February/March 2025...

  • Databricks Developer

    3 weeks ago


    Toronto, Ontario, Canada Tata Consultancy Services Full time

    Inclusion without Exception: Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our...

  • Cloud Architect

    5 days ago


    Toronto, Ontario, Canada Lumenalta Full time

    Lumenalta helps enterprise clients build cutting-edge digital products. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to tackle the most demanding data challenges.You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their...


  • Toronto, Ontario, Canada Apex Systems Full time

    Professional Technical Recruiter at Apex Systems - Specializing in PMOLocation: Downtown TorontoHybrid: Every Thursday and 1 Friday of the month (1-2 days a week)Terms: 6 month contract to hire (conversion to FTE)Hours/week: 37.5 hours/weekJob Summary:We are seeking a skilled Databricks Developer to design, develop, and implement advanced data solutions...


  • Toronto, Ontario, Canada Eviden Full time

    Responsibilities- Performance Optimization: Lead the performance tuning and optimization of Azure-based data pipelines, specifically addressing the current bottleneck where processing 1000 records takes 40 minutes.- Architecture Review and Redesign: Evaluate the existing Azure data platform architecture, identify bottlenecks and design flaws, and propose and...


  • Toronto, Ontario, Canada Apex Systems Full time

    Databricks Developer (Azure) Client: Big 5 Bank Location: Downtown Toronto Hybrid: Every Thursday and 1 Friday of the month (1-2 days a week) Terms: 6 month contract to hire (conversion to FTE) FTE Package: Upon conversion – FTE Salary, Bonus, Health Benefits, Perks & more Hours/week: 37.5 hours/week Start date: February/March 2025 Job Summary ...


  • Toronto, Ontario, Canada Apex Systems Full time

    Databricks Developer (Azure)Client: Big 5 BankLocation: Downtown TorontoHybrid: Every Thursday and 1 Friday of the month (1-2 days a week)Terms: 6 month contract to hire (conversion to FTE)FTE Package: Upon conversion – FTE Salary, Bonus, Health Benefits, Perks & moreHours/week: 37.5 hours/week Start date: February/March 2025Job SummaryWe are seeking a...


  • Toronto, Ontario, Canada S I Systems Full time

    Sr. DevOps Engineer to provision cloud infrastructure on AWS, Snowflake and Databricks resources for a major insurance clientPosition: Sr. DevOps Engineer to provision cloud infrastructure on AWS, Snowflake and Databricks resources for a major insurance clientDuration: 6 months with possible extensionLocation: Hybrid (twice a week in Toronto or Montreal)Must...


  • Toronto, Ontario, Canada Cognizant Full time

    We are seeking an experienced Databricks Support Lead with 8 to 14 years of experience to join our AIA team. The ideal candidate will have expertise in Spark in Scala, Kafka, Azure DevOps, Python, Databricks SQL, Databricks Workflows, and PySpark.In this role, you will:- Design and implement scalable data processing solutions using Spark in Scala and...


  • Toronto, Ontario, Canada Cognizant Full time

    We are seeking an experienced Databricks Support Lead with 8 to 14 years of experience to join our AIA team. The ideal candidate will have expertise in Spark in Scala, Kafka, Azure DevOps, Python, Databricks SQL, Databricks Workflows, and PySpark.In this role, you will:- Design and implement scalable data processing solutions using Spark in Scala and...