Current jobs related to Databricks Pipeline Architect - Toronto, Ontario - LanceSoft

  • Cloud Architect

    5 days ago

    Toronto, Ontario, Canada Lumenalta Full time

    Lumenalta helps enterprise clients build cutting-edge digital products. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance solutions to tackle the most demanding data challenges.You will have the opportunity to drive end-to-end architecture and help our clients unlock the full potential of their...

  • Azure Databricks Solutions Architect

    3 days ago

    Toronto, Ontario, Canada Apex Systems Full time

    We are looking for a talented Azure Databricks Solutions Architect who can design and implement scalable data pipelines and ETL processes using Databricks.Collaboration with BA/SME, analysts, and stakeholders is crucial to implement DW models and prepare the data for advanced analytics.The successful candidate will have hands-on experience with cloud...

  • Databricks ETL Specialist

    5 days ago

    Toronto, Ontario, Canada CG Consulting Group Full time

    About the Job:We are looking for a highly skilled Data Architect Developer to lead data integration projects at CG Consulting Group. As a key member of our team, you will be responsible for designing and implementing data architectures that meet client requirements.Analyzing business requirements to identify data integration needs.Designing and developing...

  • Data Architect

    6 days ago

    Toronto, Ontario, Canada Tredence Inc. Full time

    Databricks ArchitectJob SummaryWe are seeking a highly skilled Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in cloud-based data engineering, big data processing, and analytics, and a strong understanding of data architecture principles. You will play a pivotal...

  • Solutions Architect

    5 days ago

    Toronto, Ontario, Canada Lumenalta Full time

    Join to apply for the Solutions Architect - Databricks role at LumenaltaAt Lumenalta, we partner with enterprise clients to build cutting-edge digital products that interact with hundreds of millions of customers, transactions, and data points. As a Databricks Solutions Architect, you will be pivotal in designing and implementing scalable, high-performance...

  • Databricks Engineer

    4 weeks ago

    Toronto, Ontario, Canada Presto Recruiting Solutions Full time

    With our client, you will work at the forefront of data innovation, collaborating with top-tier teams and stakeholders to craft solutions that drive real-world impact. With a focus on modern tools like Databricks, Unity Catalog, and Azure Cloud, you'll have the opportunity to shape the future of our data infrastructure. What You'll Do: Build Next-Level...

  • Databricks Developer

    2 weeks ago

    Toronto, Ontario, Canada Apex Systems Full time

    Databricks Developer (Azure) Client: Big 5 Bank Location: Downtown Toronto Hybrid: Every Thursday and 1 Friday of the month (1-2 days a week) Terms: 6-month contract to hire (conversion to FTE) FTE Package: Upon conversion – FTE Salary, Bonus, Health Benefits, Perks & more Hours/week: 37.5 hours/week Start date: February/March 2025...

  • Databricks Expert

    16 hours ago

    Toronto, Ontario, Canada Tactable Full time

    Senior Data Engineer PositionTactable is looking for an experienced Senior Data Engineer with strong expertise in Databricks. As a key member of our data team, you will design and maintain scalable ETL/ELT pipelines, integrate data from various sources, and optimize Databricks workloads for cost efficiency and performance.This role requires collaboration...

  • Databricks Engineer

    1 week ago

    Toronto, Ontario, Canada ShyftLabs Full time

    ShyftLabs is seeking a skilled Databricks Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to drive data-driven...

  • Databricks Engineer

    3 days ago

    Toronto, Ontario, Canada Shyftlabs Full time

    Position Overview:ShyftLabs is seeking a skilled Databricks Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to...

  • ETL Data Architect

    3 days ago

    Toronto, Ontario, Canada Maarut Inc Full time

    Job SummaryMaarut Inc is seeking an experienced ETL Data Architect to design, develop, and maintain ETL processes in Azure Databricks for data warehousing, data lakes, and analytics. The ideal candidate will have 7+ years of experience with ETL tools, strong knowledge of Delta Lake, and familiarity with Databricks Workflows.Key ResponsibilitiesDesign,...

  • Data Architect ETL Specialist

    5 days ago

    Toronto, Ontario, Canada Maarut Inc Full time

    Job DescriptionMaart Inc is seeking a highly skilled Data Architect ETL Specialist to join our team. As an ETL Specialist, you will be responsible for designing, developing, and maintaining data architecture and integration solutions. Your primary focus will be on data warehousing, data lakes, and analytics using Databricks.Key Responsibilities:Design,...

  • Databricks Analytics Expert

    3 days ago

    Toronto, Ontario, Canada Shyftlabs Full time

    Designing Big Data Solutions">As a Databricks Engineer at ShyftLabs, you will be responsible for designing, implementing, and optimizing big data pipelines in Databricks.">You will develop scalable ETL workflows to process large datasets and leverage Apache Spark for distributed data processing and real-time analytics.">Additionally, you will implement data...

  • Databricks Engineer

    1 week ago

    Toronto, Ontario, Canada Nous Infosystems Full time

    Skilled Databricks Engineer with expertise in Python and PySpark to design, develop, and optimize data pipelines and workflows. Experience working with Apache Spark, ETL processes, and big data architectures in an Azure environment.Key Responsibilities:Develop and maintain scalable data pipelines using Databricks, PySpark, and PythonWork with structured and...

  • Cloud Data Architect

    5 days ago

    Toronto, Ontario, Canada Apex Systems Full time

    Job DescriptionThe Cloud Data Architect will be responsible for designing, developing, and implementing advanced data solutions using Databricks. This role requires strong technical skills, including expertise in ETL technologies, data pipelines, and cloud environments to support data-driven decision-making processes.Key Responsibilities:Designing,...

  • Databricks Engineer

    4 weeks ago

    Greater Toronto Area, Canada, Ontario Presto Recruiting Solutions Full time

    With our client, you will work at the forefront of data innovation, collaborating with top-tier teams and stakeholders to craft solutions that drive real-world impact. With a focus on modern tools like Databricks, Unity Catalog, and Azure Cloud, you’ll have the opportunity to shape the future of our data infrastructure.What You’ll Do:Build Next-Level...

  • Databrick Admin

    3 weeks ago

    Toronto, Ontario, Canada Galent Full time

     Expert in Databricks Administration.  Strong Databricks troubleshooting experience.  Good Knowledge of Databricks Unity Catalog.  Strong understanding of GCP core foundation, Azure DevOps, Terraform for Cloud, Git, REST API.  Strong knowledge of HCL, YAML, and JSON formats.  Understanding of data structures and algorithms.  Programming...

  • Azure Databricks Developer

    3 days ago

    Toronto, Ontario, Canada Apex Systems Full time

    Professional Technical Recruiter at Apex Systems - Specializing in PMOLocation: Downtown TorontoHybrid: Every Thursday and 1 Friday of the month (1-2 days a week)Terms: 6 month contract to hire (conversion to FTE)Hours/week: 37.5 hours/weekJob Summary:We are seeking a skilled Databricks Developer to design, develop, and implement advanced data solutions...

  • Databricks Engineer

    7 days ago

    Toronto, Ontario, Canada Cognizant Full time

    We are seeking an experienced Databricks Support Lead to join our team at Cognizant. The ideal candidate will have expertise in Spark in Scala, Kafka, Azure DevOps, Python, Databricks SQL, and Databricks Workflows.About the Role:Design and implement scalable data processing solutions using Spark in Scala and PySpark.Support existing code base across various...

  • Databricks Data Lead

    5 days ago

    Toronto, Ontario, Canada Whopper Technologies Full time

    Title: Databricks Data Lead /Architect, Data Governance Location: Remote- anywhere in Canada but must be able to work PST hours Duration: 12+months Interview Process: 3 rounds Note: Really needing someone who has strong skills in Data Bricks, SQL; and has Ecommerce experience. Must Haves:The Data Architect is responsible for designing the overall...

Databricks Pipeline Architect

1 week ago

Toronto, Ontario, Canada LanceSoft Full time

LanceSoft is committed to delivering exceptional results through innovative solutions and cutting-edge technology. We're now seeking a highly skilled Databricks Pipeline Architect to lead our data engineering efforts and drive business growth through efficient data management.

The ideal candidate will have extensive experience in designing and implementing efficient ETL pipelines using Databricks. They should possess a deep understanding of Delta Lake for building data lakes and managing ACID transactions, schema evolution, and data versioning.

You'll be responsible for automating ETL pipelines using Delta Live Tables, including handling Change Data Capture (CDC) for incremental data loads. Your expertise in structuring data pipelines with the Medallion Architecture to scale data pipelines and ensure data quality is also essential.

We're looking for someone with hands-on experience developing streaming tables in Databricks using Structured Streaming and readStream to handle real-time data. Additionally, your expertise in integrating CDC tools like GoldenGate or Debezium for processing incremental updates and managing real-time data ingestion is a must-have.

You'll work closely with our cross-functional teams to design and implement robust data governance policies using Unity Catalog. Strong analytical skills for troubleshooting, problem-solving, and ensuring data quality are also essential.

To succeed in this role, you'll need to communicate complex technical concepts effectively to non-technical stakeholders and collaborate with cross-functional teams to achieve project goals. In terms of qualifications, we're looking for candidates with at least 7 years of experience using ETL tools such as Microsoft SSIS, stored procedures, T-SQL, and 2+ years of experience with Delta Lake, Databricks, and Azure Databricks pipelines.