Databricks and Azure Expert

7 days ago


Toronto, Ontario, Canada Eviden Full time
Responsibilities

- Performance Optimization: Lead the performance tuning and optimization of Azure-based data pipelines, specifically addressing the current bottleneck where processing 1000 records takes 40 minutes.
- Architecture Review and Redesign: Evaluate the existing Azure data platform architecture, identify bottlenecks and design flaws, and propose and implement solutions for a more efficient and scalable system.
- Databricks Expertise: Utilize your advanced PySpark skills, particularly with structured streaming, to re-engineer data transformation and processing logic within Databricks.
- Data Integration: Work with Azure Data Lake Storage (ADLS), Azure Data Factory (ADF), Azure Database (DB), and file exchange processes (batch mode) to ensure seamless data flow and integration.

  • Toronto, Ontario, Canada Themesoft Inc. Full time

    About the RoleWe are seeking an experienced Azure Databricks Expert to join our team at Themesoft Inc. As a key member of our organization, you will be responsible for overseeing the development and implementation of data models using Azure Databricks.Key Responsibilities:Lead the analysis and interpretation of complex data to support business...


  • Toronto, Ontario, Canada Apex Systems Full time

    Databricks Developer (Azure) Client: Big 5 Bank Location: Downtown Toronto Hybrid: Every Thursday and 1 Friday of the month (1-2 days a week) Terms: 6 month contract to hire (conversion to FTE) FTE Package: Upon conversion – FTE Salary, Bonus, Health Benefits, Perks & more Hours/week: 37.5 hours/week Start date: February/March 2025 Job Summary ...


  • Toronto, Ontario, Canada Apex Systems Full time

    Databricks Developer (Azure)Client: Big 5 BankLocation: Downtown TorontoHybrid: Every Thursday and 1 Friday of the month (1-2 days a week)Terms: 6 month contract to hire (conversion to FTE)FTE Package: Upon conversion – FTE Salary, Bonus, Health Benefits, Perks & moreHours/week: 37.5 hours/week Start date: February/March 2025Job SummaryWe are seeking a...


  • Toronto, Ontario, Canada Apex Systems Full time

    Professional Technical Recruiter at Apex Systems - Specializing in PMOLocation: Downtown TorontoHybrid: Every Thursday and 1 Friday of the month (1-2 days a week)Terms: 6 month contract to hire (conversion to FTE)Hours/week: 37.5 hours/weekJob Summary:We are seeking a skilled Databricks Developer to design, develop, and implement advanced data solutions...


  • Toronto, Ontario, Canada Apex Systems Full time

    We are looking for a talented Azure Databricks Solutions Architect who can design and implement scalable data pipelines and ETL processes using Databricks.Collaboration with BA/SME, analysts, and stakeholders is crucial to implement DW models and prepare the data for advanced analytics.The successful candidate will have hands-on experience with cloud...


  • Toronto, Ontario, Canada Databricks Inc. Full time

    Succeed in a Fast-Paced Sales Environment\Databricks is seeking a highly motivated and results-driven sales professional to join our team as an Enterprise Account Executive, Public Sector. As a key member of our sales team, you will be responsible for identifying and closing new business opportunities within the public sector market while also growing...

  • Databricks Expert

    16 hours ago


    Toronto, Ontario, Canada Tactable Full time

    Senior Data Engineer PositionTactable is looking for an experienced Senior Data Engineer with strong expertise in Databricks. As a key member of our data team, you will design and maintain scalable ETL/ELT pipelines, integrate data from various sources, and optimize Databricks workloads for cost efficiency and performance.This role requires collaboration...

  • Databrick Admin

    3 weeks ago


    Toronto, Ontario, Canada Galent Full time

     Expert in Databricks Administration.  Strong Databricks troubleshooting experience.  Good Knowledge of Databricks Unity Catalog.  Strong understanding of GCP core foundation, Azure DevOps, Terraform for Cloud, Git, REST API.  Strong knowledge of HCL, YAML, and JSON formats.  Understanding of data structures and algorithms.  Programming...


  • Toronto, Ontario, Canada Tundra Technical Solutions Full time

    Job OverviewTundra Technical Solutions is seeking an experienced Power BI Developer with a strong background in Azure Databricks to join our data analytics team. This role is integral to designing and developing visually compelling, data-driven solutions that empower data-informed decision-making across the organization.Key ResponsibilitiesDashboard...

  • Databricks Developer

    2 weeks ago


    Toronto, Ontario, Canada Apex Systems Full time

    Databricks Developer (Azure) Client: Big 5 Bank Location: Downtown Toronto Hybrid: Every Thursday and 1 Friday of the month (1-2 days a week) Terms: 6-month contract to hire (conversion to FTE) FTE Package: Upon conversion – FTE Salary, Bonus, Health Benefits, Perks & more Hours/week: 37.5 hours/week Start date: February/March 2025...

  • Azure Data Engineer

    1 week ago


    Toronto, Ontario, Canada Eviden Full time

    Role : Azure Data Engineer (Databricks Expert)Location : Toronto, ONHire Type : Full-Time with EvidenJob Description:About the Role:We are seeking a highly skilled and experienced Senior Azure Data Engineer to join team and tackle critical performance challenges within Azure data platform. You will play a pivotal role in optimizing and re-architecting key...


  • Toronto, Ontario, Canada Maarut Inc Full time

    About the PositionWe're looking for a Big Data Specialist to join our team at Maarut Inc. As a Big Data Specialist, you'll be responsible for designing, developing, and maintaining complex ETL processes in Azure Databricks for data warehousing, data lakes, and analytics.Key ResponsibilitiesDevelop high-quality ETL mappings/scripts/notebooks using Python and...

  • Databricks Engineer

    4 weeks ago


    Toronto, Ontario, Canada Presto Recruiting Solutions Full time

    With our client, you will work at the forefront of data innovation, collaborating with top-tier teams and stakeholders to craft solutions that drive real-world impact. With a focus on modern tools like Databricks, Unity Catalog, and Azure Cloud, you'll have the opportunity to shape the future of our data infrastructure. What You'll Do: Build Next-Level...

  • Databricks Engineer

    7 days ago


    Toronto, Ontario, Canada Cognizant Full time

    We are seeking an experienced Databricks Support Lead to join our team at Cognizant. The ideal candidate will have expertise in Spark in Scala, Kafka, Azure DevOps, Python, Databricks SQL, and Databricks Workflows.About the Role:Design and implement scalable data processing solutions using Spark in Scala and PySpark.Support existing code base across various...

  • Databricks Engineer

    1 week ago


    Toronto, Ontario, Canada Nous Infosystems Full time

    Skilled Databricks Engineer with expertise in Python and PySpark to design, develop, and optimize data pipelines and workflows. Experience working with Apache Spark, ETL processes, and big data architectures in an Azure environment.Key Responsibilities:Develop and maintain scalable data pipelines using Databricks, PySpark, and PythonWork with structured and...

  • Databricks Engineer

    4 weeks ago


    Greater Toronto Area, Canada, Ontario Presto Recruiting Solutions Full time

    With our client, you will work at the forefront of data innovation, collaborating with top-tier teams and stakeholders to craft solutions that drive real-world impact. With a focus on modern tools like Databricks, Unity Catalog, and Azure Cloud, you’ll have the opportunity to shape the future of our data infrastructure.What You’ll Do:Build Next-Level...


  • Toronto, Ontario, Canada Themesoft Inc. Full time

    **Job Description**Lead the analysis and interpretation of complex data to support business objectives.Oversee the development and implementation of data models using Azure Databricks.Provide expertise in Databricks SQL to optimize data queries and enhance data processing efficiency.Our ideal candidate will have a strong background in data engineering, with...

  • Databricks Engineer

    1 week ago


    Toronto, Ontario, Canada ShyftLabs Full time

    ShyftLabs is seeking a skilled Databricks Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to drive data-driven...

  • Databricks Engineer

    3 days ago


    Toronto, Ontario, Canada Shyftlabs Full time

    Position Overview:ShyftLabs is seeking a skilled Databricks Engineer to support in designing, developing, and optimizing big data solutions using the Databricks Unified Analytics Platform. This role requires strong expertise in Apache Spark, SQL, Python, and cloud platforms (AWS/Azure/GCP). The ideal candidate will collaborate with cross-functional teams to...


  • Toronto, Ontario, Canada Tredence Inc. Full time

    QualificationsTo be considered for this role, please have:Bachelor's or master's degree in computer science, Data Engineering, or a related field.10+ years of experience in big data engineering, architecture, or related field.Strong expertise in Databricks, Spark, and big data technologies.Hands-on experience with cloud platforms (AWS, Azure, or Google...