Data Engineer with Pyspark and Azure Expertise

1 month ago


Toronto, Ontario, Canada Purple Drive Full time

Data Engineer with Pyspark and Azure Expertise

About the Role

We are seeking a highly skilled Data Engineer with expertise in Pyspark and Azure to join our team at Purple Drive.

Key Responsibilities

  • Design and develop data pipelines using Pyspark and Azure services
  • Collaborate with business stakeholders to understand data requirements and deliver data solutions
  • Ensure data quality and integrity across various data processing layers

Requirements

  • 8 years of experience in Data Engineering with a strong background in Pyspark
  • Hands-on experience in Azure data services, including Databricks, Synapse Analytics, and Informatica
  • Ability to coordinate independently with business stakeholders and understand business requirements

  • Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Foilcon Full time

    Job DescriptionFoIalcon is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing data ingestion frameworks from Oracle sources to Azure Data Lake, including initial load and incremental ETL. You will work with various tools such as Oracle Golden Gate, Azure Data...

  • Azure Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Capgemini Full time

    Job Title: Azure Data Engineer - Cloud ArchitectAbout the Role:We are seeking an experienced Azure Data Engineer to join our team at Capgemini. As a key member of our cloud data solutions team, you will be responsible for designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure...


  • Toronto, Ontario, Canada Purple Drive Full time

    Data Engineer RoleData Engineer with Pyspark Databricks skillset required.RequirementsStrong background in Azure data services including Databricks Synapse Analytics Informatica Pyspark and SQL.Ability to extract and transform data especially unstructured data across various data processing layers using Databricks Python.Coordinate independently with...


  • Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Astra North Infoteck Inc. is seeking a seasoned Azure Cloud Data Architect to spearhead its data engineering initiative. The ideal candidate will have a strong background in designing and implementing scalable data architectures on Azure.Key Responsibilities:Develop and maintain data pipelines using Azure Data Factory and DatabricksDesign and implement data...

  • Senior Data Engineer

    2 weeks ago


    Toronto, Ontario, Canada Rubicon Path Full time

    As a Senior Data Engineer at Rubicon Path, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Databricks and Python. Your expertise in ETL tools, such as Microsoft SSIS, and strong knowledge of Delta Lake for data management and optimization, will be crucial in ensuring the efficient transformation and...


  • Toronto, Ontario, Canada Highbrow LLC Full time

    Highbrow LLC is seeking a highly skilled Senior Data Scientist and Engineer Lead to join our team. This role will be responsible for leading the development of data science and data engineering initiatives across the organization.Job OverviewThe ideal candidate will have 2-5 years of experience in working with technologies such as PySpark, SQL, Databricks,...


  • Toronto, Ontario, Canada Foilcon Full time

    Job Summary:FoIICON is seeking a highly skilled Senior Data Engineer to join our team. As an experienced professional in designing and implementing data ingestion frameworks, you will play a key role in shaping the future of our organization.About the Role:We are looking for a talented individual with expertise in Azure-based data engineering solutions. The...


  • Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Azure Databricks Role OverviewAstra North Infoteck Inc. is seeking an experienced Azure Databricks Architect to help us design and implement data processing pipelines. The successful candidate will have extensive experience with Azure Data Factory, Databricks, and Pyspark based data processing.Key ResponsibilitiesDesign and implement data processing...


  • Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job OverviewRoyal Bank of Canada is seeking an experienced Data Engineer to join our US Cash Management Technology team.Salary and BenefitsThe estimated salary for this role is $120,000 - $180,000 per year, depending on experience. In addition to a competitive salary, we offer a comprehensive benefits package that includes medical, dental, and vision...


  • Toronto, Ontario, Canada OMERS Full time

    Accelerate Your CareerAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. We're a purpose-driven, dynamic, and sustainable pension plan, with a global presence and a commitment to innovation. Our ideal candidate will have over 8 years of experience working with data warehouses and modern data platforms, with a strong...


  • Toronto, Ontario, Canada Highbrow LLC Full time

    Job Responsibilities:Contribute to the development of Data Science and Data Engineering initiativesRequired Skills and Experience:2-5 years of experience in the following:PySparkSQLDatabricksPythonAzure Cloud expertiseDesired Skills:Data Management and Data Warehouse knowledgeTechnical writing experienceData Governance SkillsJIRA and Agile...


  • Toronto, Ontario, Canada Lyons Consulting Group Full time

    Job OverviewWe are seeking an experienced Data Engineer to join our team at Lyons Consulting Group. This role will be responsible for designing, developing, and implementing data pipelines using Azure technologies.

  • Data Engineer

    1 month ago


    Toronto, Ontario, Canada Lyons Consulting Group Full time

    Job Title: Data Engineer - ArchitectJob Summary:We are seeking a highly skilled Data Engineer - Architect to join our team at Lyons Consulting Group. As a Data Engineer - Architect, you will be responsible for designing and implementing ETL processes to ingest data from various sources into Unity Catalog. You will also use notebooks to write code in PySpark,...

  • Senior Data Engineer

    2 weeks ago


    Toronto, Ontario, Canada OMERS Full time

    Empower Your ImpactAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. As a key member of our collaborative development environment, you'll design, develop, and maintain scalable data pipelines and systems, ensuring high performance and reliability.Responsibilities:Implement and optimize data products for our global...

  • Azure Data Engineer

    3 weeks ago


    Toronto, Ontario, Ontario, Canada Procom Full time

    The role: In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data refresh performance.The role encompasses ownership (both execution and management)...


  • Old Toronto, Ontario, Canada NTT DATA Services Full time

    Job Title: Azure Cloud Operations EngineerNTT DATA is seeking a highly skilled Azure Cloud Operations Engineer to join our team in Canada. As a key member of our cloud operations team, you will be responsible for ensuring the smooth operation of our Azure cloud infrastructure.Key Responsibilities:Establish and maintain proactive monitoring for Azure...

  • Senior Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada OMERS Full time

    Accelerate Your Growth & DevelopmentAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. As a key member of our team, you'll design, develop, and maintain scalable data pipelines and systems, ensuring high performance and reliability.Responsibilities:Design and implement data products, collaborating with...

  • Senior Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada OMERS Full time

    Empower Your ImpactAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. As a key member of our team, you'll design, develop, and maintain scalable data pipelines and systems, ensuring high performance and reliability.Responsibilities:Design and implement data products, collaborating with cross-functional teams to...

  • Senior Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada OMERS Full time

    Empower Your ImpactAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. As a key member of our team, you'll design, develop, and maintain scalable data pipelines and systems, ensuring high performance and reliability.Responsibilities:Design and implement data products, collaborating with cross-functional teams to...

  • Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Highbrow LLC Full time

    Job Summary:Highbrow LLC is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems.Key Responsibilities:Develop and implement data pipelines using PySpark, SQL, and Databricks.Design and maintain data warehouses using Python and Azure...