Int. Azure Platform Engineer with Databricks, Data Factory

4 weeks ago


Toronto Ontario CA, Ontario S.i. Systems Full time

Int. Azure Platform Engineer with Databricks, Data Factory & Purview experience for our insurance client


Duration: 6 Months (Extensions Likely)

Location: Hybrid (3 days in office - Toronto or London, ON)


Responsibilities:


  • Collaborate with data engineers, data scientists, and stakeholders to understand complex data requirements.
  • Assist in designing, developing, and optimizing data pipelines, architectures, and data sets, ensuring efficient data ingestion, transformation, and reliable delivery using Microsoft Azure and Informatica/IICS to support data mesh architecture.
  • Develop, automate, optimize, and fine-tune data platform provisioning, scaling, and maintenance tasks to enhance operational efficiency, performance, scalability, and cost-effectiveness.
  • Implement DevOps pipelines for code promotion.
  • Ensure data security, compliance, and governance standards are consistently met across the data platform, adhering to global data engineering standards and principles.
  • Develop foundational knowledge in data warehouse/lake solutions, data mesh architectures.
  • Creation of all infrastructure required to implement ingestion pipelines by DTS
  • ***Must be willing to perform production support outside of regularly scheduled hours***


Must Have Requirements:


  • Eligible or posses Protected - B Security Clearance
  • 5+ Years experience as Azure Platform Engineer and who is individual contributor..
  • Experience in working cloud-native systems following IaC and DataOps principles (Git repo/Jenkins/terraform, CI/CD, Orchestration, Actions)
  • Experience in working in Azure cloud following Azure Databricks, Azure Data factory and Purview etc.
  • Familiar with firewall/network rules.
  • Interest in data integration technologies, cloud platforms, and data engineering tools.



Nice to have:

  • Knowledge on Syncsort
  • Experience in the Insurance or Financial industry


Apply

  • Toronto, Ontario, Canada S.i. Systèmes Full time

    About the RoleThe ideal candidate will possess extensive experience in Azure platform engineering, specifically with Databricks, Data Factory, and Purview. This individual will be responsible for collaborating with cross-functional teams to design, develop, and optimize data pipelines, architectures, and data sets. The successful candidate will also be...


  • Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job DescriptionAzure Data Analyst - Azure Data Lake, Data Factory, DataBricks Key Responsibilities• Analyze large-scale data sets stored in Azure Data Lake using DataBricks and Azure Data Factory• Design and develop data integration pipelines using Azure Data Factory, DataBricks, and Python• Collaborate with cross-functional teams to identify business...

  • Azure Data Engineer

    3 weeks ago


    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    About the RoleAstra North Infoteck Inc. is seeking a highly skilled Azure Data Analyst to lead our big data initiatives and drive business growth through data-driven insights. As a key member of our team, you will be responsible for designing, implementing, and maintaining large-scale data solutions on Azure Data Lake, Azure Data Factory, and DataBricks...


  • Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Azure Databricks Role OverviewAstra North Infoteck Inc. is seeking an experienced Azure Databricks Architect to help us design and implement data processing pipelines. The successful candidate will have extensive experience with Azure Data Factory, Databricks, and Pyspark based data processing.Key ResponsibilitiesDesign and implement data processing...

  • Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Lyons Consulting Group Full time

    Job Title: Senior Software EngineerAbout the Role:We are seeking a highly skilled Senior Software Engineer to join our team at Lyons Consulting Group. As a Senior Software Engineer, you will be responsible for designing and implementing efficient ETL or ELT pipelines to move data between systems, ensuring data quality and consistency through cleansing,...


  • Toronto, Ontario, Canada Guidepoint Full time

    Guidepoint is seeking a highly skilled Databricks Platform Engineer to join our Toronto-based Data/AI team. As a key member of our engineering team, you will play a crucial role in designing and implementing cloud solutions, building MLOps on cloud (Azure and Databricks), and providing infrastructure guidance on Databricks capabilities to accommodate...


  • Toronto, Ontario, Canada Guidepoint Full time

    Guidepoint is seeking a highly skilled Databricks Platform Engineer to join its Toronto-based Data/AI team. As a key member of the team, you will be responsible for designing and implementing cloud solutions, building MLOps on cloud (Azure and Databricks), and providing infrastructure guidance on Databricks capabilities to accommodate business/technical use...

  • Azure Data Engineer

    3 weeks ago


    Toronto, Ontario, Ontario, Canada Procom Full time

    The role: In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data refresh performance.The role encompasses ownership (both execution and management)...

  • Senior Data Engineer

    2 weeks ago


    Toronto, Ontario, Canada Foilcon Full time

    Job Summary:FoIICON is seeking a highly skilled Senior Data Engineer to join our team. As an experienced professional in designing and implementing data ingestion frameworks, you will play a key role in shaping the future of our organization.About the Role:We are looking for a talented individual with expertise in Azure-based data engineering solutions. The...

  • Azure Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Capgemini Full time

    Job Title: Azure Data Engineer - Cloud ArchitectAbout the Role:We are seeking an experienced Azure Data Engineer to join our team at Capgemini. As a key member of our cloud data solutions team, you will be responsible for designing and implementing scalable and secure data processing pipelines using Azure Data Factory, Azure Databricks, and other Azure...


  • Toronto, Ontario, Canada Lyons Consulting Group Full time

    Job OverviewLyons Consulting Group seeks a highly skilled Data Engineering Expert to lead the development of scalable and efficient Azure data solutions. As part of our team, you will work on designing and implementing complex data pipelines, ensuring seamless integration with various data sources and platforms.About the RoleWe are looking for an experienced...


  • Toronto, Ontario, Canada OMERS Full time

    We are a purpose-driven, dynamic and sustainable pension plan, embodying the values of our 600,000+ members.An industry leading global investor with teams in various cities across North America and Europe.Join us to accelerate your growth & development, prioritize wellness, build connections, support the communities we live and work.Don't just work anywhere...


  • Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Astra North Infoteck Inc. is seeking a seasoned Azure Cloud Data Architect to spearhead its data engineering initiative. The ideal candidate will have a strong background in designing and implementing scalable data architectures on Azure.Key Responsibilities:Develop and maintain data pipelines using Azure Data Factory and DatabricksDesign and implement data...


  • Toronto, Ontario, Canada Maarut Inc Full time

    Job SummaryWe are seeking a highly skilled Senior Software Developer to join our team at Maarut Inc. as an Azure Databricks Expert. The successful candidate will be responsible for designing, developing, and maintaining business intelligence and reporting solutions using Microsoft Azure data analytics tools.Key ResponsibilitiesDesign and develop BI...


  • Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    We are seeking an experienced Enterprise Data Analyst to join our team at Astra North Infoteck Inc. as an Azure Data Engineer. The successful candidate will have 6-8 years of experience in data analytics and data integration, with a strong understanding of agile methodologies.About the RoleThis is a challenging and rewarding opportunity for an individual who...


  • Toronto, Ontario, Canada Capgemini Full time

    Data Engineer Role OverviewAs a Senior Azure Data Engineer at Capgemini, you will play a key role in developing and implementing data pipelines using Azure Synapse, Databricks, and SQL data warehouse. Your focus will be on ensuring data quality and consistency through cleansing, validation, and standardization processes.Key Responsibilities:Design and...

  • Senior Data Engineer

    3 weeks ago


    Toronto, Ontario, Canada Rubicon Path Full time

    As a Senior Data Engineer at Rubicon Path, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Databricks and Python. Your expertise in ETL tools, such as Microsoft SSIS, and strong knowledge of Delta Lake for data management and optimization, will be crucial in ensuring the efficient transformation and...

  • Senior Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada OMERS Full time

    Empower Your ImpactAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. As a key member of our team, you'll design, develop, and maintain scalable data pipelines and systems, ensuring high performance and reliability.Responsibilities:Design and implement data products, collaborating with cross-functional teams to...

  • Senior Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada OMERS Full time

    Accelerate Your Growth & DevelopmentAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. As a key member of our team, you'll design, develop, and maintain scalable data pipelines and systems, ensuring high performance and reliability.Responsibilities:Design and implement data products, collaborating with...


  • Toronto, Ontario, Canada OMERS Full time

    Accelerate Your CareerAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. We're a purpose-driven, dynamic, and sustainable pension plan, with a global presence and a commitment to innovation. Our ideal candidate will have over 8 years of experience working with data warehouses and modern data platforms, with a strong...