Senior Azure Data Engineer

1 week ago

Toronto, Ontario, Canada AXIS Capital Full time

This is your opportunity to join AXIS Capital – a trusted global provider of specialty lines insurance and reinsurance. We stand apart for our outstanding client service, intelligent risk taking and superior risk adjusted returns for our shareholders. We also proudly maintain an entrepreneurial, disciplined and ethical corporate culture. As a member of AXIS, you join a team that is among the best in the industry.

At AXIS, we believe that we are only as strong as our people. We strive to create an inclusive and welcoming culture where employees of all backgrounds and from all walks of life feel comfortable and empowered to be themselves. This means that we bring our whole selves to work.

All qualified applicants will receive consideration for employment without regard to race, color, religion or creed, sex, pregnancy, sexual orientation, gender identity or expression, national origin or ancestry, citizenship, physical or mental disability, age, marital status, civil union status, family or parental status, or any other characteristic protected by law. Accommodation is available upon request for candidates taking part in the selection process.

Senior Azure Data Engineer

Job Family Grouping: Chief Underwriting Officer
Job Family: Data & Analytics
Location: Halifax NS, Canada

How does this role contribute to our collective success?

The Data & Analytics department transforms raw data into actionable insights to drive informed decision-making and optimize business operations. The Senior Azure Data Engineer will support these goals by designing, implementing, and managing scalable data solutions on the Azure platform, ensuring efficient data processing, storage, and retrieval. You will play a key role in modernizing our data architecture, ensuring efficient data integration, and enabling advanced analytics to support critical business decisions. This role will enhance the department's ability to deliver high-quality analytics and maintain robust data infrastructure.

What will you do in this role?

As a Senior Azure Data Engineer, you will be responsible for designing, implementing, and maintaining data storage and processing solutions on the Azure platform. You will work with modern data warehouse (MDW) technologies, big data, and Lakehouse architectures to ensure our data solutions are secure, efficient, and optimized.

Key Responsibilities:

  • Design and implement data solutions using Azure services, including Azure Databricks, ADF, and Data Lake Storage.
  • Develop and maintain ETL/ELT pipelines to process structured and unstructured data from multiple sources. Automate loads using Databricks workflows and Jobs.
  • Develop, test and build CI/CD pipelines using Azure DevOps to automate deployment and monitoring of data solutions to all environments. Provide knowledge sharing to data operations teams on release management and maintenance.
  • Manage platform administration, ensuring optimal performance, availability, and scalability of Azure data services.
  • Implement end-to-end data pipelines, ensuring data quality, data integrity and data security.
  • Troubleshoot and resolve data pipeline issues while ensuring data integrity and quality.
  • Implement and enforce data security best practices, including role-based access control (RBAC), encryption, and compliance with industry standards.
  • Collaborate with data scientists, analysts, and business stakeholders to deliver high-quality data solutions.
  • Monitor and optimize Databricks performance, including cost management guidance and cluster tuning.
  • Stay up to date with Azure cloud innovations and recommend improvements to existing architectures.
  • Assist data analysts with technical input.

You may also be required to take on additional duties, responsibilities and activities appropriate to the nature of this role.

About You:

We encourage you to bring your own experience and expertise to the table, so while there are some qualifications and experiences we need you to have, we are open to discussing how your individual knowledge might lend itself to fulfilling this role and help us achieve our goals.

Required Skills & Experience:

  • 5 plus years Azure & Data Engineering Expertise.
  • Proven experience in designing and managing large-scale data solutions on Microsoft Azure.
  • Unity Catalog Mastery: In-depth knowledge of setting up, configuring, and utilizing Unity Catalog for robust data governance, access control, and metadata management in a Databricks environment.
  • Databricks Proficiency: Demonstrated ability to optimize and tune Databricks notebooks and workflows to maximize performance and efficiency. Experience with performance troubleshooting and best practices for scalable data processing is essential.
  • Strong problem-solving skills, ability to work in agile environments, and effective collaboration with cross-functional teams.
  • Experience with implementing a Data Lakehouse solution with Azure Databricks, data modeling, warehousing, and real-time streaming.
  • Knowledge of developing and processing full and incremental loads.
  • Experience of automated loads using Databricks workflows and Jobs.
  • Expertise in Azure Databricks, including Delta Lake, Spark optimizations, and MLflow.
  • Strong experience with Azure Data Factory (ADF) for data integration and orchestration.
  • Hands-on experience with Azure DevOps, including pipelines, repos, and infrastructure as code (IaC).
  • Solid understanding of platform administration, including monitoring, logging, and cost management.
  • Knowledge of data security, compliance, and governance in Azure, including Azure Active Directory (AAD), RBAC, and encryption.
  • Experience working with big data technologies (Spark, Python, Scala, SQL).
  • Strong problem-solving and troubleshooting skills.
  • Excellent communication skills with the ability to collaborate with cross-functional teams to understand requirements, data solutions, data models and mapping documents.

Preferred Qualifications:

  • Azure certifications (e.g., Azure Data Engineer Associate, Azure Solutions Architect).
  • Experience with Terraform, ARM templates, or Bicep for infrastructure automation.
  • Experience integrating Azure Data Services with Power BI and AI/ML workflows.
Role Factors:

The position is full-time with remote work options, requiring in-office presence three days per week.

What we offer:

You will be eligible for a comprehensive and competitive benefits package which includes medical plans for you and your family, health and wellness programs, retirement plans, tuition reimbursement, paid annual leave, and much more.

#J-18808-Ljbffr

  • Senior Data Engineer

    3 days ago

    Toronto, Ontario, Canada Bevertec Full time

    Job DescriptionDataOps/Cloud Data Engineer – Senior Candidate is required to come in office 3 days a week.Expert experience with Microsoft Azure technologies, including Azure pipeline, DACPAC, storage account, disk, file share, Azure key vault, Azure portal, virtual machine, Azure DevOps, Data Lake, Data Lakehouse, Azure monitoring tools.Experience with...

  • Senior Azure Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Recrute Action Full time

    Senior Azure Data Engineer We are hiring for two exciting opportunities with our client in the insurance industry, supporting high-impact data modernization initiatives. These roles offer the chance to lead the development of scalable, cloud-based data pipelines and platforms in a collaborative, forward-thinking environment. If you are passionate about...

  • Senior Data Engineer

    1 week ago

    Toronto, Ontario, Canada Eviden Full time

    Job OverviewEviden is a company that seeks highly skilled and experienced professionals to join our team. We are looking for a Senior Azure Data Engineer who can play a pivotal role in optimizing and re-architecting our Azure data platform.The successful candidate will have a solid understanding of data warehousing principles and experience with Master Data...

  • Azure Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Eviden Full time

    Role : Azure Data Engineer (Databricks Expert) Location : Toronto, ON Hire Type : Full-Time with Eviden We are seeking a highly skilled and experienced Senior Azure Data Engineer to join team and tackle critical performance challenges within Azure data platform. You will play a pivotal role in optimizing and re-architecting key components of data...

  • Azure Data Engineer

    1 week ago

    Toronto, Ontario, Canada Eviden Full time

    Role : Azure Data Engineer (Databricks Expert) Location : Toronto, ON Hire Type : Full-Time with Eviden We are seeking a highly skilled and experienced Senior Azure Data Engineer to join team and tackle critical performance challenges within Azure data platform. You will play a pivotal role in optimizing and re-architecting key components of data...

  • Azure Data Engineer

    4 days ago

    Toronto, Ontario, Canada Eviden Full time

    Role : Azure Data Engineer (Databricks Expert) Location : Toronto, ON Hire Type : Full-Time with Eviden We are seeking a highly skilled and experienced Senior Azure Data Engineer to join team and tackle critical performance challenges within Azure data platform. You will play a pivotal role in optimizing and re-architecting key components of data...

  • Azure Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Eviden Full time

    Role : Azure Data Engineer (Databricks Expert)Location : Toronto, ONHire Type : Full-Time with EvidenJob Description:About the Role:We are seeking a highly skilled and experienced Senior Azure Data Engineer to join team and tackle critical performance challenges within Azure data platform. You will play a pivotal role in optimizing and re-architecting key...

  • Azure Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Eviden Full time

    Role : Azure Data Engineer (Databricks Expert) Location : Toronto, ON Hire Type : Full-Time with Eviden Job Description: About the Role: We are seeking a highly skilled and experienced Senior Azure Data Engineer to join team and tackle critical performance challenges within Azure data platform. You will play a pivotal role in optimizing and...

  • Senior Big Data Engineer

    1 week ago

    Toronto, Ontario, Canada Eviden Full time

    About the RoleWe are seeking an exceptional Senior Big Data Engineer - Azure to join our team at Eviden. As a critical member of our data engineering team, you will play a pivotal role in optimizing and re-architecting key components of our Azure data platform. Your expertise will be instrumental in ensuring the performance and scalability of our core data...

  • Senior Azure Data Architect

    4 days ago

    Toronto, Ontario, Canada Eviden Full time

    Job SummaryEviden is seeking a highly skilled Senior Azure Data Engineer to join our team. As an expert in Databricks and Spark, you will play a pivotal role in optimizing and re-architecting key components of our data infrastructure.The ideal candidate will have extensive experience with Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and Azure...

  • Senior Azure Data Engineer

    2 days ago

    Toronto, Ontario, Canada Compunnel Inc. Full time

    Typical day in the role/Responsibilities: Hands-on technical skills in developing batch and real-time data pipelines, DevOps pipelines, and end-to-end processes in Microsoft Azure data and analytics PaaS services. Lead the agile software development process, including roadmap planning, cross-team coordination, task assignments, code reviews, sprint demos,...

  • Azure Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Diverse Lynx Full time

    Azure Data Engineer(Hybrid) TorontoTech lead: Experienced Azure Data Engineer Lead, Data Modeler, and Solution Designer. This hybrid role will combine leadership, data engineering, and solution design responsibilities. The ideal candidate will have extensive expertise in building and managing cloud-based data solutions, designing complex data models, and...

  • Senior Cloud Data Engineer

    3 days ago

    Toronto, Ontario, Canada Randstad Canada Full time

    The Senior DataOps/Cloud Data Engineer will play a crucial role in designing and deploying cloud-based data infrastructure using Microsoft Azure technologies. Key responsibilities include designing, developing, and optimizing data/database CI/CD pipelines using Azure tools, developing and maintaining database change processes using DACPAC and Azure DevOps,...

  • Senior Azure Data Specialist

    3 days ago

    Toronto, Ontario, Canada AXIS Capital Full time

    Job OverviewWe are seeking a highly skilled Senior Azure Data Engineer to join our team at AXIS Capital. This is an exceptional opportunity for a talented individual to contribute to the success of our organization by designing, implementing, and managing large-scale data solutions on Microsoft Azure.The successful candidate will have a strong background in...

  • Azure Data Engineer

    1 week ago

    Toronto, Ontario, Canada BetasharpInc Full time

    BetasharpInc is seeking an experienced Azure Data Engineer to lead the development and implementation of a scalable data hub built on the Azure stack.The ideal candidate should possess a strong background in data engineering, cloud data platforms, and project management.Key Responsibilities:Develop and implement data ingestion, transformation, and...

  • Cloud Data Engineer with Expertise in Azure

    3 days ago

    Toronto, Ontario, Canada Bevertec Full time

    About the RoleThis Senior DataOps/Cloud Data Engineer position requires a highly experienced professional to work on large-scale projects utilizing Microsoft Azure technologies.Responsibilities include developing and implementing data pipelines, workflows, and automation using Azure services such as Azure pipeline, DACPAC, storage account, disk, file share,...

  • Azure Data Engineer

    2 days ago

    Toronto, Ontario, Canada Wirehead Full time

    **About the Role:**We're seeking a highly motivated and experienced Senior Software Developer to join our team at Wirehead. As a Senior Software Developer, you will be responsible for designing and developing ETL pipelines using Azure Data Factory, Databricks, and other related tools.**Key Responsibilities:Design and develop ETL pipelines using Azure Data...

  • Azure Data Engineer

    7 days ago

    Toronto, Ontario, Canada Navacord Full time

    Professional Development Courses & Designations100% tuition re-imbursement for business relevant courses and trainingHybrid remote work flexibilityA volunteer day to make a difference and give back to your communityVary days – including a day off for your birthdayPOSITION OVERVIEW:Navacord is hiring technical talent in the insurance industry We are...

  • Azure Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Themesoft Inc. Full time

    Position : Azure Data Engineer Location : Toronto, On – Hybrid Job Description : Lead the analysis and interpretation of complex data to support business objectives. Oversee the development and implementation of data models using Azure Databricks. Provide expertise in Databricks SQL to optimize data queries and enhance data processing...

  • Azure Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Themesoft Inc. Full time

    Position: Azure Data EngineerLocation: Toronto, On – HybridJob Description:Lead the analysis and interpretation of complex data to support business objectives.Oversee the development and implementation of data models using Azure Databricks.Provide expertise in Databricks SQL to optimize data queries and enhance data processing efficiency.Develop and manage...