Senior Azure Data Engineer

3 weeks ago

Canada, CA Agility Partners Full time

A Little About This Gig:

Agility Partners is looking for a Senior Data Engineer to build data pipelines, model and prepare data, perform complex data analysis to answer Business questions, build and automate data pipeline and quality framework to enable and promote self service data pipelines, assist in operationalizing the AI / ML Engineering solutions. This role is expected to lead and guide other team members and evangelize the design patterns as well as coding standards.

This role plays an active part in our client's Data Modernization project to migrate the from on-prem platforms such as IBM Netezza to cloud.

  • In this role, you will:
  • Team up with the engineering teams and enterprise architecture (EA) to define standards, design patterns, accelerators, development practices, DevOps and CI/CD automation
  • Create and maintain the data ingestion, quality testing and audit framework
  • Conduct complex data analysis to answer the queries from Business Users or Technology team partners either directly from Analysts or stemmed from one of the Reporting tools suchs PowerBI, Tableau, OBIEE.
  • Build and automate the data ingestion, transformation and aggregation pipelines using Azure Data Factory, Databricks / Spark, Snowflake, Kafka as well as Enterprise Scheduler tools such as CA Workload automation or Control M
  • Setup and evangelize the metadata driven approach to data pipelines to promote self service
  • Setup and continuously improve the data quality and audit monitoring as well as alerting
  • Constantly evaluate the process automation options and collaborate with engineering as well as architecture to review the proposed design.
  • Demonstrate mastery of build and release engineering principles and methodologies including source control, branch management, build and smoke testing, archiving and retention practices
  • Adhere to and enhance and document the design principles, best practices by collaborating with Solution and in some cases Enterprise Architects
  • Participate in and support the Data Academy and Data Literacy program to train the Business Users and Technology teams on Data
  • Respond SLA driven production data quality or pipeline issues
  • Work in a fast-paced Agile/Scrum environment
  • Identify and assist with implementation of DevOps practices in support of fully automated deployments
  • Document the Data Flow Diagrams, Data Models, Technical Data Mapping and Production Support Information for Data Pipelines
  • Follow the Industry standard data security practices and evangelize the same across the team.


The Ideal Candidate:

  • 6+ years of experience in an Enterprise Data Management or Data Engineering role
  • 3+ of hands on experience in building metadata driven data pipelines using Azure Data Factory, Databricks / Spark for Cloud Datalake
  • 5+ years hands on experience with using one or more of the following for data analysis and wrangling Databricks, Python / PySpark, Jupyter Notebooks
  • Expert level SQL knowledge on databases such as but not limited to Snowflake, Netezza, Oracle, Sql Server, MySQL, Teradata
  • 3+ years of hands on experience on one or more of big data technologies such as Cloudera Hadoop, Pivotal, Vertica, MapR is a plus
  • Experience working in a multi developer environment and hands on experience in using either azure devops or gitlab
  • Preferably experienced in SLA driven Production Data Pipeline or Quality support
  • Experience or strong understanding of the traditional enterprise ETL platforms such as IBM Datastage, Informatica, Pentaho, Ab Initio etc.
  • Functional knowledge of some of the following technologies - Terraform, Azure CLI, PowerShell, Containerization (Kubernetes, Docker)
  • Functional knowledge of one or more Reporting tools such as PowerBI, Tableau, OBIEE
  • Team player with excellent communication skills, ability to communicate with the customer directly and able to explain the status of the deliverables in scrum calls
  • Ability to implement Agile methodologies and work in an Agile DevOps environment


Reasons to Love It:

  • Fully remote
  • Ability to join a collaborative team, making a positive impact on the financial stability and overall health of an organization
  • Culture-focused company focused on customer-first and a growth mindset
  • Great resume builder – gain experience with a Fortune 15 company
  • Medical, Dental and Vision plans (PPO and HSA plans available); Individual and Family coverage offerings
  • Long and short term disability coverage
  • 401(k)

  • Sr. Azure Data Engineer

    4 weeks ago

    Canada, CA Samay Consulting Full time

    At Samay India, we are looking to build a Centre of Excellence for our BI team and are actively looking to hire Azure Data Engineers in both Architect and Senior level developer roles. Prior experience building pipelines and transforming data using Azure Data Factory is mandatory. Knowledge of a Cloud Datawarehouse like Azure Synapse or Snowflake is also...

  • Lead Azure Data Engineer

    7 days ago

    Canada, CA Samay Consulting Full time

    On behalf of our retail client, we are looking to hire Azure Architect/Lead Azure Data Engineer who has expert level knowledge in Azure Data Factory & SQL, and is willing to serve in an individual contributor role.Knowledge of Snowflake is highly desirable. In the absence of Snowflake, knowledge of any Cloud Datawarehouse would work tooClient is only...

  • Azure DevSecOps Engineer

    3 weeks ago

    Canada, CA Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • Data Engineer

    2 days ago

    Canada, CA Conspicuous Full time

    Data Engineer (Contract)Remote - CanadaUp to $85/hr CAD C2COverview:Our client is seeking an experienced Data Engineer to join their team on a contract basis. This is an exciting opportunity to work on cutting-edge data solutions leveraging Microsoft technologies. Candidates with a background in Canadian Financial Institution environments will be highly...

  • Senior AI Data Engineer

    4 weeks ago

    Canada, CA Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • Data Engineer

    1 month ago

    Canada, CA technology& Full time

    Job Title: Data EngineerExperience Range: 8-14 yearsLocation: Canada (100% Remote, must be based within Canada)Job Type: ContractDuration: 6+ MonthsRate: CAD $60/hr - $65/hr (all-inclusive)Work Authorization: Open to all candidates legally authorized to work in Canada (No third-party candidates)Start Date: ASAPJob DescriptionAs a Data Engineer, you will play...

  • Senior Data Engineer

    3 weeks ago

    Canada, CA TekRek Full time

    Company Background: TekRek is assisting our client partner to recruit an experienced Senior Data Engineer in Toronto. Our client is a growth stage business completing a major data migration project to Snowflake data warehouse. They require a specialist data engineering for a 6-month project engagement. Job Description:As an Data Engineering leader you will...

  • Azure Developer

    4 weeks ago

    Canada, CA Capgemini Full time

    The Azure Developer will work remotely to design, develop, and scale Azure-based solutions for Capgemini clients. This role focuses on building robust Azure cloud integrations, providing technical leadership, and ensuring adherence to coding and cloud environment quality standards. The project duration is through June 30, 2025, with two open positions...

  • Azure Data Analyst

    2 days ago

    Canada, CA E-Solutions Full time

    Role : Azure Data Analyst Location : Canada JD :• Strong knowledge of Azure Databricks and SQL and preferred experience in areas such as creating data pipelines to load or ingest data• In depth knowledge in Pharma / Healthcare data and experience with HCP, HCO, Clinical study data.• knowledge of Python is plus to add • Candidate should be able to do...

  • Senior Machine Learning Engineer

    5 days ago

    Canada, CA RIGID ROBOTICS Full time

    Job Title: Senior ML EngineerLocation: Burnaby, BC (Hybrid)About Us: At RIGID ROBOTICS, we are on an exciting journey to transform the mining industry. By harnessing the power of precision sensing, IoT, and AI-driven decision-making our vision is to optimize the performance of large mining shovels. Our innovative solutions not only significantly boost...

  • Data Developer

    3 weeks ago

    Canada, CA hireVouch Full time

    Data Developer (1-Year Contract)Our client is a leading technology consulting and managed services provider specializing in database management, analytics, application development and cloud solutions. With strong partnerships across AWS, Microsoft, Oracle and a large team of certified consultants, they deliver solutions to global...

  • Azure Cloud Infrastructure Architect

    2 months ago

    Canada, CA Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...

  • Customer Engineer

    2 days ago

    Canada, CA Ascendion Full time

    About Ascendion:Ascendion is a full-service digital engineering solutions company. We make and manage software platforms and products that power growth and deliver captivating experiences to consumers and employees. Our engineering, cloud, data, experience design, and talent solution capabilities accelerate transformation and impact for enterprise clients....

  • DevOps Engineer

    3 weeks ago

    Canada, CA BrickRed Systems Full time

    Job DescriptionWe are seeking a Senior DevOps Engineer with at least 7 years of experience in Azure DevOps pipelines, CI/CD automation, and a strong background in .NET development. The ideal candidate will play a key role in designing, implementing, and optimizing deployment workflows, ensuring efficient and reliable development-to-production processes.Key...

  • Senior Consultant

    6 months ago

    Canada, CA LevelUp Finance - An Array Company Full time

    Position: Senior Consultant - Financial & Operational Business Intelligence / Data EngineerLocation: Remote in CanadaExperience:At least 5 years of experience using SQL & Power BI in the workplace.Experience with accounting/finance, sales operations, or other data-intensive business operations is a plus.Experience in planning applications (e.g., Adaptive,...

  • Data Engineer

    2 months ago

    Canada, CA Electric Mind inc. Full time

    As Data Engineer, you will provide hands-on expertise as it relates to data management, analytics, and business intelligence. This opportunity will allow you to utilize your unique blend of technical, software and cloud engineering experience.While working with teams in an Agile environment, you will be:Designing high quality data pipelines/architectures...

  • Data Engineer

    2 months ago

    Canada, CA Capgemini Full time

    As a Data Engineer, you will play a pivotal role in transforming operations by ensuring high-quality data and efficient tooling. This position involves building, maintaining, and optimizing data pipelines to drive insights, improve product solutions, and support cross-functional teams.Experience:5+ years of relevant experience in software development,...

  • Data Engineer

    4 weeks ago

    Canada, CA MSR Technology Group Full time

    Position: AWS Data EngineerLocation: Toronto, ONMandatory Skills: AWS, Glue, SQL, Redshift, LambdaJob Description:10+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, DevOps, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with...

  • Senior Network Engineer

    3 weeks ago

    Canada, CA Diligente Technologies Full time

    Sr. Network Engineer - Enterprise NetworkEmployment Type: Contract Contract Duration: 12+ monthsLocation : Remote/Canada EastDescription: Responsibilities • Work with the technical and project teams to archive milestones for major deliverable, US East Coast preferred time zone. • Work closely with Local IT-Cross function to maintain high level user...

  • Cyber Security Specialist

    1 month ago

    Canada, CA Intuitive.Cloud Full time

    About us:Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes.Intuitive Superpowers:- DataOps & AI/ML- Cloud Native, AppSecOps, DevSecOps- Cloud Migration &...