Int. Azure Data Engineer with Python, Databricks and ADF experience to operationalize ingested data for our insurance client

Sr. Azure Data Engineer with Python, Synapse, Databricks and ADF experience to Build and support data products for our insurance clientLocation: Hybrid (3 Days onsite in Toronto or London, ON)Duration: 6 MonthsResponsibilities: • Build and support data products for Canadian use: design, curate, and publish self-service connected datasets that increase...

Key Responsibilities:Lead the migration of existing ETL processes from Azure Data Factory and SQL procedures to DatabricksRedesign and optimize 15 data modelsImplement Delta Lake and Databricks SQL for efficient data warehousingDevelop scalable and performant data pipelines using Spark and Delta Live TablesCollaborate with BI and data science teams to ensure...

"Key skills: •AWS Glue, Python, AWS Redshift, Airflow, AWS LaMDA, AWS CloudWatch, Good experience on CLOUD Data Engineering •Equivalent AWS technologies in AZURE and GCP can also be considered, Azure Databricks, Azure ADF, python"

"Skills and Responsibilities:8+ Years experience is must in AWS data Engineer• Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred).• Must be able to work with large volumes of data coming from various sources. Perform data cleansing, data validation etc.Key skills: •AWS Glue,...

Job Summary:FoIICON is seeking a highly skilled Senior Data Engineer to join our team. As an experienced professional in designing and implementing data ingestion frameworks, you will play a key role in shaping the future of our organization.About the Role:We are looking for a talented individual with expertise in Azure-based data engineering solutions. The...

Toronto/HybridExperience with Microsoft Azure Synapse AnalyticsExperience with DatabricksExperience with data quality and data ingestion within the Azure platformimplement, maintain and support Azure data pipelines working with the Data Platform, Cloud, Infrastructure team, project team and architecture teamDevelop and automate data pipelines in Azure...

The role: In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data refresh performance.The role encompasses ownership (both execution and management)...

As a Senior Data Engineer at Rubicon Path, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Databricks and Python. Your expertise in ETL tools, such as Microsoft SSIS, and strong knowledge of Delta Lake for data management and optimization, will be crucial in ensuring the efficient transformation and...

Job Summary:The Data Engineer will be a key member of our Data & Analytics commercial data engineering team, responsible for designing, building, optimizing, and maintaining experiments, prototypes, and products across the organization's Microsoft Azure's Data Platform. Key Responsibilities:Design and build data extraction, transformation, and loading...

Responsibilities: Develop a comprehensive technical plan for the migration, including data ingestion, transformation, storage, and access control in Azure's Data Factory and data lakeDesign and implement scalable and efficient data pipelines to ensure smooth data movement from multiple sources using Azure DatabricksDeveloping scalable and re-usable...

Role: Azure Data EngineerLocation: Toronto, ON (Hybrid - 3 days onsite)Job type: Long-term Contract/ Full-time opportunity Experience: 5+ years Job Description: We are looking for a highly skilled professional to design, build, and maintain scalable data solutions while ensuring data quality and driving data innovation. Requirements• Over 3 years of...

Key ResponsibilitiesWe are seeking an experienced Data Engineer to join our team at Q1 Technologies, Inc. The ideal candidate will have a strong background in cloud-based data engineering and experience with AWS technologies.Key SkillsAWS Glue, Python, AWS Redshift, Airflow, and AWS CloudWatchGood experience in cloud data engineeringThe successful candidate...

Job DescriptionAzure Data Analyst - Azure Data Lake, Data Factory, DataBricks Key Responsibilities• Analyze large-scale data sets stored in Azure Data Lake using DataBricks and Azure Data Factory• Design and develop data integration pipelines using Azure Data Factory, DataBricks, and Python• Collaborate with cross-functional teams to identify business...

Data Engineer RoleData Engineer with Pyspark Databricks skillset required.RequirementsStrong background in Azure data services including Databricks Synapse Analytics Informatica Pyspark and SQL.Ability to extract and transform data especially unstructured data across various data processing layers using Databricks Python.Coordinate independently with...

Job Description:Foilcon is seeking a highly skilled Data Engineer to join our team. As a key member of our organization, you will be responsible for designing, developing, and implementing data warehouse solutions that meet the needs of our clients.About the Role:We are looking for an experienced Data Engineer with a strong background in data modeling,...

About the RoleRubicon Path is seeking an experienced Data Engineer to join our team. As a key member of our engineering team, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Databricks, Delta Lake, and Azure.Key ResponsibilitiesDesign and implement ETL processes using Databricks, Delta Lake, and Azure Data...

At Zurich Canada, we are seeking a talented Data Engineer to join our IT Data team.The successful candidate will have extensive experience working with large data sets from the insurance industry and knowledge of building programs/mappings that leverage Azure and Databricks platforms and Data warehouses.This is a unique opportunity to build your knowledge...

We are seeking an experienced Databricks ETL engineer to support our data warehousing, data lakes, and analytics initiatives. As a key member of our team, you will be responsible for designing, developing, and maintaining efficient ETL pipelines using Databricks and related tools.Key ResponsibilitiesDesign and implement scalable ETL processes to ingest,...

We are seeking an experienced Enterprise Data Analyst to join our team at Astra North Infoteck Inc. as an Azure Data Engineer. The successful candidate will have 6-8 years of experience in data analytics and data integration, with a strong understanding of agile methodologies.About the RoleThis is a challenging and rewarding opportunity for an individual who...

We are seeking a skilled Azure Data Engineer to design, build, and maintain scalable data solutions at VLink Inc.Estimated Salary: $120,000 - $180,000 per year, based on experience and location.About the RoleIn this key position, you will be responsible for designing and building data solutions using Azure Cloud Resources (ADLS, ADF, Dataflow) in accordance...