Senior Data Engineer
2 weeks ago
Position: Senior Data Engineer (Databricks Expertise)
Location: Hybrid Montreal, QC / Mississauga, ON
Pay Rate: CAD 80/hr - CAD 83/hr
Employment: 6-month contract with possible extension
Job Summary:
We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize large-scale data pipeline, ensuring scalability, reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting-edge data solutions.
Key Responsibilities:
Data Pipeline Development:
- Build and maintain scalable ETL/ELT pipelines using Databricks.
- Leverage PySpark/Spark and SQL to transform and process large datasets.
- Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non-relational systems.
Collaboration & Analysis:
- Work Closely with multiple teams to prepare data for dashboard and BI Tools.
- Collaborate with cross-functional teams to understand business requirements and deliver tailored data solutions.
Performance & Optimization:
- Optimize Databricks workloads for cost efficiency and performance.
- Monitor and troubleshoot data pipelines to ensure reliability and accuracy.
Governance & Security:
- Implement and manage data security, access controls and governance standards using Unity Catalog.
- Ensure compliance with organizational and regulatory data policies.
Deployment:
- Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments.
- Manage version control for Databricks artifacts and collaborate with team to maintain development best practices.
Technical Skills:
- 12 years of experience with Data engineering
- Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
- Proficiency in Azure Cloud Services.
- Solid Understanding of Spark and PySpark for big data processing.
- Experience in relational databases.
- Knowledge on Databricks Asset Bundles and GitLab.
Preferred Experience:
- Familiarity with Databricks Runtimes and advanced configurations.
- Knowledge of streaming frameworks like Spark Streaming.
- Experience in developing real-time data solutions.
Certifications:
Azure Data Engineer Associate or Databricks certified Data Engineer Associate certification. (Optional)
Technical Skills:
* 12 years of experience with Data engineering.
* Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.)
* Proficiency in Azure Cloud Services.
* Solid Understanding of Spark and PySpark for big data processing.
* Experience in relational databases.
* Knowledge on Databricks Asset Bundles and GitLab.
Preferred Experience:
* Familiarity with Databricks Runtimes and advanced configurations.
* Knowledge of streaming frameworks like Spark Streaming.
* Experience in developing real-time data solutions.
Certifications:
Azure Data Engineer Associate or Databricks certified Data Engineer Associate certification. (Optional)
-
Data Engineer Lead
6 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeWe are seeking a highly skilled and experienced Senior Data Engineer to join our Digital Solutions team in Mississauga, ON.The successful candidate will be responsible for designing and implementing data ingestion strategies using SLT SAP to stream data towards our Azure Enterprise Data Lake, maintaining and monitoring data ingestion across various platforms...
-
Senior Data Scientist Position
6 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeSkillful Data Engineers play a pivotal role in today's digital landscape, where data informs business decisions and fuels innovation.At BASF, we seek an exceptional Senior Data Engineer to lead our Big Data initiatives, leveraging their expertise in design and implementation of data ingestion strategies, data pipeline development, and quality control...
-
Cloud Data Engineering Expert
5 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeJob Summary:Join BASF's Digital Solutions team as a Senior Data Engineer and contribute to the development of cutting-edge big data solutions, driving business growth through data-driven decision-making.This exciting opportunity offers the chance to work with advanced technology, collaborate with top talent, and impact the company's strategic direction.In...
-
Big Data Architect Role
5 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeIn this challenging yet rewarding role, you will leverage your technical expertise to deliver high-impact data engineering solutions that empower business growth and fuel innovation.As a Senior Data Engineer, you will collaborate with multidisciplinary teams to design, develop, and maintain cutting-edge data solutions, applying your knowledge of cloud...
-
Senior Data Integrity Engineer
3 hours ago
Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full timeAbout the JobWe are excited to welcome applications for the Senior Data Integrity Engineer role at KUBRA Data Transfer Ltd.In this role, you will work closely with the Engineering and Service Delivery teams to ensure our products meet stringent specifications and quality standards.Develop and execute manual and automated test cases for software applications...
-
Senior Data Engineer
5 days ago
Mississauga, Ontario, Canada Express Scripts Inc. Full timeWe are looking for a Senior Data Engineer to join our team at Express Scripts Inc. This role involves designing, developing, and supporting ETL jobs, preferably with ODI, and associated tasks such as troubleshooting, tuning, documentation, and migration between environments.The Senior Data Engineer will be responsible for performing detailed data analysis...
-
Senior Data Engineer
4 weeks ago
Mississauga, Ontario, Canada Dexian Full timeSenior Data Engineer Locations: Full Time/Permanent/Direct Hire Develop, implement, and optimize data pipelines using PySpark and Python. - Write complex SQL queries to extract, transform, and load (ETL) data from various sources. - Ensure data quality, integrity, and availability for analytical purposes. - Work closely with data scientists and analysts...
-
Senior Data Engineer
3 weeks ago
Mississauga, Ontario, Canada Dexian Full timeRole: Senior Data Engineer Locations: Mississauga, ON Type: Full Time/Permanent/Direct Hire Job Description: Responsibilities • Develop, implement, and optimize data pipelines using PySpark and Python. • Write complex SQL queries to extract, transform, and load (ETL) data from various sources. • Ensure data quality, integrity, and availability...
-
Senior Data Engineer
4 weeks ago
Mississauga, Ontario, Canada Dexian Full timeRole: Senior Data Engineer Locations: Mississauga, ON Type: Full Time/Permanent/Direct Hire Job Description: Responsibilities - Develop, implement, and optimize data pipelines using PySpark and Python. - Write complex SQL queries to extract, transform, and load (ETL) data from various sources. - Ensure data quality, integrity, and availability for...
-
Engineer Data Quality
5 days ago
Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full time**Responsibilities**The Data Quality Engineer will be responsible for:Collaborating with cross-functional teams to ensure quality and timely delivery of products.Developing and executing manual and automated test cases for software applications to ensure the reliability of data pipelines, ETL processes, and data transformations.Conducting end-to-end...
-
Senior Data Engineer
3 weeks ago
Mississauga, Ontario, Canada Pharma Medica Research Inc. Full timePharma Medica Research (PMRI) Inc. is a Contract Research Organization that strives for innovation and original solutions in a highly regulated and competitive industry. If your career goals align with innovation and original thinking you will be the perfect candidate to be part of an inclusive, adaptable, and forward-thinking organization. Our reputation...
-
Senior Data Engineer
6 days ago
Mississauga, Ontario, Canada Mattamy Homes Full timeLocation: Mississauga, Ontario – Hybrid (2 days/week in office) Company: Mattamy Asset Management Department: IT Enterprise Services Department, GTA Lowrise Division Employment Type: Full-Time Reports to: Director, Platform Engineering At Mattamy Asset Management (MAM), everyone has an important role to play in our shared success. Developing...
-
Data Quality Engineer
2 days ago
Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full timeWe are excited to welcome applications for the Data Quality Engineering role at KUBRAIn this role, you will work closely with the Engineering and Service Delivery teams to ensure our products meet stringent specifications and quality standards. Your focus will be on testing and enhancing data capabilities across various products, ensuring impeccable data...
-
Senior Data Engineer
2 days ago
Mississauga, Ontario, Canada Infosys Limited Full timeWe are seeking a talented Senior Data Engineer to join our team at Infosys Limited. As a key member of our global delivery model, you will play a crucial role in enabling digital transformation for our clients.In this role, you will research and recommend appropriate solutions for complex data processing challenges, contributing to technology-specific best...
-
Senior Cloud and Data Engineering Lead
6 days ago
Mississauga, Ontario, Canada 08763 Citi Canada Technology Services ULC Full timeSecurity Services industry is constantly changing, requiring Citi to react and plan accordingly. An analysis has been undertaken to identify a strategic vision in response to a changing landscape. The business recognizes that investment in technology is critical to fulfilling evolving client needs. To that extent, a 5-year transformational strategy is...
-
Data Engineering Lead
5 days ago
Mississauga, Ontario, Canada Bank of Montreal Full timeAbout the Role: We are seeking an experienced leader to oversee our data engineering and application development efforts. As a Senior Manager, Data Engineering and Application Development, you will be responsible for managing people and leading a team capable of delivering the desired business results.Key Responsibilities:Provide strategic input into...
-
Senior Data Engineer
6 days ago
Mississauga, Ontario, Canada Synechron Full timeAt Synechron, we combine creativity with innovative technology to deliver industry-leading digital solutions. Our global consulting firm has a proven track record of transforming businesses through cutting-edge data engineering and cloud-based services.We are seeking a highly skilled Data Pipeline Specialist to join our dynamic team. The ideal candidate will...
-
Senior Big Data Engineer
2 days ago
Mississauga, Ontario, Canada Infosys Full timeAt Infosys, we are seeking a skilled Senior Big Data Engineer to enable digital transformation for our clients in a global delivery model. In this role, you will research on technologies independently, recommend appropriate solutions and contribute to technology-specific best practices and standards.Key Responsibilities:Interface with key stakeholders and...
-
Data Transformation Engineer
3 hours ago
Mississauga, Ontario, Canada Infosys Full timeKey ResponsibilitiesDesign and develop scalable data pipelines using Apache Spark and Scala.Work closely with cross-functional teams to identify business requirements and implement data transformation solutions.Collaborate with senior engineers to design and implement ETL processes.Maintain and optimize existing data processing systems to ensure high...
-
Senior Data Engineering Lead
1 day ago
Mississauga, Ontario, Canada Presto Recruiting Solutions Full timePresto Recruiting Solutions is seeking a highly skilled and passionate Lead Python Data Engineer to drive the development and maintenance of our advanced data infrastructure.In this leadership role, you will play a critical part in designing, building, and optimizing data pipelines that provide actionable insights across the organization.You will have the...