Data Engineer Transformation Expert
2 weeks ago
Job Title: Data Engineer Transformation Expert
About the Role
We are seeking an experienced Data Engineer to join our team in Toronto. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining data pipelines using Azure Databricks and Spark (Python). You will leverage Databricks Notebooks and VScode to implement and manage the Delta Live Tables (DLT) framework and structured streaming for real-time data processing.
The ideal candidate will have significant experience in developing with Azure DevOps, Spark, particularly in Python, and using Databricks Notebooks within Azure Databricks. You will also have strong knowledge and hands-on experience with the Delta Live Tables (DLT) framework and structured streaming.
Key Responsibilities
- Design, develop, and maintain data pipelines using Azure Databricks and Spark (Python)
- Implement and manage the Delta Live Tables (DLT) framework and structured streaming for real-time data processing
- Build and support resilient data pipelines for operational systems
- Utilize Azure DevOps for CI/CD processes
- Develop and maintain unit testing frameworks to validate data solutions
Required Skills and Qualifications
To be successful in this role, you will need:
- Bachelor's degree in Computer Science, Engineering, or a related field
- Significant experience in developing with Azure DevOps, Spark, particularly in Python, and using Databricks Notebooks within Azure Databricks
- Strong knowledge and hands-on experience with the Delta Live Tables (DLT) framework and structured streaming
- Proven track record in building resilient data solutions for operational systems
- Experience in using Azure DevOps for CI/CD and familiarity with unit testing frameworks
Benefits and Perks
As a valued member of our team, you can expect:
- Competitive salary: $140,000 - $160,000 per year
- Flexible work options enabling time and location-based flexibility
- Company-provided home office equipment
- Comprehensive benefits program (Health, Welfare, Retirement, and Paid Time Off)
- Other perks and wellness benefits like discount programs and gym/studio access
About Capgemini
Capgemini is a global business and technology transformation partner, helping organizations accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society.
-
Data Engineer Transformation Specialist
2 weeks ago
Toronto, Ontario, Canada Scotiabank Full timeTransform Your Career with a Data-Driven Role at ScotiabankWe are seeking an experienced Data Engineer Transformation Specialist to join our team, where you will play a key role in designing and implementing scalable data solutions that drive business growth.About the Job:Design and develop high-performance data engineering solutions to support our...
-
Data Engineer
4 weeks ago
Toronto, Ontario, Canada The Home Depot Canada Full timeAbout the RoleThe Home Depot Canada is seeking a talented Data Engineer to join our Analytics team. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining scalable data pipelines using Google Cloud Platform services. Your primary responsibility will be to extract, transform, and load (ETL) data from diverse sources into...
-
Data Engineering Expert for Azure Solutions
2 weeks ago
Toronto, Ontario, Canada Lyons Consulting Group Full timeJob OverviewLyons Consulting Group seeks a highly skilled Data Engineering Expert to lead the development of scalable and efficient Azure data solutions. As part of our team, you will work on designing and implementing complex data pipelines, ensuring seamless integration with various data sources and platforms.About the RoleWe are looking for an experienced...
-
Toronto, Ontario, Canada Scotiabank Full timeOverviewAt Scotiabank, we are seeking a Senior Cloud Data Engineer to lead our data transformation efforts and drive innovation using Google Cloud Platform (GCP) technologies.Estimated Salary Range:$120,000 - $180,000 per yearJob DescriptionA career as a Senior Cloud Data Engineer at Scotiabank means you will be working on designing, building, and...
-
Digital Transformation Lead
2 weeks ago
Toronto, Ontario, Canada NTT DATA Full timeCompany Overview:NTT DATA is a leading provider of digital and AI infrastructure solutions, serving 75% of the Fortune Global 100. We are committed to helping clients innovate, optimize, and transform for long-term success.About the Role:We are seeking a skilled Digital Transformation Lead to join our team in Canada. As a fully remote role, you will have the...
-
Data Engineer
2 weeks ago
Toronto, Ontario, Canada Zurich Insurance Company Full timeAt Zurich Canada, we are seeking a talented Data Engineer to join our IT Data team.The successful candidate will have extensive experience working with large data sets from the insurance industry and knowledge of building programs/mappings that leverage Azure and Databricks platforms and Data warehouses.This is a unique opportunity to build your knowledge...
-
Data Engineering Transformation Lead
2 weeks ago
Toronto, Ontario, Canada Scotiabank Full timeCompany OverviewScotiabank is a leading bank in the Americas, committed to helping customers achieve success through a range of advice, products, and services.Salary: $180,000 - $220,000 per yearJob DescriptionWe are seeking a highly motivated Data Engineering Transformation Lead to drive Global Treasury's transformation. As Director, Data Engineering, you...
-
Data Engineer
2 weeks ago
Toronto, Ontario, Canada Scotiabank Full timeJob SummaryWe are seeking a highly skilled Data Engineer to join our Fraud Business Intelligence team at Scotiabank. As a key member of this team, you will be responsible for organizing and transforming raw data into actionable insights.ResponsibilitiesYou will work closely with stakeholders to understand business needs and translate requirements into...
-
Data Engineer Manager
5 days ago
Toronto, Ontario, Canada Scotiabank Full timeJob DescriptionCompany Overview:Scotiabank is a leading bank in the Americas, guided by its purpose to help clients achieve success through diverse advice, products, and services.Salary:$140,000 - $180,000 per yearAbout the Role:We are seeking an experienced Data Engineer Manager to join our Fraud Business Intelligence team. In this role, you will be...
-
Cloud Data Engineer for Digital Transformation
2 weeks ago
Toronto, Ontario, Canada Tech Mahindra Full timeDigital TransformationWe thrive on innovation and technology to drive meaningful and sustainable experiences. The digital landscape is constantly evolving, disrupting industries like never before. Businesses must build seamless yet simple enterprises that collaborate and synergize to stay ahead.At Tech Mahindra, we live the philosophy of connected world and...
-
Toronto, Ontario, Canada Wattpad Full timeAbout UsAt Wattpad, we're passionate about harnessing the power of community and technology to unleash the full potential of stories worldwide. With a global reach and a diverse team, we're dedicated to creating innovative products that connect people through storytelling.Job OverviewWe're seeking an experienced Data Engineer, Analytics to join our...
-
Data Conversion Expert
4 weeks ago
Toronto, Ontario, Canada Foilcon Full timeAbout the RoleFoilon is seeking an experienced Data Conversion Expert to join our team. As a key member of our data migration team, you will be responsible for overseeing all aspects of data conversion, ensuring seamless data transfer and high-quality results.Key ResponsibilitiesOversee all facilities of the conversion processComplete mapping, interfaces,...
-
Strategic Data Analytics Manager
3 weeks ago
Toronto, Ontario, Canada NTT DATA Services Full timeJob Summary:NTT DATA Services is seeking a Strategic Data Analytics Manager to remotely join our team in or near Toronto, Ontario, Canada.We are looking for a seasoned data professional with Google Cloud Platform expertise to lead our Data Intelligence team. The ideal candidate is an intellectually curious and growth-minded individual who excels in...
-
IT Transformation Expert
2 weeks ago
Toronto, Ontario, Canada Foilcon Full timeAbout FoilconFoilcon is a leading provider of innovative IT solutions, committed to helping our clients achieve their business objectives through effective technology implementation.Job Title: IT Transformation ExpertWe are seeking an experienced IT Transformation Expert to join our team. As an IT Transformation Expert, you will play a key role in advising...
-
Data Engineering Transformation Specialist
2 weeks ago
Toronto, Ontario, Canada Scotiabank Full timeWe are seeking a highly motivated, passionate, and experienced technical leader to drive Global Treasury's transformation as Director of Data Engineering. This role will play a crucial part in defining the governance structures, data domain models, and tools required to support Global Treasury's vision.Key ResponsibilitiesCollaborate with stakeholders to...
-
Lead Data Engineer
2 weeks ago
Toronto, Ontario, Canada CPP Investments Full timeUnlock Your Potential as a Lead Data EngineerCPP Investments, a global investment organization, seeks an exceptional Lead Data Engineer to join its team. As a key member of our data engineering team, you will design, implement, and deploy data pipelines to transform vendor data into CPPIB standard format.Key Responsibilities:Develop and lead the design,...
-
Digital Transformation Expert
3 weeks ago
Toronto, Ontario, Canada Management Solutions, S.L Full timeAbout the RoleWe are seeking a skilled Digital Transformation Expert to join our team in Toronto. As a key member of our organization, you will be responsible for driving digital transformation initiatives and helping our clients navigate the ever-changing technology landscape.Key Responsibilities:Develop and implement digital transformation strategies to...
-
Data Engineer for Data Warehouse Solutions
2 weeks ago
Toronto, Ontario, Canada Foilcon Full timeJob Description:Foilcon is seeking a highly skilled Data Engineer to join our team. As a key member of our organization, you will be responsible for designing, developing, and implementing data warehouse solutions that meet the needs of our clients.About the Role:We are looking for an experienced Data Engineer with a strong background in data modeling,...
-
Toronto, Ontario, Canada Stripe Full timeAbout the RoleStripe is a financial infrastructure platform for businesses. We're looking for a talented Software Engineer to join our Data Transformation and Movement team, which operates the critical infrastructure that powers near-real-time and batch data processing at Stripe.ResponsibilitiesDesign, build, and maintain innovative next-generation or...
-
Senior Data Conversion Expert
2 weeks ago
Toronto, Ontario, Canada Foilcon Full timeSkillful Data MigrationAt Foilcon, we are seeking a seasoned Senior Data Conversion Expert to join our team. With the right candidate, we aim to elevate our data migration processes and ensure seamless transitions for our clients.In this role, you will be responsible for overseeing all aspects of the conversion process, from mapping interfaces to verifying...