Data Pipeline Engineer
4 weeks ago
At CG Consulting Group, we are seeking a highly skilled Data Pipeline Engineer to join our team. As a Data Pipeline Engineer, you will be responsible for designing, developing, and implementing high-performance, scalable, and reliable data pipelines using Java and Apache Spark. You will work on data-intensive projects, leveraging the power of Spark for large-scale data processing and analytics.
Key Responsibilities:
• Design, develop, and maintain Java applications leveraging Apache Spark for distributed data processing and analytics.
• Collaborate with data engineers and data scientists to implement data pipelines, ETL processes, and machine learning workflows using Spark.
• Optimize and tune Spark jobs to ensure efficient utilization of computing resources and high throughput for data processing tasks.
Requirements:
• Bachelor's degree in Computer Science, Engineering, or a related field.
• Proven experience as a Java Developer with hands-on experience in Apache Spark for data processing and analytics.
• Strong proficiency in Java programming language with a focus on scalable and distributed systems.
• Experience with Apache Spark, Spark Streaming, Spark SQL, and related Spark ecosystem tools and libraries.
• Knowledge of big data technologies such as Hadoop, HDFS, and distributed computing frameworks for large-scale data processing.
• Strong understanding of data structures, algorithms, and database technologies for data manipulation and analytics.
• Experience with Agile development methodologies and tools.
What We Offer:
• Competitive salary and benefits package.
• Opportunity to work with a dynamic and experienced team.
• Professional development and growth opportunities.
• Collaborative and inclusive work environment.
-
Data Engineer: Cloud Data Pipeline Expert
5 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeAutoCapital Canada Inc. is a leading Canadian financial services company with diverse portfolios across automotive, consumer, and merchant lending.About the RoleThis position offers an exciting opportunity to leverage big data and cloud computing technologies in writing impactful data pipelines that drive business growth.Design, implement, and maintain...
-
Senior Data Engineer
3 weeks ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeAbout the RoleWe are seeking an experienced Data Engineer to join our team at AutoCapital Canada. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key ResponsibilitiesData Pipeline Design and...
-
Senior Data Engineer
1 month ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeJob DescriptionWe are seeking a highly skilled Data Engineer to join our team at AutoCapital Canada. As a Data Engineer, you will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key Responsibilities:Design and implement data...
-
Data Engineer, Finance
1 month ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeJob Title: Data Engineer, FinanceAutoCapital Canada Inc. is a leading financial services company with a strong presence in the Canadian market. We are seeking a highly skilled Data Engineer to join our team and contribute to the development of our data-driven solutions.Key Responsibilities:Design, implement, and maintain robust data pipelines and ETL...
-
Senior Data Engineer
1 month ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeJob SummaryWe are seeking a highly skilled Data Engineer to join our Insurance Development team in Technology & Operations at the Royal Bank of Canada. As a key member of our team, you will be responsible for designing, developing, and implementing data solutions to support our business needs.Key ResponsibilitiesPerform data analysis and design data...
-
Senior Data Processing Engineer
2 weeks ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeJob Title: Senior Data Processing EngineerCompany Overview:AutoCapital Canada Inc. is a Canadian national financial services company with a diverse portfolio of automotive, consumer, and merchant lending.We specialize in managing the entire lifecycle of finance receivables, from credit adjudication to contract administration and customer service.We work...
-
Senior Data Architect
1 week ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeUnlock career opportunities as a Senior Data Architect with AutoCapital Canada Inc., a leading national financial services company. Our team focuses on innovative data solutions and cutting-edge technology to drive business growth.We are looking for an experienced Senior Data Architect to join our Engineering team in Toronto, Ontario. As a key member of the...
-
Senior Data Engineer
4 weeks ago
Mississauga, Ontario, Canada F. Hoffmann-La Roche Gruppe Full timeThe RoleWe are seeking a Senior Data Engineer to join our Agile team, where you will develop and maintain robust data pipelines and data management systems. Your strong attention to detail and passion for delivering highly accurate and available data will enable downstream insights and drive business value.As a key member of our team, you will partner...
-
Data Engineer
4 weeks ago
Mississauga, Ontario, Canada Astra North Infoteck Inc. Full timeData Engineering Role at Astra North Infoteck Inc.As a Data Engineer at Astra North Infoteck Inc., you will be responsible for designing, developing, and maintaining large-scale data processing systems. This includes experience with ETL (Extract, Transform, Load) processes, data pipelines, and data warehousing. You will work closely with cross-functional...
-
Data Engineer
4 weeks ago
Mississauga, Ontario, Canada Astra North Infoteck Inc. Full timeData Engineering Role at Astra North Infoteck Inc.As a Data Engineer at Astra North Infoteck Inc., you will be responsible for designing, developing, and maintaining large-scale data processing systems. This includes experience with ETL (Extract, Transform, Load) processes, data pipelines, and data warehousing using SQL and NoSQL databases. Additionally, you...
-
Senior Data Engineer
3 weeks ago
Mississauga, Ontario, Canada F. Hoffmann-La Roche Gruppe Full timeRochefosters diversity, equity, and inclusion, representing the communities we serve. In the field of healthcare, diversity is key to success. We believe that inclusion unlocks understanding of people's varied healthcare needs. Together, we celebrate individuality and share a passion for exceptional care.The RoleWe are always innovating, bringing together...
-
Data Pipeline Engineer
1 month ago
Mississauga, Ontario, Canada https:www.pcrecruiter.netsitemap Full timeSr Java Spark DeveloperWe are seeking a highly skilled and experienced Java Spark Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing high-performance, scalable, and reliable applications using Java and Apache Spark.Key Responsibilities:Design and develop Java...
-
Data Engineer
2 weeks ago
Mississauga, Ontario, Canada Capgemini Full timeJob Title: Data Engineer - Scalable Pipeline DeveloperAbout the RoleCapgemini is seeking a Data Engineer - Scalable Pipeline Developer to join its team of innovative professionals. The ideal candidate will have a strong background in data engineering, with expertise in scalable pipeline development using Java or Python.This is a unique opportunity to work...
-
Software Engineer
1 month ago
Mississauga, Ontario, Canada Aviyatech Full timeAviyatech is seeking a skilled Software Engineer to lead the development of data pipelines and APIs for our aerospace and defense applications. The ideal candidate will have a strong background in software engineering and experience with data governance principles.Key ResponsibilitiesDesign and implement ETL pipelines to extract, transform, and load data...
-
Senior Cloud Data Engineer
4 weeks ago
Mississauga, Ontario, Canada Egen Full timeData Engineering Role at EgenAs a Senior Cloud Data Engineer at Egen, you will be responsible for architecting and implementing cloud-native data pipelines and infrastructure to enable analytics and machine learning on Egen's rich datasets. This is a unique opportunity to work with a talented team of data engineers and contribute to the development of...
-
Senior Data Engineer
1 month ago
Mississauga, Ontario, Canada Mattamy Homes Full timeAbout the RoleMattamy Asset Management is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our IT Enterprise Services Department, you will be responsible for designing, developing, and maintaining data storage, processing, and integration solutions focused on the customer portfolio of applications.Key...
-
Data Engineer
2 weeks ago
Mississauga, Ontario, Canada COMPASS GROUP CANADA Full timeYou might not know our name, but you know where we are. That's because Compass Group Canada is part of a global foodservice and support services company that's the 6th largest employer in the world, with 625,000 employees.We're in all major cities, at remote work sites and everywhere in between – doing business in Canada and 50+ other countries where you...
-
Mississauga, Ontario, Canada BASF SE Full timeJob DescriptionWe are seeking an experienced Cloud Data Engineer for Advanced Data SolutionsCompany OverviewBASF SE is a leading chemical company that aims to drive sustainable growth and improve people's lives.About the RoleIn this role, you will design, implement, and maintain data distribution strategies using Unity Catalog with Azure Databricks and Azure...
-
Data Engineer
4 weeks ago
Mississauga, Ontario, Canada COMPASS GROUP CANADA Full timeYou might not know our name, but you know where we are. That's because Compass Group Canada is part of a global foodservice and support services company that's the 6th largest employer in the world, with 625,000 employees.We're in all major cities, at remote work sites and everywhere in between – doing business in Canada and 50+ other countries where you...
-
Cloud Data Engineer
4 weeks ago
Mississauga, Ontario, Canada https:www.pcrecruiter.netsitemap Full timeCloud Data EngineerThis role involves designing, developing, and deploying data pipelines for efficient data ingestion, transformation, and loading from various sources while ensuring data quality and integrity.Responsibilities:Build and optimize data pipelines using Python, Pyspark, and SQL to process and analyze large volumes of data.Design and develop...