Data Pipeline Engineer
6 days ago
We are seeking a highly skilled Big Data Developer for a contract role at Open Systems Technologies. As a key member of our team, you will be responsible for designing and developing scalable data pipelines using Java Spark.
This exciting opportunity involves working on large-scale financial data processing and analysis, ensuring efficient data storage and retrieval using Big Data frameworks.
Key Responsibilities:
- Develop and optimize Java Spark-based data pipelines for risk calculations, trade analytics, and regulatory reporting.
- Design and implement distributed computing solutions for risk modeling, pricing, and regulatory compliance.
- Maintain high code quality through testing, CI/CD pipelines, and version control (Git, Jenkins).
Required Skills and Qualifications:
- 7+ years of experience in software development with at least 3 years of experience in Java Spark and Big data frameworks.
- Strong proficiency in Python and Java Spark with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc.).
- Excellent problem-solving skills and strong analytical mindset.
-
BASF Senior Data Engineer
3 weeks ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeNow hiring Senior Data EngineerMississauga, ON (Hybrid - 2 days in office)We are looking for a Senior Data Engineer (SAP) to join our Digital Solutions team in Mississauga, ON. Come create chemistry with us We as Global Digital Services enable BASF's digitalization and adoption of artificial intelligence. In agile teams, we develop innovative solutions for...
-
Senior Data Professional Wanted
3 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeJob DescriptionWe are seeking a highly motivated and detail-oriented Senior Data Engineer who will be responsible for SAP Data Engineering with SAP Datasphere or similar technologies maintaining/developing the platform and processes in an ambitious team.The ideal candidate will design and implement data ingestion strategies using SLT SAP to stream data...
-
Data Pipeline Engineer
1 day ago
Mississauga, Ontario, Canada Open Systems Technologies Full time**Job Description:**We are looking for a highly skilled Data Pipeline Engineer to join our team at Open Systems Technologies.This is a 3-day Hybrid role that involves developing and optimizing data pipelines for risk calculations, trade analytics, and regulatory reporting.Key Responsibilities:Design and implement distributed computing solutions for risk...
-
Cloud Architect and Engineer
3 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeRequirements and QualificationsA bachelor's degree in computer science, Information Technology, Engineering, Business, or related fields.A minimum of 4-5 years' experience as Data Engineer with SAP Data and familiarity with Big Data concepts.Proficient in software engineering and development skills using Python and Git, with Spark or PySpark.Additionally,...
-
Engineering Data Quality Manager
4 days ago
Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full timeAbout the Role:We are seeking a highly skilled Data Quality Engineer to join our team. As a key member of our Engineering department, you will work closely with cross-functional teams to ensure our products meet high levels of product data quality and accuracy. Your focus will be on testing and enhancing data capabilities across various products, using...
-
Data Engineer Positions
3 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeCompany OverviewBASF is a leading chemical company that has been finding solutions for everyday needs and addressing complex economic, environmental, and sustainability challenges for over 150 years.We strive to become an even better workplace and have earned various awards, including being recognized as one of Canada's Top Employers for eleven consecutive...
-
Big Data Solutions Expert
3 days ago
Mississauga, Ontario, Canada Data Engineer Jobs Full timeAbout the RoleThis role offers an opportunity to work with cutting-edge technology and contribute to the development of innovative solutions for BASF and its customers.You will collaborate with the Data Integration team and Business Data Owners to align infrastructure components and troubleshoot data-related issues for optimal performance, develop and...
-
Azure Databricks Data Pipeline Expert
1 week ago
Mississauga, Ontario, Canada Synechron Full timeSynechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering.We develop innovative solutions for modernization, including AI and Blockchain, Data Science models, Digital Underwriting, mobile-first applications, and more.We are seeking a highly...
-
Data Engineer
4 days ago
Mississauga, Ontario, Canada Open Systems Technologies Full timeAt Open Systems Technologies, we're looking for a skilled Data Engineer to join our team and help us deliver innovative data-driven solutions.This role involves designing and developing scalable data pipelines using Java Spark to process and analyze large-scale financial data. You'll be responsible for ensuring efficient data storage and retrieval using Big...
-
Senior Azure Data Pipeline Developer
6 days ago
Mississauga, Ontario, Canada Synechron Full timeAt Synechron, we are passionate about driving innovation and growth through digital transformation. Our global consulting firm combines creativity with cutting-edge technology to deliver industry-leading digital solutions that cater to the evolving needs of financial services and technology firms.We are seeking an experienced Azure Data Engineer to join our...
-
Senior Data Engineer
3 weeks ago
Mississauga, Ontario, Canada Vaco Full timePosition: Senior Data Engineer (Databricks Expertise)Location: Hybrid Montreal, QC / Mississauga, ONPay Rate: CAD 80/hr - CAD 83/hrEmployment: 6-month contract with possible extensionJob Summary:We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize...
-
Senior Data Engineer
1 week ago
Mississauga, Ontario, Canada Vaco Full timePosition: Senior Data Engineer (Databricks Expertise)Location: Hybrid Montreal, QC / Mississauga, ONPay Rate: CAD 80/hr - CAD 83/hrEmployment: 6-month contract with possible extensionJob Summary:We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize...
-
Data Engineering Lead
4 days ago
Mississauga, Ontario, Canada Presto Recruiting Solutions Full timePresto Recruiting Solutions is seeking a highly skilled and passionate Data Engineering Lead to drive the development and maintenance of our advanced data infrastructure. In this leadership role, you will play a critical part in designing, building, and optimizing data pipelines that provide actionable insights across the organization.The ideal candidate...
-
Data Engineer Leader
3 days ago
Mississauga, Ontario, Canada Synechron Full time**Company Overview:** At Synechron, we believe in the power of digital to transform businesses for the better. We combine creativity and innovative technology to deliver industry-leading digital solutions.We are seeking a highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement...
-
Mississauga, Ontario, Canada Open Systems Technologies Full timeJob OverviewOpen Systems Technologies is seeking a highly skilled Java Spark Developer to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data pipelines using Java Spark.In this role, you will work closely with our risk management team to develop and optimize data pipelines for risk...
-
Data Engineer
1 week ago
Mississauga, Ontario, Canada Tata Consultancy Services Full timeAbout the RoleTata Consultancy Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing high-quality data transformation applications using Apache Spark framework.Your key responsibilities will include:Designing and developing scalable, high-performance data transformation...
-
Senior Data Engineer
2 weeks ago
Mississauga, Ontario, Canada Pharma Medica Research Inc. Full timePharma Medica Research (PMRI) Inc. is a Contract Research Organization that strives for innovation and original solutions in a highly regulated and competitive industry. If your career goals align with innovation and original thinking you will be the perfect candidate to be part of an inclusive, adaptable, and forward-thinking organization. Our reputation...
-
Senior Data Engineer Position
5 days ago
Mississauga, Ontario, Canada Synechron Full timeAt Synechron, we believe in harnessing the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions that drive real impact. We span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering...
-
Lead Python Data Engineer
2 weeks ago
Mississauga, Ontario, Canada Presto Recruiting Solutions Full timeNow Hiring: Lead Python Data Engineer We are seeking a highly skilled and passionate Lead Python Data Engineer to drive the development and maintenance of our advanced data infrastructure. In this leadership role, you will play a critical part in designing, building, and optimizing data pipelines that provide actionable insights across the organization....
-
Senior Data Engineering Expert
1 week ago
Mississauga, Ontario, Canada Synechron Full timeAt Synechron, we believe in harnessing the power of digital to transform businesses and drive growth. Our global consulting firm combines creativity and innovative technology to deliver cutting-edge digital solutions.Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...