Data Pipeline Engineer

6 days ago


Mississauga, Ontario, Canada Open Systems Technologies Full time

We are seeking a highly skilled Big Data Developer for a contract role at Open Systems Technologies. As a key member of our team, you will be responsible for designing and developing scalable data pipelines using Java Spark.

This exciting opportunity involves working on large-scale financial data processing and analysis, ensuring efficient data storage and retrieval using Big Data frameworks.

Key Responsibilities:

  • Develop and optimize Java Spark-based data pipelines for risk calculations, trade analytics, and regulatory reporting.
  • Design and implement distributed computing solutions for risk modeling, pricing, and regulatory compliance.
  • Maintain high code quality through testing, CI/CD pipelines, and version control (Git, Jenkins).

Required Skills and Qualifications:

  • 7+ years of experience in software development with at least 3 years of experience in Java Spark and Big data frameworks.
  • Strong proficiency in Python and Java Spark with knowledge of core spark concepts (RDDs, Dataframes, Spark Streaming, etc.).
  • Excellent problem-solving skills and strong analytical mindset.


  • Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Now hiring Senior Data EngineerMississauga, ON (Hybrid - 2 days in office)We are looking for a Senior Data Engineer (SAP) to join our Digital Solutions team in Mississauga, ON. Come create chemistry with us We as Global Digital Services enable BASF's digitalization and adoption of artificial intelligence. In agile teams, we develop innovative solutions for...


  • Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Job DescriptionWe are seeking a highly motivated and detail-oriented Senior Data Engineer who will be responsible for SAP Data Engineering with SAP Datasphere or similar technologies maintaining/developing the platform and processes in an ambitious team.The ideal candidate will design and implement data ingestion strategies using SLT SAP to stream data...


  • Mississauga, Ontario, Canada Open Systems Technologies Full time

    **Job Description:**We are looking for a highly skilled Data Pipeline Engineer to join our team at Open Systems Technologies.This is a 3-day Hybrid role that involves developing and optimizing data pipelines for risk calculations, trade analytics, and regulatory reporting.Key Responsibilities:Design and implement distributed computing solutions for risk...


  • Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Requirements and QualificationsA bachelor's degree in computer science, Information Technology, Engineering, Business, or related fields.A minimum of 4-5 years' experience as Data Engineer with SAP Data and familiarity with Big Data concepts.Proficient in software engineering and development skills using Python and Git, with Spark or PySpark.Additionally,...


  • Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full time

    About the Role:We are seeking a highly skilled Data Quality Engineer to join our team. As a key member of our Engineering department, you will work closely with cross-functional teams to ensure our products meet high levels of product data quality and accuracy. Your focus will be on testing and enhancing data capabilities across various products, using...


  • Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Company OverviewBASF is a leading chemical company that has been finding solutions for everyday needs and addressing complex economic, environmental, and sustainability challenges for over 150 years.We strive to become an even better workplace and have earned various awards, including being recognized as one of Canada's Top Employers for eleven consecutive...


  • Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleThis role offers an opportunity to work with cutting-edge technology and contribute to the development of innovative solutions for BASF and its customers.You will collaborate with the Data Integration team and Business Data Owners to align infrastructure components and troubleshoot data-related issues for optimal performance, develop and...


  • Mississauga, Ontario, Canada Synechron Full time

    Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering.We develop innovative solutions for modernization, including AI and Blockchain, Data Science models, Digital Underwriting, mobile-first applications, and more.We are seeking a highly...

  • Data Engineer

    4 days ago


    Mississauga, Ontario, Canada Open Systems Technologies Full time

    At Open Systems Technologies, we're looking for a skilled Data Engineer to join our team and help us deliver innovative data-driven solutions.This role involves designing and developing scalable data pipelines using Java Spark to process and analyze large-scale financial data. You'll be responsible for ensuring efficient data storage and retrieval using Big...


  • Mississauga, Ontario, Canada Synechron Full time

    At Synechron, we are passionate about driving innovation and growth through digital transformation. Our global consulting firm combines creativity with cutting-edge technology to deliver industry-leading digital solutions that cater to the evolving needs of financial services and technology firms.We are seeking an experienced Azure Data Engineer to join our...

  • Senior Data Engineer

    3 weeks ago


    Mississauga, Ontario, Canada Vaco Full time

    Position: Senior Data Engineer (Databricks Expertise)Location: Hybrid Montreal, QC / Mississauga, ONPay Rate: CAD 80/hr - CAD 83/hrEmployment: 6-month contract with possible extensionJob Summary:We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize...


  • Mississauga, Ontario, Canada Vaco Full time

    Position: Senior Data Engineer (Databricks Expertise)Location: Hybrid Montreal, QC / Mississauga, ONPay Rate: CAD 80/hr - CAD 83/hrEmployment: 6-month contract with possible extensionJob Summary:We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize...


  • Mississauga, Ontario, Canada Presto Recruiting Solutions Full time

    Presto Recruiting Solutions is seeking a highly skilled and passionate Data Engineering Lead to drive the development and maintenance of our advanced data infrastructure. In this leadership role, you will play a critical part in designing, building, and optimizing data pipelines that provide actionable insights across the organization.The ideal candidate...


  • Mississauga, Ontario, Canada Synechron Full time

    **Company Overview:** At Synechron, we believe in the power of digital to transform businesses for the better. We combine creativity and innovative technology to deliver industry-leading digital solutions.We are seeking a highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement...


  • Mississauga, Ontario, Canada Open Systems Technologies Full time

    Job OverviewOpen Systems Technologies is seeking a highly skilled Java Spark Developer to join our team. As a key member of our data engineering group, you will be responsible for designing and developing scalable data pipelines using Java Spark.In this role, you will work closely with our risk management team to develop and optimize data pipelines for risk...

  • Data Engineer

    1 week ago


    Mississauga, Ontario, Canada Tata Consultancy Services Full time

    About the RoleTata Consultancy Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing high-quality data transformation applications using Apache Spark framework.Your key responsibilities will include:Designing and developing scalable, high-performance data transformation...

  • Senior Data Engineer

    2 weeks ago


    Mississauga, Ontario, Canada Pharma Medica Research Inc. Full time

    Pharma Medica Research (PMRI) Inc. is a Contract Research Organization that strives for innovation and original solutions in a highly regulated and competitive industry. If your career goals align with innovation and original thinking you will be the perfect candidate to be part of an inclusive, adaptable, and forward-thinking organization. Our reputation...


  • Mississauga, Ontario, Canada Synechron Full time

    At Synechron, we believe in harnessing the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions that drive real impact. We span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps, Data, and Software Engineering...


  • Mississauga, Ontario, Canada Presto Recruiting Solutions Full time

    Now Hiring: Lead Python Data Engineer We are seeking a highly skilled and passionate Lead Python Data Engineer to drive the development and maintenance of our advanced data infrastructure. In this leadership role, you will play a critical part in designing, building, and optimizing data pipelines that provide actionable insights across the organization....


  • Mississauga, Ontario, Canada Synechron Full time

    At Synechron, we believe in harnessing the power of digital to transform businesses and drive growth. Our global consulting firm combines creativity and innovative technology to deliver cutting-edge digital solutions.Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...