Data Engineer

2 weeks ago

Mississauga, Ontario, Canada LHH Full time

LHH is currently working with a client in Toronto, Canada that is looking for Data Engineers. This is a full time, direct hire, hybrid with 3 days in office opportunity. This role requires Hadoop, Spark, Hive, JAVA, Kafka experience.

Responsibilities

  • Partner with multiple management teams to ensure appropriate integration of functions to meet goals and identify and define necessary system enhancements to deploy new products and process improvements.
  • Resolve high-impact problems/projects through in-depth evaluation of complex business processes, system processes, and industry standards.
  • Provide expertise in area and advanced knowledge of applications programming and ensure application design adheres to the overall architecture blueprint.
  • Utilize advanced knowledge of system flow and develop standards for coding, testing, debugging, and implementation.
  • Statistical modeling of large datasets.
  • Big data architecture troubleshooting.
  • Data curation and conformance work.
  • Streaming/batch processing and event-based messaging.
  • Data manipulation and analysis.

Qualifications

  • 6+ years of relevant experience in Apps Development or systems analysis role.
  • 6+ years experience using tools for statistical modeling of large data sets.
  • 6+ years experience and strong solid understanding of the Big Data architecture and the ability to trouble shoot performance and/or development issues on Hadoop (Cloudera preferably) or Snowflake.
  • Hands-on experience working with Core SQL, Hive, Impala and HBase, Kudu, Spark for data curation/conformance related work.
  • 6+ years experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event-based messaging.
  • 6+ years experience in JAVA.
  • 6+ years of proven experience as a Data Engineer working with large-scale data platforms.
  • Strong proficiency in PySpark (Python API) and Scala Spark.
  • Expertise in writing complex SQL queries for data manipulation and analysis.
  • Experience with data warehousing solutions and technologies.
  • Solid understanding of data structures, algorithms, and distributed systems.
  • Excellent communication and collaboration skills

Required Skills

  • JAVA
  • Hadoop (Cloudera)
  • Snowflake
  • Core SQL
  • Hive
  • Impala
  • HBase
  • Kudu
  • Spark
  • Spark/Storm/Kafka (or equivalent)
  • PySpark
  • Scala Spark
  • Statistical Modeling Tools
  • Data Warehousing Technologies
  • Data Structures and Algorithms

This role is only available to candidates with an Open work permit, with more than 1 year remaining, Canadian Permanent Resident, or Canadian Citizen.

  • BASF Senior Data Engineer

    3 weeks ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Now hiring Senior Data EngineerMississauga, ON (Hybrid - 2 days in office)We are looking for a Senior Data Engineer (SAP) to join our Digital Solutions team in Mississauga, ON. Come create chemistry with us We as Global Digital Services enable BASF's digitalization and adoption of artificial intelligence. In agile teams, we develop innovative solutions for...

  • Senior Data Professional Wanted

    3 days ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Job DescriptionWe are seeking a highly motivated and detail-oriented Senior Data Engineer who will be responsible for SAP Data Engineering with SAP Datasphere or similar technologies maintaining/developing the platform and processes in an ambitious team.The ideal candidate will design and implement data ingestion strategies using SLT SAP to stream data...

  • Cloud Architect and Engineer

    2 days ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Requirements and QualificationsA bachelor's degree in computer science, Information Technology, Engineering, Business, or related fields.A minimum of 4-5 years' experience as Data Engineer with SAP Data and familiarity with Big Data concepts.Proficient in software engineering and development skills using Python and Git, with Spark or PySpark.Additionally,...

  • Data Engineer Positions

    3 days ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Company OverviewBASF is a leading chemical company that has been finding solutions for everyday needs and addressing complex economic, environmental, and sustainability challenges for over 150 years.We strive to become an even better workplace and have earned various awards, including being recognized as one of Canada's Top Employers for eleven consecutive...

  • Big Data Solutions Expert

    2 days ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleThis role offers an opportunity to work with cutting-edge technology and contribute to the development of innovative solutions for BASF and its customers.You will collaborate with the Data Integration team and Business Data Owners to align infrastructure components and troubleshoot data-related issues for optimal performance, develop and...

  • Engineering Data Quality Manager

    4 days ago

    Mississauga, Ontario, Canada KUBRA Data Transfer Ltd Full time

    About the Role:We are seeking a highly skilled Data Quality Engineer to join our team. As a key member of our Engineering department, you will work closely with cross-functional teams to ensure our products meet high levels of product data quality and accuracy. Your focus will be on testing and enhancing data capabilities across various products, using...

  • Data Engineer

    3 weeks ago

    Mississauga, Ontario, Canada Capgemini Full time

    Role: Data EngineersLocation: Mississauga, CAFulltime- 7+ experience with the below required soft skills as well- Proficient in Java or Python, APIs and SQL with experience in the data space (data integration/ transformation jobs)- Experience with Cloud technologies including AWS, EKS, Kubernetes, etc.- Strong understanding of CI/CD tools such as GitHub,...

  • Data Engineer

    2 weeks ago

    Mississauga, Ontario, Canada Capgemini Full time

    Role: Data EngineersLocation: Mississauga, CAFulltime 7+ experience with the below required soft skills as well Proficient in Java or Python, APIs and SQL with experience in the data space (data integration/ transformation jobs)Experience with Cloud technologies including AWS, EKS, Kubernetes, etc.Strong understanding of CI/CD tools such as GitHub, Jenkins,...

  • Data Engineer

    3 weeks ago

    Mississauga, Ontario, Canada Alquemy Search & Consulting Full time

    Data EngineerFull time/permanent opportunity"Hybrid" work environment, two days per week in the Mississauga officeDesired skills & experience:- 5+ years as a Data Engineer working with large-scale data platforms- PySpark (Python API)- Scala Spark- Writing complex SQL queries for data analysis- Data structures, Algorithms and distributed systems$80,000 -...

  • Data Engineer

    1 week ago

    Mississauga, Ontario, Canada Capgemini Full time

    Role: Data Engineers Location: Mississauga, CA Fulltime 7+ experience with the below required soft skills as well Proficient in Java or Python, APIs and SQL with experience in the data space (data integration/ transformation jobs) Experience with Cloud technologies including AWS, EKS, Kubernetes, etc. Strong understanding of CI/CD tools such as...

  • Data Engineer

    2 weeks ago

    Mississauga, Ontario, Canada Alquemy Search & Consulting Full time

    Data Engineer Full time/permanent opportunity "Hybrid" work environment, two days per week in the Mississauga office Desired skills & experience: 5+ years as a Data Engineer working with large-scale data platforms PySpark (Python API) Scala Spark Writing complex SQL queries for data analysis Data structures, Algorithms and distributed systems $80,000 -...

  • Data Engineer

    1 week ago

    Mississauga, Ontario, Canada Alquemy Search & Consulting Full time

    Data EngineerFull time/permanent opportunity"Hybrid" work environment, two days per week in the Mississauga officeDesired skills & experience:5+ years as a Data Engineer working with large-scale data platformsHadoopSparkHiveJavaKafkaWriting complex SQL queries for data analysisData structures, Algorithms and distributed systems$90,000 - $150,000 base...

  • Data Engineer

    7 days ago

    Mississauga, Ontario, Canada Tata Consultancy Services Full time

    About the RoleTata Consultancy Services is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing and developing high-quality data transformation applications using Apache Spark framework.Your key responsibilities will include:Designing and developing scalable, high-performance data transformation...

  • Data Engineer

    2 weeks ago

    Mississauga, Ontario, Canada Alquemy Search & Consulting Full time

    Data Engineer Full time/permanent opportunity "Hybrid" work environment, two days per week in the Mississauga office Desired skills & experience: 5+ years as a Data Engineer working with large-scale data platforms Hadoop Spark Hive Java Kafka Writing complex SQL queries for data analysis Data structures, Algorithms and distributed systems $90,000 -...

  • Data Engineer

    2 weeks ago

    Mississauga, Ontario, Canada LHH Full time

    A leading global financial institution is seeking a Data Engineer at the intermediate level to contribute to the development, implementation, and optimization of large-scale data platforms. The role involves working closely with the technology team to analyze, develop, and enhance data-driven applications and systems. The ideal candidate will bring expertise...

  • Data Engineer

    4 weeks ago

    Mississauga, Ontario, Canada Synechron Full time

    We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Data Engineer

    3 weeks ago

    Mississauga, Ontario, Canada Synechron Full time

    We are At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative technology to deliver industry-leading digital solutions. Synechron's progressive technologies and optimization strategies span end-to-end Artificial Intelligence, Consulting, Digital, Cloud & DevOps,...

  • Data Engineering Specialist

    4 days ago

    Mississauga, Ontario, Canada Definity Financial Corporation Full time

    **Job Overview:**We are seeking a highly skilled Data Engineering Specialist to join our team at Definity Financial Corporation.As a Data Engineering Specialist, you will be responsible for designing and implementing data engineering solutions that meet the needs of our business.Key Responsibilities:Work closely with our technical and agile development team...

  • Senior Data Engineer

    3 weeks ago

    Mississauga, Ontario, Canada Vaco Full time

    Position: Senior Data Engineer (Databricks Expertise)Location: Hybrid Montreal, QC / Mississauga, ONPay Rate: CAD 80/hr - CAD 83/hrEmployment: 6-month contract with possible extensionJob Summary:We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize...

  • Senior Data Engineer

    1 week ago

    Mississauga, Ontario, Canada Vaco Full time

    Position: Senior Data Engineer (Databricks Expertise)Location: Hybrid Montreal, QC / Mississauga, ONPay Rate: CAD 80/hr - CAD 83/hrEmployment: 6-month contract with possible extensionJob Summary:We are seeking highly skilled Azure Data Engineer with strong expertise in Databricks to join our data team. The ideal candidate will design, implement and optimize...