Data engineer

4 weeks ago

Toronto, Canada Tata Consultancy Services Full time

TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our workforce implemented through equitable workplace policies and processes.


About TCS


TCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries. TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status. Our organizational structure is domain-led and designed to offer businesses a single window into industry-specific solutions. Our agile industry units have embedded capabilities to enable rapid responses that provide a competitive edge to our customers. This, coupled with a unique Global Network Delivery Model™ (GNDM™), is recognized as the current benchmark of excellence in technology deployment. We have made significant investments in digital technology, horizontal, and vertical platforms, allowing us to successfully serve our clients for over 50 years.


Skills and Responsibilities:


• Design, develop, and maintain data processing pipelines using Apache Spark.

• Collaborate with data engineers, data scientists, and business analysts to understand data requirements and deliver solutions that meet business needs.

• Write efficient Spark code to process, transform, and analyze large datasets.

• Optimize Spark jobs for performance, scalability, and resource utilization.

• Integrate Hadoop, Hive, Spring, Hibernate, Kafka, and ETL processes into Spark applications.

• Troubleshoot and resolve issues related to data pipelines and Spark applications.

• Monitor and manage Spark clusters to ensure high availability and reliability.

• Implement data quality and validation processes to ensure accuracy and consistency of data.

• Stay up-to-date with industry trends and best practices related to Spark, big data technologies, Python, and AWS services.

• Document technical designs, processes, and procedures related to Spark development.

• Provide technical guidance and mentorship to junior developers on Spark-related projects.


Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

• Proven experience as a Spark Developer or in a similar role working with big data technologies.

• Strong proficiency in Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib.

• Proficiency in programming languages such as Scala or Python for Spark development.

• Experience with data processing and ETL concepts, data warehousing, and data modeling.

• Solid understanding of distributed computing principles and cluster management.


Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodations during the recruitment and selection process, please inform Human Resource.


Thank you for your interest in TCS. Candidates that meet the qualification for this position will be contacted within a 2 week period. We invite you to continue to apply for other opportunities that match your profile.

  • iOS Engineer, Observability SDK

    4 weeks ago

    Toronto, Ontario, Canada Data Theorem Full time

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.As an iOS engineer, you will be...

  • Data Engineer

    13 hours ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as...

  • Data Engineer

    40 minutes ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as...

  • Data Engineer

    21 hours ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams.The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a...

  • Data Engineer

    13 hours ago

    Toronto, Canada CGS (Computer Generated Solutions) Full time

    Data Engineer– Full time – Permanent Position Computer Generated Solutions – Saint John, NB Open for Remote work Corporate Profile: We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about...

  • Data Engineer

    21 hours ago

    Toronto, Canada CGS (Computer Generated Solutions) Full time

    Data Engineer– Full time – Permanent Position Computer Generated Solutions – Saint John, NB Open for Remote work Corporate Profile: We provide custom learning solutions, channel partner enablement services and applications development. Since 1984, CGS has been delivering expert, cross-industry solutions across multiple platforms. To learn more about...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a...

  • Data Engineer

    14 hours ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming,

  • Data Engineer

    4 weeks ago

    Toronto, Canada SearchLabs Full time

    Title: Data EngineerType: ContractLocation: TorontoEnvironment: HybridWe are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and maintaining scalable data pipelines and platforms using cloud-based technologies, particularly within the Microsoft Azure ecosystem....

  • Data Engineer

    1 month ago

    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Data Engineer

    4 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join.The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL pipelines,...

  • Data Engineer

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join.The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL pipelines,...

  • Data Engineer

    2 weeks ago

    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Data Engineer

    13 hours ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join. The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL...

  • Data Engineer

    42 minutes ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join. The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL...

  • Data Engineer

    21 hours ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join.The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL pipelines,...

  • Data Engineer

    2 days ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join. The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a da