Data engineer

4 weeks ago

Toronto, Canada Tata Consultancy Services Full time

TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our workforce implemented through equitable workplace policies and processes.


About TCS


TCS operates on a global scale, with a diverse talent base of more than 600,000 associates representing 153 nationalities across 55 countries. TCS has been recognized as a Global Top Employer by the Top Employers Institute - one of only eight companies worldwide to have achieved this status. Our organizational structure is domain-led and designed to offer businesses a single window into industry-specific solutions. Our agile industry units have embedded capabilities to enable rapid responses that provide a competitive edge to our customers. This, coupled with a unique Global Network Delivery Model™ (GNDM™), is recognized as the current benchmark of excellence in technology deployment. We have made significant investments in digital technology, horizontal, and vertical platforms, allowing us to successfully serve our clients for over 50 years.


Skills and Responsibilities:


• Design, develop, and maintain data processing pipelines using Apache Spark.

• Collaborate with data engineers, data scientists, and business analysts to understand data requirements and deliver solutions that meet business needs.

• Write efficient Spark code to process, transform, and analyze large datasets.

• Optimize Spark jobs for performance, scalability, and resource utilization.

• Integrate Hadoop, Hive, Spring, Hibernate, Kafka, and ETL processes into Spark applications.

• Troubleshoot and resolve issues related to data pipelines and Spark applications.

• Monitor and manage Spark clusters to ensure high availability and reliability.

• Implement data quality and validation processes to ensure accuracy and consistency of data.

• Stay up-to-date with industry trends and best practices related to Spark, big data technologies, Python, and AWS services.

• Document technical designs, processes, and procedures related to Spark development.

• Provide technical guidance and mentorship to junior developers on Spark-related projects.


Qualifications:

• Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

• Proven experience as a Spark Developer or in a similar role working with big data technologies.

• Strong proficiency in Apache Spark, including Spark SQL, Spark Streaming, and Spark MLlib.

• Proficiency in programming languages such as Scala or Python for Spark development.

• Experience with data processing and ETL concepts, data warehousing, and data modeling.

• Solid understanding of distributed computing principles and cluster management.


Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodations during the recruitment and selection process, please inform Human Resource.


Thank you for your interest in TCS. Candidates that meet the qualification for this position will be contacted within a 2 week period. We invite you to continue to apply for other opportunities that match your profile.

  • Data Analyst

    3 weeks ago

    Toronto, Canada Data SEA Consulting Full time

    Data SEA Consulting – Data Analyst Company DescriptionData SEA Consulting focuses on helping mid-sized businesses harness the power of their data by leveraging the latest analytics tools and techniques. We work with Private Equity Funds and Independent Business Owners to find the unique data solutions that will drive the most value for their business....

  • Data Analyst

    3 weeks ago

    Toronto, Canada Data SEA Consulting Full time

    Data SEA Consulting – Data Analyst Company DescriptionData SEA Consulting focuses on helping mid-sized businesses harness the power of their data by leveraging the latest analytics tools and techniques. We work with Private Equity Funds and Independent Business Owners to find the unique data solutions that will drive the most value for their business....

  • Data Analyst

    3 weeks ago

    Toronto, Canada Data SEA Consulting Full time

    Data SEA Consulting – Data Analyst Company DescriptionData SEA Consulting focuses on helping mid-sized businesses harness the power of their data by leveraging the latest analytics tools and techniques. We work with Private Equity Funds and Independent Business Owners to find the unique data solutions that will drive the most value for their business....

  • Data Analyst

    4 weeks ago

    Toronto, Canada Data SEA Consulting Full time

    Data SEA Consulting – Data Analyst Company Description Data SEA Consulting focuses on helping mid-sized businesses harness the power of their data by leveraging the latest analytics tools and techniques. We work with Private Equity Funds and Independent Business Owners to find the unique data solutions that will drive the most value for their business....

  • iOS Engineer, Observability SDK

    1 month ago

    Toronto, Canada Data Theorem Full time

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.As an iOS engineer, you will be...

  • iOS Engineer, Observability SDK

    4 weeks ago

    Toronto, Ontario, Canada Data Theorem Full time

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.As an iOS engineer, you will be...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve...

  • Data Engineer

    3 weeks ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a...

  • Data Engineer

    3 weeks ago

    Toronto, Canada SearchLabs Full time

    Job DescriptionTitle: Data EngineerType: ContractLocation: TorontoEnvironment: HybridWe are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and maintaining scalable data pipelines and platforms using cloud-based technologies, particularly within the Microsoft...

  • Data Engineer

    3 weeks ago

    Toronto, Canada Organigram Inc Full time

    Description:We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in SQL Server, Azure Data Factory, and data ingestion architecture within the Azure Cloud environment. Additionally, familiarity with Dynamics 365 and experience in IoT (Internet of Things) would be highly...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Organigram Inc Full time

    Description:We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in SQL Server, Azure Data Factory, and data ingestion architecture within the Azure Cloud environment. Additionally, familiarity with Dynamics 365 and experience in IoT (Internet of Things) would be highly...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Organigram Inc Full time

    Description: We are seeking a skilled and experienced Data Engineer to join our team. The ideal candidate will have expertise in SQL Server, Azure Data Factory, and data ingestion architecture within the Azure Cloud environment. Additionally, familiarity with Dynamics 365 and experience in IoT (Internet of Things) would be highly beneficial....

  • Data Engineer

    3 weeks ago

    Toronto, Canada SearchLabs Full time

    Title: Data EngineerType: ContractLocation: TorontoEnvironment: HybridWe are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will have extensive experience in designing, building, and maintaining scalable data pipelines and platforms using cloud-based technologies, particularly within the Microsoft Azure ecosystem....

  • Data Engineer

    4 weeks ago

    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Data Engineer

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join.The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL pipelines,...

  • Data Engineer

    1 week ago

    Toronto, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Data Engineer

    1 week ago

    Toronto, Canada Compunnel Full time

    POSITION GENERAL DUTIES AND TASKS : Data Engineer Responsibilities Create and maintain test deliverables and artifacts (test plans, test cases, test results summary) to test complex applications and system integrations for Finance (Oracle EBS, Mulesoft and integrated SaaS) applications.Database systems, Data Pipeline Orchestration, Programing languages...

  • Data Engineer

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join.The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL pipelines,...

  • Data Engineer

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join. The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL...