BigData Developer

3 weeks ago

Toronto, Canada Tata Consultancy Services Full time

Inclusion without Exception

TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our workforce implemented through equitable workplace policies and processes.


About TCS:


Tata Consultancy Services is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive powered portfolio of business, technology, and engineering services and solutions is delivered through its unique Location Independent Agile™ delivery model, recognized as a benchmark of excellence in software development. A part of the Tata group, India's largest multinational business group, TCS has over 615,000 of the world’s best-trained consultants in 55 countries. The company generated consolidated revenues of US $27.9 billion in the fiscal year ended March 31, 2023, and is listed on the BSE and the NSE in India. TCS' proactive stance on climate change and award-winning work with communities across the world have earned it a place in leading sustainability indices such as the MSCI Global Sustainability Index and the FTSE4Good Emerging Index.


Role Description

Total Experience- 6-8 years Resource have strong data warehouse technical knowledge.? Resource have knowledge in Bank and financial domain (Minimum 6+ years of experience).? Resource also required knowledge in ETL process and develop the SSIS packages. ? Understand requirement from product owners and translate into requirement and scope documents? Decide on the best fitment of technologies/services that are available in scope? Create Solution for data ingestion and data transformation using Hadoop services like Spark, Spark streaming, Hive, etc.? Create technical design documents to communicate solutions to the team and mentor the team to develop the solution? Build the solution with Hadoop Services as per design specifications? Assist team teams to build test cases and support with testing the solution? Coordinate with Upstream, Downstream and other supporting teams for production implementation? Provide post-production support for Solutions implemented


Required Skill Set:

ETL data warehouse MS SSIS/SSRS IBM Netezza MS SQL server/Sybase database

Candidate should have strong working experience with Hadoop platform.

Strong hands-on experience on Hive, Spark with Scala.

In-depth knowledge and extensive experience in building batch workloads on Hadoop.

Adept in analyzing and refining requirements, consumption query patterns and choosing the right technology fit like RDBMS, data lake and data warehouse.

Should have knowledge of analytical data modelling on any of the RDBMS platform / Hive

Should have working experience in Pentaho? Proven practical experience in migrating RDBMS based data to Hadoop on-prem


Desired Skill Set:


Hadoop (Hive SQL and Pentaho ETL design)

AWS Cloud services (Spark, Redshift and EMR)

Knowledge in lending systems and functional knowledge on the same

Knowledge in MDM systems for customer demographics process

Knowledge in retail and commercial deposit system process (Core banking with Canadian banking domain)

Strong solution Knowledge in AWS Cloud and hands on experience with ETL process (like Kafka message processing, batch interface data injection and other business layer process)

Hands-on experience working with Terra bytes \ peta bytes scale data and millions of transactions per day.

Skills to develop ETL pipeline using Airflow

Knowledge of Spark streaming or any other streaming jobs

Ability to deploy code using AWS Code Pipeline and Bit bucket is an added plus

Expert in any of the following programming language: Scala, Java and comfortable with working on Linux platform.

Knowledge of Python.



Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodations during the recruitment and selection process, please inform Human Resource


Thank you for your interest in TCS. Candidates that meet the qualification for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.

  • Bigdata QA Automation Tester

    7 months ago

    Toronto, Canada themesoft Full time

    Hi Professionals; **This Thiru from Themesoft INC.** **Kindly let me know if you are interested in this opportunity** Job Title: Bigdata QA Automation tester. Job Location: Toronto Canada Duration:contract JD: **Must Have** - 9+ years’ experience as a Bigdata QA Automation tester. - Expert level hands on in Python development - must have - Knowledge...

  • BigData Solution Architect

    2 weeks ago

    Toronto, Canada Tata Consultancy Services Full time

    About TCSTata Consultancy Services is a global leader in IT services, consulting, and business solutions.With over 55 years of experience, we have been partnering with many of the world's largest businesses in their transformation journeys.We offer a unique portfolio of business, technology, and engineering services and solutions, delivered through our...

  • Azure Bigdata Support Analyst

    7 months ago

    Toronto, Canada Tekshapers Software Solutions Pvt Ltd Full time

    Position: - Azure Bigdata Support Analyst Location: - Toronto Fulltime job description: - "Skills and Responsibilities: - Provide technical support and troubleshooting assistance to customers using Azure services. - Collaborate with development teams to identify and resolve product issues and improve customer experience. - Leverage Azure monitoring...

  • BigData Developer

    2 weeks ago

    Toronto, Canada Tata Consultancy Services Full time

    Inclusion without Exception TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • Bigdata Developer

    2 weeks ago

    Toronto, ON, Canada Tata Consultancy Services Full time

    Inclusion without Exception TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • Bigdata Developer

    2 weeks ago

    Toronto, ON, Canada Tata Consultancy Services Full time

    Inclusion without Exception TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • BigData Developer

    1 month ago

    Toronto, Ontario, Ontario, Canada Tata Consultancy Services Full time

    Inclusion without ExceptionTCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • Experienced Python Developer for Wholesale Lending Projects

    4 days ago

    Toronto, Ontario, Canada First Derivative Full time

    First Derivative is a people-first company, powered by specialist problem-solvers and process-evolvers. We offer agile solutions and exciting career opportunities.As a Senior Python Developer, you will gain exposure to mission-critical projects, tech stacks, and clients in the Capital Markets consultancy. Our company prides itself on career development,...

  • Big Data

    2 days ago

    Toronto, Canada Atlantis IT group Full time

    **Job Title**:Big Data Developer **Location**:Toronto **Duration**:Full time **Key skills**: BigData, Spark, Scala

  • Senior Python Developer

    2 weeks ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    2 weeks ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • First Derivative | Senior Python Developer

    4 days ago

    toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • ​ Senior Python Developer

    4 months ago

    Toronto, ON, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • First Derivative | ​ Senior Python Developer

    3 days ago

    toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, ON, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, ON, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...