BigData Developer

3 weeks ago

Toronto, Canada Tata Consultancy Services Full time

Inclusion without Exception

TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our workforce implemented through equitable workplace policies and processes.


About TCS:


Tata Consultancy Services is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive powered portfolio of business, technology, and engineering services and solutions is delivered through its unique Location Independent Agile™ delivery model, recognized as a benchmark of excellence in software development. A part of the Tata group, India's largest multinational business group, TCS has over 615,000 of the world’s best-trained consultants in 55 countries. The company generated consolidated revenues of US $27.9 billion in the fiscal year ended March 31, 2023, and is listed on the BSE and the NSE in India. TCS' proactive stance on climate change and award-winning work with communities across the world have earned it a place in leading sustainability indices such as the MSCI Global Sustainability Index and the FTSE4Good Emerging Index.


Role Description

Total Experience- 6-8 years Resource have strong data warehouse technical knowledge.? Resource have knowledge in Bank and financial domain (Minimum 6+ years of experience).? Resource also required knowledge in ETL process and develop the SSIS packages. ? Understand requirement from product owners and translate into requirement and scope documents? Decide on the best fitment of technologies/services that are available in scope? Create Solution for data ingestion and data transformation using Hadoop services like Spark, Spark streaming, Hive, etc.? Create technical design documents to communicate solutions to the team and mentor the team to develop the solution? Build the solution with Hadoop Services as per design specifications? Assist team teams to build test cases and support with testing the solution? Coordinate with Upstream, Downstream and other supporting teams for production implementation? Provide post-production support for Solutions implemented


Required Skill Set:

ETL data warehouse MS SSIS/SSRS IBM Netezza MS SQL server/Sybase database

Candidate should have strong working experience with Hadoop platform.

Strong hands-on experience on Hive, Spark with Scala.

In-depth knowledge and extensive experience in building batch workloads on Hadoop.

Adept in analyzing and refining requirements, consumption query patterns and choosing the right technology fit like RDBMS, data lake and data warehouse.

Should have knowledge of analytical data modelling on any of the RDBMS platform / Hive

Should have working experience in Pentaho? Proven practical experience in migrating RDBMS based data to Hadoop on-prem


Desired Skill Set:


Hadoop (Hive SQL and Pentaho ETL design)

AWS Cloud services (Spark, Redshift and EMR)

Knowledge in lending systems and functional knowledge on the same

Knowledge in MDM systems for customer demographics process

Knowledge in retail and commercial deposit system process (Core banking with Canadian banking domain)

Strong solution Knowledge in AWS Cloud and hands on experience with ETL process (like Kafka message processing, batch interface data injection and other business layer process)

Hands-on experience working with Terra bytes \ peta bytes scale data and millions of transactions per day.

Skills to develop ETL pipeline using Airflow

Knowledge of Spark streaming or any other streaming jobs

Ability to deploy code using AWS Code Pipeline and Bit bucket is an added plus

Expert in any of the following programming language: Scala, Java and comfortable with working on Linux platform.

Knowledge of Python.



Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodations during the recruitment and selection process, please inform Human Resource


Thank you for your interest in TCS. Candidates that meet the qualification for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.

  • Bigdata QA Automation Tester

    7 months ago

    Toronto, Canada themesoft Full time

    Hi Professionals; **This Thiru from Themesoft INC.** **Kindly let me know if you are interested in this opportunity** Job Title: Bigdata QA Automation tester. Job Location: Toronto Canada Duration:contract JD: **Must Have** - 9+ years’ experience as a Bigdata QA Automation tester. - Expert level hands on in Python development - must have - Knowledge...

  • Azure Bigdata Support Analyst

    7 months ago

    Toronto, Canada Tekshapers Software Solutions Pvt Ltd Full time

    Position: - Azure Bigdata Support Analyst Location: - Toronto Fulltime job description: - "Skills and Responsibilities: - Provide technical support and troubleshooting assistance to customers using Azure services. - Collaborate with development teams to identify and resolve product issues and improve customer experience. - Leverage Azure monitoring...

  • BigData Developer

    7 hours ago

    Toronto, Canada Tata Consultancy Services Full time

    Inclusion without ExceptionTCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • BigData Developer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Tata Consultancy Services Full time

    Inclusion without ExceptionTCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • Senior Platform Architect

    2 months ago

    Old Toronto, Canada Citigroup Inc. Full time

    Job Description:The Senior Lead Engineer is responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team.Key Responsibilities:Leadership and Collaboration: Partner with multiple management teams to ensure appropriate integration of functions to meet goals, as well as identify and...

  • ​ Senior Python Developer

    4 months ago

    Toronto, ON, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, ON, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, ON, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Python Developer

    4 months ago

    Toronto, Ontario, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Lead Engineer

    2 months ago

    Old Toronto, Canada Citigroup Inc. Full time

    h3>The Senior Lead Engineer is responsible for establishing and implementing new or revised application systems and programs in coordination with the Technology team. u>Partner with multiple management teams to ensure appropriate integration of functions to meet goals as well as identify and define necessary system enhancements to deploy new products and...

  • Data Analyst

    7 months ago

    Toronto, Canada Atlantis IT group Full time

    **Hello ,** **Hope you are doing good..!!!** **Role **:Data Analyst** **Location : Mississauga, ON**(hybrid),3days office** **Duration : Contract** Role name: Data Analyst Role Description: Managing Data Analyst role, Compare data and match against the requirement. Analyzing various source of data and compare with target data. Responsible & accountable...

  • BigData Tech Lead

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Tata Consultancy Services Full time

    Inclusion without ExceptionTCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • Functional Analyst Bilingual

    3 months ago

    Toronto, Canada Atlantis IT group Full time

    **Role**: Functional Analyst Bilingual (French & English) **location**: MISSISSAUGA, ONTARIO **Role Description**: 1. Supports code development for projects by participating in project team meetings to develop project plans; reviewing project requirements; providing insight to software developers regarding project quality requirements; and providing guidance...

  • Retail Business Analyst @ Mississauga, On

    1 month ago

    Toronto, Canada Atlantis IT group Full time

    Role - Retail Business Analyst Location - Mississauga, ON - Hybrid Duration - Long term **Role name**: Business Analyst **Role Description**: SN Responsibility of / Expectations from the Role 1 Strong SQL knowledge. Needs to be very data centric and someone that can dig through data and make decisions accordingly 2 Understanding the requirement from business...

  • Software Developer IV

    4 months ago

    Toronto, Canada Randstad Canada Full time

    Are you a Software Developer looking for a new opportunity?Are you looking for a new contract opportunity?We are pleased to offer you a new contract opportunity for you to consider: Software Developer-Start: ASAP-Estimated length: 6 months-Location: Toronto-Hybrid role- min. 2 days onsite per weekAdvantages· You will have an opportunity to work with a...

  • Technical Business Analyst

    7 months ago

    Toronto, Canada Compest Solutions Inc Full time

    Request-ID:33030-1 10+ years previous work experience as a Business or Data Analyst, or in a technical/functional Role Experience working on Risk Data projects (Agile methodologies), sourcing, standardization, and aggregation of risk in one of the functional risk areas such as Counterparty/Credit Risk Understanding of financial Instruments including...

  • Business Analyst

    7 months ago

    Toronto, Canada Atlantis IT group Full time

    **Hello ,** **Hope you are doing good..!!!** **Role : Business Analyst (BSA)** **Location : Mississauga, ON** **Duration : Contract(Hybrid)** Role name: Business Analyst Role Description: Managing Business Analyst role ,Responsible & accountable for doing requirement gathering and creation of high level and detailed Docs.. Analyzing various source of...