Databricks Developer

4 days ago


Toronto Ontario, Ontario, Canada Tata Consultancy Services Full time

Inclusion without Exception:


Tata Consultancy Services (TCS) is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity is reflected in our people stories across our workforce and implemented through equitable workplace policies and processes.

About TCS:


TCS is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive-powered portfolio of business, technology, and engineering services and solutions is delivered through its unique Location Independent Agile™ delivery model, recognized as a benchmark of excellence in software development. A part of the Tata group, India's largest multinational business group, TCS employs over 612,000 of the world’s best-trained consultants in 55 countries. The company generated consolidated revenues of US $29 billion in the fiscal year ended March 31, 2024,[BS1] and is listed on the BSE and the NSE in India. TCS' proactive stance on climate change and award-winning work with communities across the world have earned it a place in leading sustainability indices such as the MSCI Global Sustainability Index and the FTSE4Good Emerging Index.

Required Skills:


* Proficiency in Databricks and Apache Spark.

* Experience with one or more cloud platforms (Azure Data Lake, AWS S3, GCP BigQuery).

* Strong programming skills in Python, Scala, or Java.

* Proficiency in SQL for data querying and manipulation.

* Familiarity with data orchestration tools like Apache Airflow or Azure Data Factory.

* Data Expertise:

* Knowledge of big data technologies (Delta Lake, Hive, Kafka).

* Understanding of data modeling, warehousing, and database concepts.

* Soft Skills:

* Strong analytical and problem-solving skills.

* Excellent communication and teamwork abilities.

* Databricks certifications (e.g., Databricks Certified Data Engineer).

* Experience with machine learning frameworks and Databricks MLflow.

* Exposure to REST APIs for data integration.

* Knowledge of CI/CD tools like Jenkins, GitHub Actions, or Azure DevOps.


Roles and responsibilities:


1. Design, develop, and deploy ETL pipelines using Databricks.

* Implement end-to-end data solutions, including ingestion, transformation, and storage.

* Utilize Apache Spark within Databricks for large-scale data processing.

2. Platform Expertise:

* Develop solutions on Databricks integrated with cloud platforms (Azure, AWS, or GCP).

* Optimize Databricks clusters and workflows for performance and cost efficiency.

3. Collaboration:

* Work closely with data scientists, analysts, and stakeholders to understand business requirements.

* Collaborate with DevOps teams for CI/CD pipeline integration and automation.

4. Data Governance & Security:

* Implement and maintain data security and compliance measures.

* Ensure data quality and reliability using robust validation techniques.

5. Troubleshooting & Support:

* Monitor, troubleshoot, and resolve issues in Databricks workflows and pipelines.

* Stay updated on platform upgrades, best practices, and new features.


Tata Consultancy Services Canada Inc. is committed to meeting the accessibility needs of all individuals in accordance with the Accessibility for Ontarians with Disabilities Act (AODA) and the Ontario Human Rights Code (OHRC). Should you require accommodations during the recruitment and selection process, please inform Human Resources.

Thank you for your interest in TCS. Candidates that meet the qualifications for this position will be contacted within a 2-week period. We invite you to continue to apply for other opportunities that match your profile.


  • Databricks Developer

    1 month ago


    Toronto, Ontario, Ontario, Canada Atlantis IT Group Full time

    Role name: Developer Role Description: Databricks Developer Competencies: Digital : Databricks Experience (Years): 6-8 Essential Skills: Databricks Developer Desirable Skills: Databricks Developer Country: Canada Branch | City | Location: TCCI - Canada TORONTO BRAMPTON, ONTARIO


  • Toronto, Ontario, Canada Paralucent Full time

    We are seeking a highly skilled Databricks ETL Developer to join our team at Paralucent in Toronto. This is a 5-month contract position with the possibility of yearly extension.As a Databricks ETL Developer, you will be responsible for designing, developing, and implementing scalable data pipelines using Databricks and related tools. Your primary focus will...


  • Toronto, Ontario, Canada Paralucent Full time

    We are seeking an experienced Databricks ETL engineer to support our data warehousing, data lakes, and analytics initiatives. As a key member of our team, you will be responsible for designing, developing, and maintaining efficient ETL pipelines using Databricks and related tools.Key ResponsibilitiesDesign and implement scalable ETL processes to ingest,...


  • Toronto, Ontario, Canada Maarut Inc Full time

    Job SummaryWe are seeking a highly skilled Senior Software Developer to join our team at Maarut Inc. as an Azure Databricks Expert. The successful candidate will be responsible for designing, developing, and maintaining business intelligence and reporting solutions using Microsoft Azure data analytics tools.Key ResponsibilitiesDesign and develop BI...


  • Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Azure Databricks Role OverviewAstra North Infoteck Inc. is seeking an experienced Azure Databricks Architect to help us design and implement data processing pipelines. The successful candidate will have extensive experience with Azure Data Factory, Databricks, and Pyspark based data processing.Key ResponsibilitiesDesign and implement data processing...


  • Toronto, Ontario, Canada Fluent, LLC Full time

    About the RoleWe are seeking a highly skilled Databricks Expert Software Engineer to join our team at Fluent, LLC. This is an exciting opportunity to work on building data products that power our business lines.ResponsibilitiesYou will be responsible for developing, deploying, and managing scalable pipelines on Databricks, ensuring robust integration with a...


  • Toronto, Ontario, Canada Maarut Inc Full time

    Job DescriptionWe are seeking a highly skilled Full Stack Senior Developer with expertise in Microsoft ASP .NET Python Javascript and Azure Cloud technologies. The ideal candidate will have experience in building debugging and optimizing performance in web applications as well as hands-on experience with Azure Databricks.Key Responsibilities:Develop, debug,...

  • Senior Data Engineer

    1 month ago


    Toronto, Ontario, Canada Rubicon Path Full time

    As a Senior Data Engineer at Rubicon Path, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Databricks and Python. Your expertise in ETL tools, such as Microsoft SSIS, and strong knowledge of Delta Lake for data management and optimization, will be crucial in ensuring the efficient transformation and...


  • Toronto, Ontario, Canada Fluent, LLC Full time

    About FluentAt Fluent, we're revolutionizing the advertising industry with cutting-edge technology and innovative solutions. Our goal is to build a seamless and relevant experience for online shoppers, leveraging machine learning and artificial intelligence to drive business growth.Job OverviewWe're seeking an experienced Data Engineer to join our team,...


  • Toronto, Ontario, Canada Fluent, LLC Full time

    Job Description:A Senior Data Engineer opportunity has arisen at Fluent, LLC, a high-flying performance marketing company. As part of our team, you will play a crucial role in building data products to power our business lines using your expertise in Databricks pipeline development.The successful candidate will be responsible for developing, deploying, and...


  • Toronto, Ontario, Canada Fluent, LLC Full time

    Fluent, LLC is revolutionizing the advertising industry with its cutting-edge technology. As a Data Engineer at Fluent, you will play a crucial role in building and operating high-impact data solutions that drive business growth.The ideal candidate will have extensive experience in software engineering, with expertise in Databricks and Spark. You will work...

  • ETL Developer

    1 month ago


    Toronto, Ontario, Ontario, Canada TEEMA Full time

    ETL Developer4+ months contract3 days onsite per week is required/Toronto LocationMust Haves:10 years using ETL tools such as Microsoft SSIS, stored procedures, T-SQL 2+ Delta Lake, Databricks and Azure Databricks pipelinesStrong knowledge of Delta Lake for data management and optimization.Familiarity with Databricks Workflows for scheduling and...


  • Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job DescriptionAzure Data Analyst - Azure Data Lake, Data Factory, DataBricks Key Responsibilities• Analyze large-scale data sets stored in Azure Data Lake using DataBricks and Azure Data Factory• Design and develop data integration pipelines using Azure Data Factory, DataBricks, and Python• Collaborate with cross-functional teams to identify business...


  • Toronto, Ontario, Canada Maarut Inc Full time

    About the RoleMaarut Inc is seeking a highly skilled Data Engineer to join our team. The ideal candidate will have extensive experience in designing, developing, and implementing ETL pipelines using Databricks and related tools.The successful candidate will be responsible for creating high-quality ETL mappings/scripts/notebooks, developing data pipelines...

  • ETL Developer

    2 weeks ago


    Toronto, Ontario, Ontario, Canada 2iSolutions Inc. Full time

    Our Toronto client is looking for an Intermediate ETL Software Developer in Toronto, this is a Hybrid role.Period: 4 monthsStart Date: 2025-01-06End Date: 2025-04-05Location: 277 Front Street WestWorking Hrs.: 7.25 Hrs. / dayNote: Hybrid – 2 times per week onsite Must Have:5+ years’ experience with Microsoft Azure Synapse Analytics5+ years’ experience...


  • Toronto, Ontario, C6A, Ontario, Canada State Street Full time

    Who we are looking forThis is a hands-on Data Engineer position in State Street Global Technology Services. We are looking for candidate with good knowledge on Bigdata technology and strong development experience with Databricks. You will help to migrate existing on-prem applications to cloud (Azure preferred), create and maintain new data applications...

  • Developer

    6 days ago


    Toronto, Ontario, Ontario, Canada Tata Consultancy Services Full time

    Inclusion without Exception:TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • Azure Developer

    1 week ago


    Toronto, Ontario, Ontario, Canada Virtual Labs IT Consulting Full time

    Undergraduate Degree or Technical Certificate.A minimum of 5 years experience with large SQL data marts. Expert relational database experience, Canditate should demonstrat ability to navigate through massive volumes of data to deliver effective and efficient data extraction, design, load, and reporting solutions to business partners, Strong knowledge of...


  • Toronto, Ontario, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Azure Data Engineer

    1 month ago


    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    About the RoleAstra North Infoteck Inc. is seeking a highly skilled Azure Data Analyst to lead our big data initiatives and drive business growth through data-driven insights. As a key member of our team, you will be responsible for designing, implementing, and maintaining large-scale data solutions on Azure Data Lake, Azure Data Factory, and DataBricks...