Current jobs related to Big Data Engineer - Canada - Capgemini Engineering

  • Big Data Expert

    3 days ago


    Canada Luxoft Full time

    Luxoft is a leading provider of software development and consulting services, leveraging expertise in modern technologies to deliver complex solutions. We are currently seeking a talented Big Data Developer to join our team in Pune.Job DescriptionThe successful candidate will work closely with other teams globally to develop new functionality for our...


  • Canada OptiSource Ltd Full time

    Company Overview">OptiSource Ltd is a professional and agile organization with a strong focus on innovation.">Job Description">We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and maintenance of data pipelines, data stores, and infrastructure.">Responsibilities include:">">Building entity extraction...

  • Big Data Developer

    3 days ago


    Canada Luxoft Full time

    Project Description: During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals. We are looking for a number of talented developers, who would like to...

  • Big Data Developer

    1 week ago


    Canada Luxoft Full time

    Project Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...

  • Big Data Developer

    6 days ago


    Canada Luxoft Full time

    Project Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...

  • Big Data Engineer

    7 days ago


    Canada Sage Recruiting Full time

    Why Join Our TeamWe're on a mission to empower individuals to take control of their financial lives. As a Senior Data Engineer, you'll play a critical role in designing, implementing, and optimizing our data infrastructure and pipelines.Your Key ResponsibilitiesDesign and develop complex Python and SQL queries.Build and maintain ETL processes and data...


  • Canada Data Elephant Full time

    About UsWe're a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms and unlock the power of data, analytics, ML and GenAI. As a certified partner with leading cloud platforms, including AWS, Azure and Databricks, we deliver strategic solutions that create...

  • Data Engineer

    2 weeks ago


    Canada Summer Full time

    Title: Data EngineerLocation: Remote CanadaAbout this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the success...

  • Data Engineer

    2 weeks ago


    Canada Summer Full time

    Title: Data Engineer Location: Remote Canada About this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the...


  • Canada Luxoft Full time

    Project Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...


  • Canada Data Elephant Full time

    About Data ElephantWe're a boutique data and analytics consulting firm based in Vancouver, BC, helping Canadian organizations develop data strategies, modernize their data platforms, and unlock the power of data, analytics, ML, and GenAI.Our MissionWe deliver strategic solutions that create real business impact. Our team thrives on solving complex...


  • Canada Luxoft Full time

    About Us:Luxoft is a leading provider of software development services and innovative digital solutions.Job Description:We are seeking an experienced Data Engineering Specialist to join our team. The ideal candidate will have a strong background in big data technologies and be able to design, develop, and deploy scalable data systems.Responsibilities:Design,...


  • Canada Soho Square Solutions Full time

    About Soho Square Solutions:We are a company that specializes in providing high-quality solutions to clients. Our team is dedicated to delivering exceptional results and building long-lasting relationships.Job Description:We are seeking a skilled Big Data Consultant to join our team. The ideal candidate will have experience working with big data...


  • Canada OptiSource Ltd Full time

    Company Overview">We are a fast-growing, agile company with existing funded contracts. Our goal is to excel in the data engineering field.">Job Description">We seek a talented Data Engineer to play a crucial role in designing, developing, and maintaining data pipelines, data stores, and infrastructure to support data analytics and machine learning...


  • Canada Tredence Inc. Full time

    Job SummaryTredence Inc. is seeking a highly skilled Databricks Architect to design, implement, and optimize data solutions on the Databricks platform.About the RoleCollaborate with stakeholders to understand business needs and translate them into technical requirements.Design and develop end-to-end data architecture solutions on the Databricks platform.Lead...

  • Big Data Consultant

    2 days ago


    Canada Soho Square Solutions Full time

    Hi There we're seeking exceptional talent like you to join our team. I came across your profile on LinkedIn. I have a great position that matches your goals. Soho Square Solutions is currently looking for a Big Data Expert to join our team on a Contract basis. , Skills: JAVA, AZURE, SPARK and AKS - KUBERNETES This Contract role will be 3 days Onsite a...

  • Data Engineer

    3 weeks ago


    Canada KData AI Full time

    Company DescriptionKData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. Follow us on Twitter: @KDataAI.Role DescriptionThis is a full time role for a Data Engineer....

  • Data Engineer

    2 weeks ago


    Canada KData AI Full time

    Company DescriptionKData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. Follow us on Twitter: @KDataAI.Role DescriptionThis is a full time role for a Data Engineer....

  • Data Engineer Lead

    1 week ago


    Canada Compass Digital Full time

    The Tech Lead, Data Engineer will work closely to lead a pod of Data Engineers to build out new and maintain existing ETL pipelines in Airflow, along with building and maintain data API's. They will be part of our Data Technology team working with an all-new technology stack, working closely in collaboration with internal and external stakeholders.Now, if...

  • Data Engineer

    2 days ago


    Canada Haptiq Full time

    Overview Haptiq Technology and Solutions, a leader in uniting companies and their investors through innovative technology, is looking for a Principal Fullstack Engineer to join our dynamic team in Canada. Haptiq excels in transforming potential into tangible performance, offering a suite of meticulously designed software solutions that cater to a wide...

Big Data Engineer

2 weeks ago


Canada Capgemini Engineering Full time
Responsibilities
We are seeking a highly skilled Senior Software Engineer to join our team at Capgemini Engineering. In this role, you will be responsible for:

• Obtaining tasks from the project lead or Team Lead (TL) and preparing functional and design specifications
• Ensuring that assigned area/areas are delivered within set deadlines and required quality objectives
• Providing estimations, agreeing task duration with the manager and contributing to project plan of assigned area
• Evaluating existing data systems and developing best practices for data coding to ensure consistency within the system
• Updating and optimizing local and metadata models
• Evaluating implemented data systems for variances, discrepancies, and efficiency
• Troubleshooting and optimizing data systems
• Understanding the business drivers and analytical use-cases and translating these to data products
• Designing, implementing, and maintaining pipelines that produce business-critical data reliably and efficiently using cloud technology
• Addressing area-level risks and providing mitigation plans
• Reporting about area readiness/quality and raising red flags in crisis situations
• Initiating and conducting code reviews and creating code standards, conventions, and guidelines
• Suggesting technical and functional improvements to add value to the product
• Constantly improving his/her professional level and collaborating with other teams
• Design and implement Fine Grained Access Control system for Client's big data platform (Spark, Flink, PyTorch, Ray and other ML/AI frameworks)
• Improve and customize the internals of open source Spark to meet our challenges at scale and actively participate in open source community
• Build and scale big data processing frameworks and infrastructure to process petabytes-scale datasets