Senior Data Engineer

2 weeks ago

Greater Vancouver Metropolitan Area, Canada Capgemini Full time

The Tech Lead, Data Engineering

Position Overview:

We are seeking a highly skilled, experienced and hands-on Senior Data Engineer to serve as a Tech Lead in a critical data implementation project. The ideal candidate will have 7 to 10 years of experience in ETL, Databricks, Python, Spark, and SQL databases and a strong understanding of data ingestion, transformation, and implementation in complex environments. This role requires expertise in DevOps and CI/CD for data, advanced SQL and Python programming skills, and hands-on experience with modern data engineering tools and architectures.

Responsibilities:

  • Serve as a Tech Lead in a data implementation project, guiding architecture decisions and best practices.
  • Design, build, and optimize ETL/ELT pipelines for batch and streaming data using Databricks, PySpark, Python, and SQL .
  • Implement dimensional modeling and database normalization techniques for efficient data storage and retrieval.
  • Lead database development, including DDL and DML scripting, query optimization, and performance profiling across platforms like Spark, PostgreSQL, and Databricks SQL .
  • Support the Development and maintaining of CI/CD pipelines for data workflows using Terraform, Kubernetes, Argo, or Cross Plane .
  • Work with DBT to manage models, seeds, environments, macros, unit tests, and incremental materialization .
  • Implement data versioning and migration strategies using Alembic (preferred), Flyway, or Liquibase .
  • Optimize data ingestion and transformation for structured and unstructured data sources.
  • Design and implement real-time streaming solutions using Azure EventHub or similar.
  • Manage infrastructure as code and containerized environments with Docker and Kubernetes .
  • Monitor, troubleshoot, and optimize workflows using logging and querying tools like KQL (Azure) or similar .
  • Collaborate with data scientists, analysts, and business teams to ensure data solutions align with business needs.

Skills & Qualifications:

  • Expertise in Python : Strong proficiency, unit testing experience, and deep knowledge of libraries such as Pandas, NumPy, SQLAlchemy, and Alembic .
  • Advanced SQL skills : Proficiency in CTEs, subqueries, joins, window functions (e.g., LAG), indexing strategies, and performance tuning .
  • Databricks Experience : Proficiency with Workflows/Jobs, Clusters, SQL Warehouse, Unity Catalog, performance profiling, and log analysis .
  • Spark Expertise : Hands-on experience with PySpark, Spark SQL, batch and streaming processing, delta tables, and parquet .
  • Database Proficiency : Strong understanding of PostgreSQL (queries, indexes, JSON columns), SQL and NoSQL database selection .
  • Dimensional Modeling & Data Architecture : Deep knowledge of fact/dimension tables and normalization (Normal Form) .
  • Streaming Data Processing : Experience with Azure EventHub or equivalent streaming technologies .
  • DevOps & CI/CD for Data : Experience with Kubernetes, Terraform, Argo, and Cross Plane for infrastructure as code.
  • Data Testing & Quality : Familiarity with unit tests, data tests, and snapshots in DBT .
  • Logging & Monitoring : Ability to query logs using KQL (Azure) or similar tools .

Life at Capgemini

Capgemini supports all aspects of your well-being throughout the changing stages of your life and career. For eligible employees, we offer:

  • Collaborating with teams of creative, fun, and driven colleagues
  • Flexible work options enabling time and location-based flexibility
  • Company-provided home office equipment
  • Virtual collaboration and productivity tools to enable hybrid teams
  • Comprehensive benefits program (Health, Welfare, Retirement and Paid time off)
  • Other perks and wellness benefits like discount programs, and gym/studio access.
  • Paid Parental Leave and coaching, baby welcome gift, and family care/illness days
  • Back-up childcare/elder care, childcare discounts, and subsidized virtual tutoring
  • Tuition assistance and weekly hot skill development opportunities
  • Experiential, high-impact learning series events
  • Access to mental health resources and mindfulness programs
  • Access to join Capgemini Employee Resource Groups around communities of interest

About Capgemini

Capgemini is a global business and technology transformation partner, helping organizations to accelerate their dual transition to a digital and sustainable world, while creating tangible impact for enterprises and society. It is a responsible and diverse group of 340,000 team members in more than 50 countries. With its strong over 55-year heritage, Capgemini is trusted by its clients to unlock the value of technology to address the entire breadth of their business needs. It delivers end-to-end services and solutions leveraging strengths from strategy and design to engineering, all fueled by its market leading capabilities in AI, cloud and data, combined with its deep industry expertise and partner ecosystem. The Group reported 2023 global revenues of €22.5 billion

  • Senior Data Engineer

    2 weeks ago

    Greater Ottawa Metropolitan Area, Canada LeverageTek Staffing Solutions Full time

    LeverageTek is actively seeking a Senior Data Engineer for a 12-month contract with it's Ottawa based customer.Work Location:RemoteKey TasksProven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.Experience in developing and proposing...

  • Senior Data Engineer

    3 weeks ago

    Greater Ottawa Metropolitan Area, Canada LeverageTek Staffing Solutions Full time

    LeverageTek is actively seeking a Senior Data Engineer for a 12-month contract with it's Ottawa based customer.Work Location:RemoteKey TasksProven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.Experience in developing and proposing...

  • Senior Data Engineer

    2 weeks ago

    Greater Ottawa Metropolitan Area, Canada LeverageTek Staffing Solutions Full time

    LeverageTek is actively seeking a Senior Data Engineer for a 12-month contract with it's Ottawa based customer. Work Location: Remote Key Tasks Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards. Experience in developing and...

  • Senior Data Engineer

    2 weeks ago

    Greater Toronto Area, Canada Found People Inc. Full time

    Job Description Our client, an ambitious and growing company in the financial services space is looking for a Senior Data Engineer. This is an exciting opportunity to shape a modern, cloud-native data infrastructure that powers mission-critical decision-making across the organization. What You'll Do: Architect and implement scalable data pipelines and...

  • Senior Data Engineer

    2 weeks ago

    Greater Toronto Area, Canada Found People Inc. Full time

    Job DescriptionOur client, an ambitious and growing company in the financial services space is looking for a Senior Data Engineer.This is an exciting opportunity to shape a modern, cloud-native data infrastructure that powers mission-critical decision-making across the organization.What You'll Do:Architect and implement scalable data pipelines and...

  • Senior Data Engineer

    3 weeks ago

    greater ottawa metropolitan area, canada | ca LeverageTek Staffing Solutions Full time

    LeverageTek is actively seeking a Senior Data Engineer for a 12-month contract with it's Ottawa based customer.Work Location:RemoteKey TasksProven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.Experience in developing and proposing...

  • Senior Data Engineer

    4 days ago

    Vancouver, British Columbia, Canada Capgemini Full time

    **Job Description:**Career Opportunity for a Senior Data Engineer at Capgemini.We are seeking a highly skilled and experienced Senior Data Engineer to serve as a Tech Lead in a critical data implementation project. The ideal candidate will have 7 to 10 years of experience in ETL, Databricks, Python, Spark, and SQL databases and a strong understanding of data...

  • Azure Data Engineering Specialist

    1 week ago

    Greater Vancouver Metropolitan Area, Canada Capgemini Full time

    About the Role: We are looking for an experienced Azure Fabric Data Engineer to join our team in Vancouver or Calgary. As a key member of our team, you will be responsible for architecting, designing, and implementing ETL processes to ingest data from various sources into Unity Catalog. Your expertise in using notebooks to write code in PySpark, SparkR, or...

  • Data Engineer

    1 week ago

    Greater Vancouver Metropolitan Area, Canada Capgemini Full time

    Company Overview: Capgemini is a global business and technology transformation partner, helping organizations to accelerate their digital transformation while creating tangible impact for enterprises and society.Job Description: We are seeking an experienced Azure Fabric Data Engineer to work on hybrid projects from our offices in Vancouver or Calgary. As a...

  • Senior Data Engineer

    4 weeks ago

    Vancouver, British Columbia, Canada BURGEON IT SERVICES Full time

    Senior Data Engineer – Vancouver, Canada_Hybrid Duration: 6 months Experience: 8-10 years Location: Vancouver, Canada_Hybrid Job Description: We are seeking a senior data engineer for an immediate requirement with Lululemon . This is a hybrid role requiring strong technical expertise in data engineering and integration. Key Skills...

  • Senior Data Engineer

    4 weeks ago

    Vancouver, British Columbia, Canada Ampstek Full time

    Title: Senior Data Engineer (Snowflake, Databricks, Azure) Location: Vancouver, Canada (Onsite) Long-Term Contract. Job Description: Technically strong Senior Data Engineer for an onsite role in Vancouver, Canada with the following skill set: - Strong expertise in Snowflake, Azure SQL services, and Databricks. - Experience in data integration to...

  • Azure Fabric Data Engineer

    2 weeks ago

    Greater Vancouver Metropolitan Area, Canada Capgemini Full time

    The Azure Fabric Data Engineer will work hybrid from our Vancouver or Calgary office. No relocation will be provided, only hiring local candidates.Responsibilities• Architect, design and implement ETL (Extract, Transform, Load) processes to ingest data from various sources into Unity Catalog experience/knowledge is a strong asset• Use notebooks to write...

  • Azure Fabric Data Engineer

    1 week ago

    Greater Vancouver Metropolitan Area, Canada Capgemini Full time

    The Azure Fabric Data Engineer will work hybrid from our Vancouver or Calgary office. No relocation will be provided, only hiring local candidates. Responsibilities • Architect, design and implement ETL (Extract, Transform, Load) processes to ingest data from various sources into Unity Catalog experience/knowledge is a strong asset • Use notebooks to...

  • Data Engineering Lead

    1 week ago

    Greater Vancouver Metropolitan Area, Canada Capgemini Full time

    Job DescriptionWe are seeking an experienced Data Engineering Lead to join our team at Capgemini.About the RoleThis is a critical data implementation project requiring expertise in ETL, Databricks, Python, Spark, and SQL databases.The ideal candidate will have 7 to 10 years of experience and a strong understanding of data ingestion, transformation, and...

  • Data Platform Engineer

    3 weeks ago

    Greater Montreal Metropolitan Area, Canada HRConnects Full time

    Join the C3 Data Warehouse team with one of our Investment Banking clients We are building a next-generation data platform that centralizes data from various technology systems to empower advanced reporting and analytics for the Technology Risk functions.Role Summary:As a Python/Pyspark Data Platform Engineer, you'll play a vital role in developing a unified...

  • Senior Data Architect

    1 week ago

    Greater Vancouver Metropolitan Area, Canada Capgemini Full time

    About the JobAs a Senior Data Architect, you will play a key role in designing and implementing scalable data solutions at Capgemini.Key ResponsibilitiesLead database development, including DDL and DML scripting, query optimization, and performance profiling across platforms like Spark, PostgreSQL, and Databricks SQL.Support the Development and maintaining...

  • Senior Platform Infrastructure Engineer

    6 days ago

    Vancouver, British Columbia, Canada NTT DATA North America Full time

    We are seeking a highly skilled Senior Platform Infrastructure Engineer to join our team in Vancouver, British Columbia (CA-BC), Canada (CA). As a key member of our engineering team, you will be responsible for designing, deploying, and optimizing cloud-native solutions on the Microsoft Azure platform.About the RoleThis senior-level position requires a...

  • Senior Data Validation Engineer

    1 day ago

    Vancouver, British Columbia, Canada Net2Source Inc. Full time

    Net2Source Inc. is seeking a Senior Data Validation Engineer to join our team. As a key member of our data engineering team, you will be responsible for developing and maintaining data validation frameworks and ensuring the accuracy and integrity of our data systems.Responsibilities:Develop and maintain data validation frameworks and best...

  • Senior Analytics and Data Engineer

    2 weeks ago

    Vancouver, British Columbia, Canada Rivian Full time

    Join or sign in to find your next jobJoin to apply for the Staff Analytics and Data Engineer role at Rivian2 weeks ago Be among the first 25 applicantsR | V Tech's Core Data Team is searching for a talented Analytics and Data Engineer or a Senior Analytics and Data Engineer to design and implement scalable Extract, Load, Transform (ELT) pipelines, develop...

  • Senior VP of Engineering

    2 weeks ago

    Greater Regina Metropolitan Area, Canada Advantage Technical Full time

    Senior Vice President (SVP) of Engineering Direct Hire Location: Preferred in Irving/DFW or Houston, TX; Regina, Canada; Chicago, IL; or Nashville, TN. Overview This role bridges senior leadership with regional execution, shaping operational and sales strategies while making Engineering a core service offering. Qualifications Education: Bachelor's in...