Data Pipeline Engineer

4 weeks ago

Vancouver BC, Canada Celestial Systems Full time

By designingreliable software,delivering quality services, and developing valuable partnerships, we are on a journey of continuousinnovation. Ourenterprise-level experience in engineering enables us to offer critical development services fororganizations to besuccessful in the digital ages. Whether its Frontend Development, Backend, DevOps, QA and Testing or CloudHosting, ourtailor-made technology solutions, provide answers to the problems.We are ISO certified enterprise-grade software company.
Celestial is rapidly expanding or Enterprise Data Services team to offer our customers a single point for all requirements including, Data Engineering, Data Analytics, Data Protection and Data Ethics/Governance.


We are looking for Senior Data Pipeline Engineers (multiple positions) for ongoing projects, within the Data Services and ML/AI Group. If you are motivated and willing to work in a startup mode on exciting NextGen projects do read on.


4+ years of experience in big data engineering, with a focus on Spark and SQL.


• 4+ Years Experience in developing Large-scale ETL Pipelines using AWS services not limited to IAM, Glue, Lambda, S3, Athena, SNS, SQS, DynamoDB, RDS, EMR, ECS, Route 53 and Redshift.


• Highly skilled in Python, PostgreSQL/RDS/Redshift, and writing complex SQL queries and analysis of data correlations.


• Design, construct, and manage Data Lake environments including Data ingestion, staging, Data quality monitoring, and business modeling, Data Schema Normalization, etc.


• Develop, construct, secure, test and maintain architectures (databases and large-scale processing systems)


• Design, develop and implement technical solutions in SQL environment (databases, SQL, data marts, integrations)


• Experience building data-driven unit test suites for data platforms and modeling highly dimensional datasets


• Strong functional understanding of Sagemaker, Jupyter and other Data Science tools on AWS


Experience designing and building big data architectures using tools such as Hadoop, Hive, or Kafka.


If you are applying for Part-time/Contract role please email your resume with contact details, and "Hourly Consulting Rate Expectations".

  • Staff Software Engineer, Data Pipeline

    4 weeks ago

    Vancouver, Canada Amplitude Full time

    Amplitude is a leading digital analytics platform that helps companies unlock the power of their products. More than 2,300 customers, including Atlassian, Jersey Mike’s, NBCUniversal, Shopify, and Under Armour, rely on Amplitude to gain self-service visibility into the entire customer journey. Amplitude guides companies every step of the way as they...

  • Lead Engineer

    12 hours ago

    Vancouver, BC, Canada Zonda Full time

    Job Title: Lead Engineer (Data)Location: Vancouver, BC / GVRDReports To: Director of Data EngineeringJob Summary:We are seeking a highly skilled and motivated individual to join our team as a Lead Engineer in Data Operation. As a Lead Engineer in Data Operations, you will be responsible for driving the development of modern data pipelines and solutions that...

  • Lead Engineer

    8 hours ago

    Vancouver, BC, Canada Zonda Full time

    Job Title: Lead Engineer (Data)Location: Vancouver, BC / GVRDReports To: Director of Data EngineeringJob Summary:We are seeking a highly skilled and motivated individual to join our team as a Lead Engineer in Data Operation. As a Lead Engineer in Data Operations, you will be responsible for driving the development of modern data pipelines and solutions that...

  • Data Engineer II

    12 hours ago

    Vancouver, BC, Canada Brooksource Full time €45 - €60

    Data Engineer IIVancouver, Canada – hybrid (3 days a week onsite) Long Term Contract $45 - $60 /hr. Who We Are: Our client is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people...

  • Data Engineer II

    8 hours ago

    Vancouver, BC, Canada Brooksource Full time €45 - €60

    Data Engineer IIVancouver, Canada – hybrid (3 days a week onsite) Long Term Contract $45 - $60 /hr. Who We Are: Our client is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support people...

  • Lead Engineer

    2 weeks ago

    Vancouver, BC, Canada Zonda Full time

    Job Title: Lead Engineer (Data) Location: Vancouver, BC / GVRD Reports To: Director of Data Engineering Job Summary: We are seeking a highly skilled and motivated individual to join our team as a Lead Engineer in Data Operation. As a Lead Engineer in Data Operations, you will be responsible for driving the development of modern data pipelines and...

  • Data Engineer II

    4 weeks ago

    Vancouver, BC, Canada Brooksource Full time

    Data Engineer II Vancouver, Canada – hybrid (3 days a week onsite) Long Term Contract $45 - $60 /hr. Who We Are: Our client is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support...

  • Lead Engineer

    2 weeks ago

    Vancouver, Canada Zonda Full time

    Job Title: Lead Engineer (Data) Location: Vancouver, BC / GVRD Reports To: Director of Data Engineering Job Summary: We are seeking a highly skilled and motivated individual to join our team as a Lead Engineer in Data Operation. As a Lead Engineer in Data Operations, you will be responsible for driving the development of modern data pipelines and...

  • Lead Engineer

    2 weeks ago

    Vancouver, Canada Zonda Full time

    Job Title: Lead Engineer (Data) Location: Vancouver, BC / GVRD Reports To: Director of Data Engineering Job Summary: We are seeking a highly skilled and motivated individual to join our team as a Lead Engineer in Data Operation. As a Lead Engineer in Data Operations, you will be responsible for driving the development of modern data pipelines and...

  • Lead Engineer

    2 weeks ago

    Vancouver, Canada Zonda Full time

    Job Title: Lead Engineer (Data) Location: Vancouver, BC / GVRD Reports To: Director of Data Engineering Job Summary: We are seeking a highly skilled and motivated individual to join our team as a Lead Engineer in Data Operation. As a Lead Engineer in Data Operations, you will be responsible for driving the development of modern data pipelines and...

  • Lead Engineer

    2 weeks ago

    Vancouver, Canada Zonda Full time

    Job Title:Lead Engineer (Data) Location:Vancouver, BC / GVRD Reports To:Director of Data EngineeringJob Summary: We are seeking a highly skilled and motivated individual to join our team as a Lead Engineer in Data Operation. As a Lead Engineer in Data Operations, you will be responsible for driving the development of modern data pipelines and solutions that...

  • Data Engineer

    3 weeks ago

    Vancouver, BC, Canada Capgemini Full time

    Python Data Modeling Building out Data Pipelines using Python Airflow

  • Data Engineer

    1 month ago

    Vancouver, BC, Canada Capgemini Full time

    Python Data Modeling Building out Data Pipelines using Python Airflow

  • Data Engineer II

    4 weeks ago

    Vancouver, Canada Brooksource Full time

    Data Engineer II Vancouver, Canada – hybrid (3 days a week onsite) Long Term Contract $45 - $60 /hr. Who We Are: Our client is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support...

  • Data Engineer II

    4 weeks ago

    Vancouver, Canada Brooksource Full time

    Data Engineer II Vancouver, Canada – hybrid (3 days a week onsite) Long Term Contract $45 - $60 /hr. Who We Are: Our client is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support...

  • Data Engineer II

    4 weeks ago

    Vancouver, Canada Brooksource Full time

    Data Engineer II Vancouver, Canada – hybrid (3 days a week onsite) Long Term Contract $45 - $60 /hr. Who We Are: Our client is an innovative performance apparel company for yoga, running, training, and other athletic pursuits. Setting the bar in technical fabrics and functional design, we create transformational products and experiences that support...

  • Project Manager

    2 weeks ago

    Vancouver, Canada ICES: Data, Discovery, Better Health Full time

    OVERVIEW The Project Manager is responsible for completing, planning, coordinating and managing all project related for Engineering or EPC projects. The incumbent will provide project management to promote the successful execution of projects with a focus on cost efficiency, constructability and schedule. The incumbent will provide project management to...

  • Project Manager

    5 days ago

    Vancouver, Canada ICES: Data, Discovery, Better Health Full time

    OVERVIEW The Project Manager is responsible for completing, planning, coordinating and managing all project related for Engineering or EPC projects. The incumbent will provide project management to promote the successful execution of projects with a focus on cost efficiency, constructability and schedule. The incumbent will provide project management to...

  • Project Manager

    4 weeks ago

    Vancouver, Canada ICES: Data, Discovery, Better Health Full time

    OVERVIEW The Project Manager is responsible for completing, planning, coordinating and managing all project related for Engineering or EPC projects. The incumbent will provide project management to promote the successful execution of projects with a focus on cost efficiency, constructability and schedule. The incumbent will provide project management to...

  • Project Manager

    4 weeks ago

    Vancouver, Canada ICES: Data, Discovery, Better Health Full time

    OVERVIEW The Project Manager is responsible for completing, planning, coordinating and managing all project related for Engineering or EPC projects. The incumbent will provide project management to promote the successful execution of projects with a focus on cost efficiency, constructability and schedule. The incumbent will provide project management to...