Senior Data Engineer

4 weeks ago


Ottawa, Canada CB Canada Full time

Senior Data Engineer

On behalf of our public sector client, we are seeking a Senior Data Engineer. Remote work at present. Onsite work in Ottawa may be required at a later date.


Job Description:

The Senior Data Engineer Service Provider will be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with stakeholders to achieve the best results for our clients.


Primary Responsibilities:

  • Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.
  • Experience in developing and proposing data models that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.
  • Experienced collaboration working with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements


Must Have:

  • Increase the overall speed in which data is onboarded to the Data and Analytics platform.
  • Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform
  • Increase the overall quality of data pipeline development through DevSecOps
  • Programming experience in Spark using modern languages such as Scala
  • Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes
  • Experience leading Data Engineering principles within an organization/team.
  • Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.
  • Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm
  • Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase
  • Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus


Assets:

  • Experience within Azure environment
  • Strong Scala and Spark experience
  • Experience modernizing data platforms.
  • 2 to 3 projects developing Data Vault


Duration:12 months



  • Ottawa, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...


  • Ottawa, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...


  • Ottawa, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...


  • Ottawa, Canada SegmentStream LTD Full time

    We are looking for a Senior Data Engineer to join the core product development team of SegmentStream and own the data & ETL architecture of our next-generation marketing analytics platform.If you are really passionate about AI & ML, enjoy working with the latest data technologies and tools, and want to make a great impact on our global success, you found the...


  • Ottawa, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to...


  • Ottawa, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to...


  • Ottawa, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to...


  • Ottawa, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement to...

  • Sr. Data Engineer

    4 weeks ago


    Ottawa, Canada Brainhunter Full time

    Senior Data Engineer - #61271About the Job: Mindwire is currently seeking a Senior Data Engineer to work for our valued Crown Corporation client.This position is remote however the consultant may be required to go on-site one-two times throughout the contract duration. Responsibilities: Proven design, build and implementation of batch and real-time data...


  • Ottawa, ON, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement...


  • Ottawa, ON, Canada S.i. Systems Full time

    Senior Data Engineer Job Description: Our public sector client is looking for a Senior Data Engineer to develop data connections and processes for data models within an existing data infrastructure. Our client is modernizing its IM/IT environment to support digital operations and enable technology excellence in service to Canadians. There is a requirement...

  • Data Engineer

    3 weeks ago


    Ottawa, Canada CGI Full time

    Position Description: Security clearance: Reliability Clearance a MUST Location: Ottawa, ON Remote: Yes Are you a data engineering professional interested in working within a talented and collaborative team developing Cloud, Data, and AI solutions for leading global clients? Do you often find yourself in discussions about disparate and scattered...

  • Data Engineer

    3 days ago


    Ottawa, Canada Knewin Full time

    We are looking for an Intermediate Data Engineer to join our team! We are seeking a talented Data Engineer to contribute to the development and optimization of our payment processing systems. As an Intermediate Data Engineer, you will play a crucial role in designing, implementing, and maintaining data About the company PayFacto thinks and develops payment...

  • Data Engineer

    3 days ago


    Ottawa, Canada Knewin Full time

    We are looking for an Intermediate Data Engineer to join our team! We are seeking a talented Data Engineer to contribute to the development and optimization of our payment processing systems. As an Intermediate Data Engineer, you will play a crucial role in designing, implementing, and maintaining data About the company PayFacto thinks and develops payment...

  • Data Engineer

    3 days ago


    Ottawa, Canada Knewin Full time

    We are looking for an Intermediate Data Engineer to join our team! We are seeking a talented Data Engineer to contribute to the development and optimization of our payment processing systems. As an Intermediate Data Engineer, you will play a crucial role in designing, implementing, and maintaining data About the company PayFacto thinks and develops payment...

  • Data Engineer

    4 days ago


    Ottawa, Canada Knewin Full time

    We are looking for an Intermediate Data Engineer to join our team! We are seeking a talented Data Engineer to contribute to the development and optimization of our payment processing systems. As an Intermediate Data Engineer, you will play a crucial role in designing, implementing, and maintaining data About the company PayFacto thinks and develops payment...


  • Ottawa, Canada Groom & Associates(es) Full time

    Senior Mechanical EngineerThis company delivers products and services into the naval and military defence and transport markets alongside performing specialist research and providing services, including training and product support. In the maritime domain, this companys engineering capabilities cover a wide range of maritime mission systems requirements,...


  • Ottawa, Canada Groom Associes Full time

    This company delivers products and services into the naval and military defence and transport markets alongside performing specialist research and providing services, including training and product support. In the maritime domain, this company's engineering capabilities cover a wide range of maritime mission systems requirements, including communications,...

  • Data Engineer

    4 weeks ago


    Ottawa, Canada Brainhunter Full time

    Data Engineer - #61261About the Job: Mindwire is currently seeking a Data Engineer to work for our valued Crown corporation client.The position is remote with the option of a Hybrid work environment (Ottawa/Toronto). Responsibilities: Converts historical data from SAS database to Parquet. Works closely with teams to develop and transition ongoing production...

  • Senior AI/ML Engineer

    18 hours ago


    Ottawa, Canada Lrostaffing Full time

    Senior AI Data Scientist - Permanent - 17083 1 day ago Be among the first 25 applicants About The OpportunityWe are currently recruiting for a Senior AI Data Scientist for our well-reputed west-end client. HQ'd in Kanata, this software company has several offices worldwide to serve their global client base. This individual will be the lead Data...