Senior Data Engineer

7 days ago

Ottawa, Ontario, Canada Newport Williams Full time

Our Crown client is need of a Senior Data Engineer for a
12 month contract.
This is a remote opportunity but candidate must reside in Canada and have
Enhanced Reliability Security
clearance or higher. (ie. Top Secret Clearance)

Enhanced Reliability Status or higher is required.

Description of Service

The Senior Data Engineerwill be responsible for leading the delivery of data on data and analytics platform. These services are at the forefront of building out data engineering practice cloud-native technologies. The Senior Data Engineer Service Provider must have experience in leading, designing, implementing, and collaborating with stakeholders to achieve the best results for our clients.

Primary Responsibilities


•Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards.


•Experience in developing and proposing design patterns that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards.


•Experienced collaboration working with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirements

Specific Project Requirements


•Increase the overall speed in which data is onboarded to the Data and Analytics platform.


• Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform


• Increase the overall quality of data pipeline development through DevSecOps

Skills

Top Skills Required:


• Programming experience in Spark using modern languages such as Python, Scala


• Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes


• Experience leading Data Engineering principles within an organization/team.

Other Skills Required:


• Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#


• Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.


• Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm


• Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase


• Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, Nexus

Assets:


• Experience within Azure environment


• Strong Python, Scala and Spark experience


• Experience modernizing data platforms.


• Experience with Azure Functions and C#


• 2 to 3 projects developing Data Vault

  • Senior IT Security Engineer

    1 week ago

    Ottawa, Ontario, Canada NTT DATA North America Full time

    NTT DATA strives to hire exceptional, innovative, and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking aSenior IT Security Engineerto join our team in Canada.Project Summary:The scope is to provide expert support to the Individual...

  • Senior Project Coordinator

    3 days ago

    Ottawa, Ontario, Canada NTT DATA Full time

    We are currently seeking a Senior Project Coordinator to join our team in Canada. Project Summary:This initiative aims to enhance network performance, establish disaster-recovery solutions to ensure IT continuity, stabilize aging IT systems, and transition to an evergreen lifecycle approach. A set of prioritized and targeted initiatives has been funded to...

  • Senior Project Coordinator

    3 days ago

    Ottawa, Ontario, Canada NTT DATA North America Full time

    We are currently seeking aSenior Project Coordinatorto join our team inCanada.Project Summary:This initiative aims to enhance network performance, establish disaster-recovery solutions to ensure IT continuity, stabilize aging IT systems, and transition to an evergreen lifecycle approach. A set of prioritized and targeted initiatives has been funded to...

  • Data Engineer

    3 days ago

    Ottawa, Ontario, Canada Work in Ottawa Full time

    Ottawa's tech sector is growing, and so are the opportunities If you're exploring your next role in tech,Work in Ottawacan help you learn about leading employers and exciting careers in Canada's capital.Led by Invest Ottawa, the city's lead economic development agency, this initiative works alongside tech companies, recruiters and search firms, and community...

  • Senior Solutions Engineer

    5 days ago

    Ottawa, Ontario, Canada Atreides Caseri Inc. Full time

    Job Title: Senior Solutions EngineerCompany Overview: Atreides helps organizations transform large and complex multi-modal datasets into information-rich geo-spatial data subscriptions that can be used across a wide spectrum of use cases. Currently, Atreides focuses on providing high-fidelity data solutions to enable customers to derive insights...

  • Data Analytics Engineer

    1 week ago

    Ottawa, Ontario, Canada Ribbon Communications Full time

    JOB TITLE Data Analytics Engineer – Ribbon Analytics (Full Time)About Ribbon CommunicationsRibbon Communications is a global leader in real-time communications, transforming networks to secure IP and cloud-based architectures for consumers and businesses worldwide. Learn more at OPPORTUNITYRibbon Communications is looking for aDataAnalytics Engineerto...

  • Data Pipeline Engineer

    1 week ago

    Ottawa, Ontario, Canada Ribbon Communications Full time

    JOB TITLEData Pipeline Engineer – Ribbon Analytics (Full Time)About Ribbon CommunicationsRibbon Communications is a global leader in real-time communications, transforming networks to secure IP and cloud-based architectures for consumers and businesses worldwide. Learn more at OPPORTUNITYRibbon Communications is looking for aData Pipeline Engineerto...

  • Data Pipeline Engineer

    6 days ago

    Ottawa, Ontario, Canada Ribbon Communications Full time

    JOB TITLE Data Pipeline Engineer – Ribbon Analytics (Full Time)ABOUT RIBBON COMMUNICATIONSRibbon Communications is a global leader in real-time communications, transforming networks to secure IP and cloud-based architectures for consumers and businesses worldwide. Learn more at OPPORTUNITYRibbon Communications is looking for a Data Pipeline Engineer to...

  • Senior Backend Engineer

    2 weeks ago

    Ottawa, Ontario, Canada ANVIL Full time $140,000 - $170,000

    Senior Backend EngineerAbout ANVILANVIL is a trusted partner in the defence industry, delivering cutting-edge solutions that enhance military capabilities and operational effectiveness. We extend our expertise to public safety, law enforcement, and national security organizations, accelerating mission-critical decision making through analytical tools,...

  • Data Engineer

    2 weeks ago

    Ottawa, Ontario, Canada Tiger Analytics Inc. Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for multiple Fortune 500 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research...