Data Engineer

1 week ago

Toronto, Ontario, Canada Ontario Power Generation Full time
Job Title: Data Developer

Join Ontario Power Generation (OPG) as a Data Developer and be part of a dynamic team that drives innovation and customer-centric digital experiences.

Job Overview

As a Data Developer, you will be responsible for building and supporting data-driven applications that enable innovative digital experiences. You will work closely with a cross-discipline agile team to solve problems across all business areas and build reliable, supportable, and performant data lake and data warehouse products.

Key Accountabilities
  • Design and implement modular and scalable data ELT/ETL pipelines and data infrastructure leveraging a wide range of data sources across the organization.
  • Collaborate with Data Architect to implement curated common data models that offer an integrated, business-centric single source of truth for business intelligence, reporting, and downstream system use.
  • Work closely with infrastructure and cyber teams to ensure data is secure in transit and at rest.
  • Clean, prepare, and optimize datasets for performance, ensuring lineage and quality controls are applied throughout the data integration cycle.
  • Support Business Intelligence Analysts in modeling data for visualization and reporting, using dimensional data modeling and aggregation optimization methods.
  • Troubleshoot issues related to ingestion, data transformation, and pipeline performance, data accuracy, and integrity.
  • Collaborate with business analysts, data scientists, data engineers, data analysts, solution architects, and data modelers to develop data pipelines to feed our data marketplace.
  • Assist in identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI.
  • Work within the agile SCRUM work management framework in delivery of products and services, including contributing to feature & user story backlog item development, and utilizing related Kanban/SCRUM toolsets.
  • Assist in building data catalog and maintenance of relevant metadata for datasets published for enterprise use.
  • Develop optimized, performant data pipelines and models at scale using technologies such as Python, Spark, and SQL, consuming data sources in XML, CSV, JSON, REST APIs, or other formats.
  • Document as-built pipelines and data products within the product description, and utilize source control to ensure a maintainable code-base.
  • Implement orchestration of data pipeline execution to ensure data products meet customer latency expectations, dependencies are managed, and datasets are as up-to-date as possible, with minimal disruption to end-customer use.
  • Create tooling to help with day-to-day tasks, and reduce toil via automation wherever possible.
  • Work with Continuous Integration/Continuous Delivery and DevOps pipelines to automate infrastructure, code delivery, and product enhancement isolation and proper release management and versioning.
  • Monitor the ongoing operation of in-production solutions, assist in troubleshooting issues, and provide Tier 2 support for datasets produced by the team, on an as-required basis.
  • Implement and manage appropriate access to data products via role-based access control.
  • Write and perform automated unit and regression testing for data product builds, assist with user acceptance testing and system integration testing as required, and assist in design of relevant test cases.
  • Participate in peer code review sessions, and approve non-production pull requests.
Education and Qualifications
  • 4-year University education in computer science, computer/software engineering, or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning.
  • Minimum 6 years of experience with Data Engineering.
  • Experience as a Data Engineer building data pipelines.
  • Fluent in creating data processing frameworks using Python, PySpark, SparkSQL, and SQL.
  • Experience with Azure Data Factory, ADLS, Synapse Analytics, and Databricks.
  • Experience building data pipelines for Data Lakehouses and Data Warehouses.
  • Good understanding of data structures and data processing frameworks.
  • Knowledge of data governance and data quality principles.
  • Effective communication skills to translate technical details to non-technical stakeholders.

  • Data Architect Data Analytics Specialist

    1 day ago

    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, develop, and maintain data pipelines deployed to our client's investment entities, ensuring high levels of...

  • Data Architect Data Analytics Specialist

    2 days ago

    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a key role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, develop, and maintain data pipelines deployed to our client's investment entities, ensuring high levels of...

  • Data Architect

    2 days ago

    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Pacific Data Integrators. As a key member of our team, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, develop, and maintain data pipelines deployed to our client's investment entities.Data...

  • Data Architect

    3 days ago

    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Pacific Data Integrators. As a key member of our team, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, develop, and maintain data pipelines deployed to our client's investment entities.Data...

  • Data Architect

    3 days ago

    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, implement, and maintain data pipelines deployed to our client's investment entities, ensuring high...

  • Data Architect

    4 days ago

    Toronto, Ontario, Canada Pacific Data Integrators Full time

    About the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, implement, and maintain data pipelines deployed to our client's investment entities, ensuring high...

  • iOS Software Engineer

    2 days ago

    Toronto, Ontario, Canada Data Theorem Full time

    Data Theorem is a pioneering company dedicated to creating a more secure digital landscape. Rooted in a strong engineering-driven culture, every employee has a significant impact on product development and strategic direction. We are seeking exceptional talent to join our team and take ownership of projects that align with their interests and skills.As an...

  • iOS Software Engineer

    2 days ago

    Toronto, Ontario, Canada Data Theorem Full time

    Data Theorem is a pioneering company dedicated to creating a more secure digital landscape. Rooted in a strong engineering-driven culture, every employee has a significant impact on product development and strategic direction. We are seeking exceptional talent to join our team and take ownership of projects that align with their interests and skills.As an...

  • iOS Software Engineer

    2 days ago

    Toronto, Ontario, Canada Data Theorem Full time

    Data Theorem is a pioneering company dedicated to creating a more secure digital landscape. Rooted in a strong engineering-driven culture, every employee has a significant impact on product development and strategic direction. We are seeking exceptional talent to join our team and take ownership of projects that align with their interests and skills.As an...

  • iOS Engineer, Observability SDK

    2 days ago

    Toronto, Ontario, Canada Data Theorem Full time

    iOS Engineer Data Theorem is a pioneering company dedicated to safeguarding the world's data. Our engineer-first culture empowers every employee to drive product innovation and direction. We're seeking exceptional talent to join our team and take ownership of projects that resonate with them. As an iOS engineer, you will be responsible for enhancing Data...

  • iOS Engineer, Observability SDK

    3 months ago

    Toronto, Ontario, Canada Data Theorem Full time

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.As an iOS engineer, you will be...

  • Lead Java Engineer

    4 weeks ago

    Toronto, Ontario, Canada NTT DATA Full time

    NTT DATA Services is dedicated to recruiting outstanding, innovative, and enthusiastic professionals who aspire to develop their careers with us. We foster an inclusive, flexible, and forward-looking workplace. We are currently on the lookout for a Lead Java Engineer (Onsite) to enhance our team in Toronto, Ontario, Canada. Key Responsibilities: Design,...

  • Data Engineer, Growth Data Engineering

    7 days ago

    Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial infrastructure platform for businesses, providing a range of services to help companies grow their revenue and accelerate new business opportunities.About the TeamThe Growth Data Engineering team at Stripe is responsible for managing business-critical data across the organization. We're looking for talented...

  • Data Engineer, Growth Data Engineering

    5 days ago

    Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial infrastructure platform for businesses, providing a range of services to help companies grow their revenue and accelerate new business opportunities.About the TeamThe Growth Data Engineering team at Stripe is responsible for managing business-critical data across the organization. We're looking for talented...

  • Data Engineer, Growth Data Engineering

    1 day ago

    Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial technology platform that provides a range of services to businesses, including payment processing, treasury management, and point-of-sale solutions. Our mission is to increase the GDP of the internet, and we're looking for talented data engineers to help us achieve this goal.About the TeamThe Growth Data Engineering...

  • Data Engineer, Growth Data Engineering

    1 day ago

    Toronto, Ontario, Canada Stripe Full time

    About StripeStripe is a leading financial technology platform that provides a range of services to businesses, including payment processing, treasury management, and point-of-sale solutions. Our mission is to increase the GDP of the internet, and we're looking for talented data engineers to help us achieve this goal.About the TeamThe Growth Data Engineering...

  • Lead Salesforce Engineer

    4 weeks ago

    Toronto, Ontario, Canada NTT DATA Full time

    Senior Salesforce Developer - Remote Opportunity in CanadaPosition Summary:Design and implement robust internal applications utilizing cutting-edge technologies.Engage in all stages of the software development lifecycle, from front-end to back-end.Key Responsibilities:Code using Apex, Lightning Web Components (LWC), Lightning Web Runtime (LWR), and...

  • Data Engineer

    5 days ago

    Toronto, Ontario, Canada Scotiabank Full time

    About the RoleThis is a challenging opportunity for a skilled Data Engineer to join our team at Scotiabank. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data engineering solutions to support our business needs.Key ResponsibilitiesDesign and Develop Data Engineering Solutions: You will work...

  • Data Engineer

    6 days ago

    Toronto, Ontario, Canada Scotiabank Full time

    About the RoleThis is a challenging opportunity for a skilled Data Engineer to join our team at Scotiabank. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data engineering solutions to support our business needs.Key ResponsibilitiesDesign and Develop Data Engineering Solutions: You will work...

  • Data Engineer

    1 day ago

    Toronto, Ontario, Canada Royal Bank of Canada> Full time

    Job SummaryJob DescriptionWhat is the Opportunity?We are seeking a Data Specialist to join the Data Analytics and Insights Team of RBC Global Asset Management. If you are passionate about data engineering and data products delivery practices, please read on.Data Engineer Assist in the development and delivery of data product solutions, including building,...