Data Engineer

2 weeks ago


Oshawa, Ontario, Canada Ontario Power Generation Inc. Full time
About the Role

We are seeking a highly skilled Data Engineer to join our team at Ontario Power Generation Inc. in the role of Data Developer.

Key Responsibilities
  • Design and build modular and scalable data ELT/ETL pipelines and data infrastructure leveraging a wide range of data sources across the organization.
  • Implement curated common data models that offer an integrated, business-centric single source of truth for business intelligence, reporting, and downstream system use, in collaboration with Data Architect.
  • Work closely with infrastructure and cyber teams to ensure data is secure in transit and at rest.
  • Clean, prepare and optimize datasets for performance, ensuring lineage and quality controls are applied throughout the data integration cycle.
  • Support Business Intelligence Analysts in modelling data for visualization and reporting, using dimensional data modeling and aggregation optimization methods.
  • Troubleshoot issues related to ingestion, data transformation and pipeline performance, data accuracy and integrity.
  • Collaborate with business analysts, data scientists, data engineers, data analysts, solution architects and data modelers to develop data pipelines to feed our data marketplace.
  • Assist in identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI.
  • Work within the agile SCRUM work management framework in delivery of products and services, including contributing to feature & user story backlog item development, and utilizing related Kanban/SCRUM toolsets.
  • Assist in building data catalog and maintenance of relevant metadata for datasets published for enterprise use.
  • Develop optimized, performant data pipelines and models at scale using technologies such as Python, Spark and SQL, consuming data sources in XML, CSV, JSON, REST APIs, or other formats.
  • Document as-built pipelines and data products within the product description, and utilize source control to ensure a maintainable code-base.
  • Implement orchestration of data pipeline execution to ensure data products meet customer latency expectations, dependencies are managed, and datasets are as up-to-date as possible, with minimal disruption to end-customer use.
  • Create tooling to help with day to day tasks, and reduce toil via automation wherever possible.
  • Work with Continuous Integration/Continuous Delivery and DevOps pipelines to automate infrastructure, code delivery and product enhancement isolation and proper release management and versioning.
  • Monitor the ongoing operation of in-production solutions, assist in troubleshooting issues, and provide Tier 2 support for datasets produced by the team, on an as-required basis.
  • Implement and manage appropriate access to data products via role-based access control.
  • Write and perform automated unit and regression testing for data product builds, assist with user acceptance testing and system integration testing as required, and assist in design of relevant test cases.
  • Participate in peer code review sessions, and approve non-production pull requests.
  • Other Duties as Required.
Requirements
  • 4-year University education in computer science, computer/software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning.
  • Minimum 6 years experience with Data Engineering.
  • Experience as a Data Engineer building data pipelines.
  • Fluent in creating data processing frameworks using Python, PySpark, SparkSQL and SQL.
  • Experience with Azure Data Factory, ADLS, Synapse Analytics and Databricks.
  • Experience building data pipelines for Data Lakehouses and Data Warehouses.
  • Good understanding of data structures and data processing frameworks.
  • Knowledge of data governance and data quality principles.
  • Effective communication skills to translate technical details to non-technical stakeholders.

  • Data Engineer

    12 hours ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job Title: Data EngineerJob Summary:Ontario Power Generation (OPG) is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key Responsibilities:Design and develop modular and scalable data ELT/ETL...

  • Data Engineer

    4 hours ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job Title: Data EngineerJob Summary:Ontario Power Generation (OPG) is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key Responsibilities:Design and develop modular and scalable data ELT/ETL...

  • Data Engineer

    1 hour ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job Title: Data EngineerJob Summary:Ontario Power Generation (OPG) is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key Responsibilities:Design and develop modular and scalable data ELT/ETL...

  • Data Engineer

    12 hours ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Data Developer Job Summary: We are seeking a dynamic Data Developer to build and support data-driven applications, working with a cross-discipline agile team to solve problems across all business areas. About the Role: As a Data Developer at Ontario Power Generation (OPG), you will be responsible for building and productionizing modular and scalable data...


  • Oshawa, Ontario, Canada Studyincanada Full time

    Overview: Data Engineers are essential professionals who utilize sophisticated analytical technologies to derive significant insights from intricate datasets. They employ state-of-the-art methodologies in machine learning and predictive analytics to discern patterns and offer automated suggestions. The demand for Data Engineers spans various sectors,...


  • Oshawa, Ontario, Canada Studyincanada Full time

    Overview: Data Engineers are essential professionals who utilize sophisticated analytical technologies to derive valuable insights from intricate datasets. They employ state-of-the-art methods in machine learning and predictive analytics to discern patterns and offer automated suggestions. The demand for Data Engineers spans various sectors, including...


  • Oshawa, Ontario, Canada Studyincanada Full time

    Role Overview: The Data Engineer is a pivotal role focused on utilizing sophisticated analytical technologies to derive significant insights from intricate datasets. This position employs state-of-the-art methodologies in machine learning and predictive analytics to discern patterns and offer automated solutions. Data Engineers are sought after in numerous...

  • Data Engineer

    1 week ago


    Oshawa, Ontario, Canada Ontario Power Generation Inc. Full time

    About the RoleOntario Power Generation Inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key ResponsibilitiesDesign and develop modular and scalable data ELT/ETL pipelines and data...

  • Data Engineer

    1 week ago


    Oshawa, Ontario, Canada Ontario Power Generation Inc. Full time

    About the RoleOntario Power Generation Inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key ResponsibilitiesDesign and develop modular and scalable data ELT/ETL pipelines and data...

  • Data Engineer

    4 days ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Ontario Power Generation. As a Data Engineer, you will play a critical role in building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key ResponsibilitiesDesign and develop modular and scalable data ELT/ETL pipelines and data...

  • Data Engineer

    4 days ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at Ontario Power Generation. As a Data Engineer, you will play a critical role in building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key ResponsibilitiesDesign and develop modular and scalable data ELT/ETL pipelines and data...

  • Data Engineer

    2 weeks ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job OverviewOntario Power Generation (OPG) is seeking a highly skilled Data Engineer to join our team in the role of a Clean Energy Specialist. Reporting to the Senior Manager, IT Programs, the successful candidate will be responsible for building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key...

  • Data Engineer

    2 weeks ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job OverviewOntario Power Generation (OPG) is seeking a highly skilled Data Engineer to join our team in the role of a Clean Energy Specialist. Reporting to the Senior Manager, IT Programs, the successful candidate will be responsible for building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key...

  • Data Developer

    1 week ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job OverviewOntario Power Generation (OPG) is seeking a highly skilled and experienced professional to join our team as a Data Developer. This is an exciting opportunity to work with a dynamic and innovative organization that is shaping the future of clean energy.Key ResponsibilitiesDesign and develop modular and scalable data pipelines and data...

  • Data Developer

    1 week ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job OverviewOntario Power Generation (OPG) is seeking a highly skilled and experienced professional to join our team as a Data Developer. This is an exciting opportunity to work with a dynamic and innovative organization that is shaping the future of clean energy.Key ResponsibilitiesDesign and develop modular and scalable data pipelines and data...

  • Data Developer

    1 week ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job OverviewOntario Power Generation (OPG) is seeking a highly skilled and experienced professional to join our team as a Data Developer. This is a key role that will play a critical part in building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key ResponsibilitiesDesign and develop modular and scalable...

  • Data Developer

    1 week ago


    Oshawa, Ontario, Canada Ontario Power Generation Full time

    Job OverviewOntario Power Generation (OPG) is seeking a highly skilled and experienced professional to join our team as a Data Developer. This is a key role that will play a critical part in building and supporting data-driven applications that enable innovative, customer-centric digital experiences.Key ResponsibilitiesDesign and develop modular and scalable...


  • Oshawa, Ontario, Canada Actalent Full time

    Industrial Engineer Position OverviewPosition Summary: The role focuses on collaborating with various departments, including the paint shop, body shop, and general assembly, to enhance the efficiency of our manufacturing processes. You will be part of a dedicated team of Industrial Engineers, working together to evaluate concepts, identify necessary tools or...

  • Procurement Engineer

    1 month ago


    Oshawa, Ontario, Canada Aecon Full time

    Come Build Your Career at AeconAs a Canadian leader in infrastructure development, Aecon is safely and sustainably building what matters for future generations to thrive We lead some of the most impactful infrastructure projects of our generation, at the forefront of transformational change in transportation and energy, and partnering every day to build,...


  • Oshawa, Ontario, Canada Aecon Full time

    Opportunity Overview: Aecon Nuclear is currently seeking a skilled Procurement Engineer to contribute to our collaborative efforts with Ontario Power Generation on the Darlington New Nuclear Project (DNNP). This role is integral to the validation phase design, procurement, and early site preparation for the Construction of the Unit 1 Small Modular...