25-167 Data Engineer

14 hours ago

Oshawa, Ontario, Canada Morson Full time $80,000 - $120,000 per year

Job Description

Title:Data Engineer

Resume Due Date: Tuesday Nov 18th :00PM EST

Number of Vacancies: 2

Level:  MP4

Duration: 12

Hours of work:   35

Location:  Oshawa (Hybrid, 3 days remote)

Job Overview

As a Data Engineer, you will be responsible for building and supporting the data driven applications which enable innovative, customer centric digital experiences. You will be working as part of a cross-discipline agile team who help each other solve problems across all business areas. You will build reliable, supportable & performant data lake & data warehouse products to meet the organization's need for data to drive reporting analytics, applications, and innovation. You will employ best practice in development, security and accessibility to achieve the highest quality of service for our customers.

Build and productionize modular and scalable data ELT/ETL pipelines and data infrastructure leveraging the wide range of data sources across the organization.Implement data ingestion and curation data pipelines that offer an integrated, business-centric single source of truth for business intelligence, reporting, and downstream system use, in collaboration with Data Architect.Work closely with Data Architect, infrastructure and cyber teams to ensure data is secure in transit and at rest.Clean, prepare and optimize datasets for performance, ensuring lineage and quality controls are applied throughout the data integration cycle.Support Business Intelligence Analysts in modelling data for visualization and reporting, using dimensional data modeling and aggregation optimization methods.Provide production support for issues related to ingestion, data transformation and pipeline performance, data accuracy and integrity.Collaborate with data architect, business analysts, data scientists, data engineers, data analysts, solution architects and data modelers to develop data pipelines to feed our data marketplace.Assist in identifying, designing, and implementing internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.Work with tools in the Microsoft Stack; Azure Data Factory, Azure Data Lake, Azure SQL Databases, Azure Data Warehouse, Azure Synapse Analytics Services, Azure Databricks, Microsoft Purview, and Power BI.Work within the agile SCRUM work management framework in delivery of products and services, including contributing to feature & user story backlog item development, and utilizing related Kanban/SCRUM toolsets.Assist in building data catalog and maintenance of relevant metadata for datasets published for enterprise use.Develop optimized, performant data pipelines and models at scale using technologies such as Python, Spark and SQL, consuming data sources in XML, CSV, JSON, REST APIs, or other formats.Document as-built pipelines and data products within the product description, and utilize source control to ensure a maintainable code-base.Implement orchestration of data pipeline execution to ensure data products meet customer latency expectations, dependencies are managed, and datasets are as up-to-date as possible, with minimal disruption to end-customer use.Create tooling to help with day to day tasks, and reduce toil via automation wherever possible.Work with Continuous Integration/Continuous Delivery and DevOps pipelines to automate infrastructure, code delivery and product enhancement isolation and proper release management and versioning.Monitor the ongoing operation of in-production solutions, assist in troubleshooting issues, and provide Tier 2 support for datasets produced by the team, on an as-required basis.Implement and manage appropriate access to data products via role-based access control.Write and perform automated unit and regression testing for data product builds, assist with user acceptance testing and system integration testing as required, and assist in design of relevant test cases.Participate in peer code review sessions, and approve non-production pull requests.

Education

Completion of a four-year University education in computer science, computer/software engineering or other relevant programs within data engineering, data analysis, artificial intelligence, or machine learning.

Experience


• Experience as a Data Engineer building data pipelines.


• Fluent in creating data processing frameworks using Python, PySpark, SparkSQL and SQL


• Experience with Azure Data Factory, ADLS, Synapse Analytics and Databricks


• Experience building data pipelines for Data Lakehouses and Data Warehouses


• Good understanding of data structures and data processing frameworks


• Knowledge of data governance and data quality principles


• Effective communication skills to translate technical details to non-technica

  • 25-153 BI Developer

    7 days ago

    Oshawa, Ontario, Canada Morson Full time $80,000 - $120,000 per year

    Job DescriptionTitle:  BI DeveloperResume Due Date:  Tuesday, September 23, :00PM EST Number of Vacancies: 2Level:  MP4Duration: 12 monthsHours of work:  40  Location:  Oshawa, ON (100% remote)Job OverviewJOB FUNCTIONS:Semantic Modeling & Enterprise Reporting is responsible for designing, developing, and maintaining enterprise-grade semantic data...

  • 25-183 - Kubernetes Engineer

    4 days ago

    Oshawa, Ontario, Canada Morson Full time $80,000 - $120,000 per year

    Job DescriptionTitle: Kubernetes Engineer 25183Resume Due Date:  November 12th, :00PM EST)Number of Vacancies: 2Level:  MP4Duration: 12 MonthsHours of work: 35   Location:  1908 Colonel Sam Drive  (Hybrid - 3 Days Remote)Job OverviewDesign and implement cloud-native infrastructure using Kubernetes and container orchestration platforms.Develop and...

  • 25-175 - Quality Engineering Practice Lead

    1 week ago

    Oshawa, Ontario, Canada Morson Full time $120,000 - $180,000 per year

    Job DescriptionTitle:  Quality Engineering Practice Lead / ManagerResume Due Date:  Friday, October 31st, :00PM EST)Number of Vacancies: 1Level:  Band H/G (Managerial Level)Duration: 18 MonthsHours of work:    Location:  Oshawa, ON  (Hybrid – 2 days remote)Job OverviewThe Quality Engineering Practice Lead is responsible for establishing, evolving,...

  • 25-175 - Quality Engineering Practice Lead

    11 hours ago

    Oshawa, Ontario, Canada Inter-Quest Full time $120,000 - $180,000 per year

    Location:Oshawa, Ontario, CanadaSalary:$ per hourCategoryIT ManagementSector:IT and DigitalContract typeContractConsultant:Akshata KamathTitle: Quality Engineering Practice Lead / ManagerResume Due Date: Friday, October 31st, :00PM EST)Number of Vacancies: 1Level: Band H/G (Managerial Level)Duration: 18 MonthsHours of work:Location: Oshawa, ON (Hybrid – 2...

  • 25-176 -Sr. Solutions Engineer

    1 week ago

    Oshawa, Ontario, Canada Morson Full time $80,000 - $120,000 per year

    Job DescriptionTitle:  Senior Solutions EngineerResume Due Date:  Friday Nov 28th, :00PM EST)Number of Vacancies: 1Level:  MP5Duration: 16 MonthsHours of work:     35Location:  CHQJob OverviewWe are seeking a highly skilled Microsoft 365 Solutions Engineer  with deep expertise in Power Platform (especially Power Apps and the Center of Excellence),...

  • 25-176 -Sr. Solutions Engineer

    1 week ago

    Oshawa, Ontario, Canada Morson Full time $80,000 - $120,000 per year

    Job DescriptionTitle:  Senior Solutions EngineerResume Due Date:  Friday Nov 28th, :00PM EST)Number of Vacancies: 1Level:  MP5Duration: 16 MonthsHours of work:     35Location:  1908 Colonel Sam Dr, Oshawa, 3 days a weekJob OverviewWe are seeking a highly skilled Microsoft 365 Solutions Engineer  with deep expertise in Power Platform (especially...

  • Digital Engineering Architect

    17 hours ago

    Oshawa, Ontario, Canada CPUS Engineering Staffing Solutions Inc. Full time US$80,000 - US$180,000 per year

    Position: Digital Engineering ArchitectResume Due Date:Monday, December 8, :00 PM EST)Number of Vacancies:2Level:SeniorContract Duration:24 MonthsHours of Work:40 hours/weekLocation:Temporary: 700 University Ave, TorontoBase: 1908 Colonel Sam Drive, OshawaWork Mode: (Hybrid – 2 days remote)About the RoleTheDigital Engineering Architectwill define and...

  • Staff Data Software Developer

    2 weeks ago

    Oshawa, Ontario, Canada General Motors Full time $120,000 - $180,000 per year

    Job DescriptionWork Arrangement:Hybrid- This role is categorized as hybrid. This means the successful candidate is expected to report to the office three days per week, at minimum.About Us:At General Motors, we envision a future characterized by zero crashes, zero emissions, and zero congestion. We are pioneering the next generation of vehicle compute...

  • Staff Engineer

    8 hours ago

    Oshawa, Ontario, Canada General Motors Full time $120,000 - $150,000 per year

    Job DescriptionWork Arrangement:Hybrid:This role is categorized as hybrid. This means the successful candidate is expected to report to Markham Elevation Centre (MEC) three times per week, at minimum.The RoleThe Data Engineering organization at General Motors is at the forefront of innovation, leveraging data to drive the future of mobility. We are seeking a...

  • BIM Architect

    8 hours ago

    Oshawa, Ontario, Canada Morson Edge (Canada) Full time US$85,000 - US$120,000 per year

    25 136 Digital Engineering Architect- BIMNumber of Vacancies : 2Level : MP6Duration : 24 MonthsHours of work: 40Pay range: $85.00- $100.00 per hour/ INCLocation : Oshawa, Ontario. Hybrid- 2 days remote/ 3 days on site.Job OverviewAs a Digital Engineering Architect, you will play a pivotal role in defining and delivering the digital engineering vision...