ETL/Azure data engineer
5 days ago
NOTE: This position is currently listed as "Onsite"; however, the Assignment under this request will provisionally be "Hybrid", working 7.25 hours per calendar day, sometime between 8:00-5:00 PM (excluding lunch breaks) Monday to Friday inclusive for three (3) days onsite and two (2) days remote (offsite), unless otherwise identified. These conditions are subject to change as the OPS reflects on its current situation. During the duration of the assignment, you will be under the discretion of the Hiring Manager's requirements for the assigned Project.
Must have's:
- Power BI: Proficiency in Power BI, including data modeling, creating interactive reports and dashboards and utilizing advanced features.
- ETL/Microsoft Azure Synapse Analytics experience, including its architecture, data storage options, data ingestion mechanisms and security features.
- Dynamics 365 CE and/or F&O report development experience.
Nice to have:
- Azure cloud certifications (e.g. Azure fundamentals, Azure Power BI Data Analyst Associate)
- Dynamics 365 certifications
Description
SCOPE:
- The OPGT is developing "PGTIMS", a new Dynamics CE based solution that will modernize OPGT's legacy applications and systems. This project requires migrating historical data from the legacy solutions to a new data warehouse/lakehouse, building all the new data assets in the lakehouse and creating new PowerBI reports.
DELIVERABLES:
- As a member of the reporting team, you will be responsible deliver the MVP for reporting, build the new data warehouse/lakehouse and deliver the required reporting. A high-level list of deliverables for the data migration team follows:
- Data Warehouse Design: analyze business requirements and design an efficient data warehouse/lakehouse/golden layer on Microsoft Azure
- Data Integration and ETL: help develop and automate ETL processes to load data from Dynamics 365 CE and F&O into the new data warehouse/lakehouse (bronze/silver/golden layers). Help integrate data from diverse sources into the new data warehouse.
- Data Modeling: create logical and physical data models that align with the project's reporting and analytical needs.
- Data Security and Governance: implement appropriate security controls to protect sensitive data within the data warehouse and reports.
- Reporting and Visualization: develop reports, dashboards and visualizations as per reporting MVP. Ensure the quality, accuracy and integrity of reports.
- Performance Optimization: fine-tune the data warehouse and reporting processes to optimize query performance and overall system efficiency.
- Other duties as assigned.
The Vendor's Personnel will also be required to:
- Complete work and achieve milestones within the assigned deadlines.
- Notify the Cluster/Ministry project Manager in writing of any issues or other material concerns related to the Assignment Deliverables, as soon as he/she becomes aware of them
- Submit Deliverables for the Cluster/Ministry approval as they are completed.
- Comply with the Ontario Government and the Cluster/Ministry security procedures and practices
- Comply with the Ontario Government and the Cluster/Ministry architecture/technology standards and best practices
- Comply with the Ontario Government and the Cluster/Ministry Conflict of Interest and Confidentiality Guidelines
- Provide knowledge and skill transfer to a designated Cluster/Ministry staff; and
- Comply with the Ontario Government I&IT Directive, Operational Policy on the I&IT Project Gateway Process, and other applicable Guidelines, Standards and Procedures.
Experience and Skill Set Requirements
- The VOR Master Service Agreement which expires on April 5, 2025, leaves some Contracts with funding unassigned for fiscal If the current statement of work expires on March 31, 2025, the remaining funds can be used to exercise an option to extend the SOW beyond March 31, 2025, based on business case approvals. Such extensions will be allowable, only if the Master Service Agreement is extended beyond April 5, 2025, and be upon the same terms, conditions, and covenants contained in the SOW.
- The start date is subject to change based on security clearances and contract signing timelines.
SKILLS AND KNOWLEDGE:
- Data Warehouse/Lakehouse Concepts: Strong understanding of data warehousing principles, including data modeling, ETL processes, data integration, and data governance.
- Microsoft Azure Synapse: In-depth knowledge and experience with Azure Synapse Analytics, including its architecture, data storage options (e.g., SQL Data Warehouse, Data Lake Storage), data ingestion mechanisms (e.g., Azure Data Factory), and security features.
- Power BI: Proficiency in Power BI, including data modeling, creating interactive reports and dashboards, configuring data gateways, and utilizing advanced features such as DAX and Power Query.
- SQL and Query Optimization: Strong SQL skills for writing complex queries, optimizing database performance, and troubleshooting query performance issues. Understanding of indexing, partitioning, and query execution plans.
- Development experience with Dynamics 365 and understanding of the Common Data Model for Dynamics.
- Report development experience for Microsoft Dynamics 365 Customer Engagement (CE) and/or Finance and Operations (F&O)
- Familiarity with version control systems (e.g., Azure Repos) and collaboration tools (e.g., Azure DevOps) for managing code, tracking changes, and collaborating with team members.
CRITERIA:
Criteria 1 - PowerBI (25 Points)
- Demonstrated experience working Power BI, creating interactive reports and dashboards, configuring data gateways, utilizing advanced features such as DAX and Power Query.
- Experience with SSIS, SSRS
Criteria 2 - ETL / Azure Platform (25 Points)
- Experience with Azure Synapse Workspaces and/or Azure Data Factory
- Azure cloud certifications
Criteria 3 - Dynamics Points)
- Demonstrated software development experience with PowerApps platform, Power Automate, Dynamics CE &F&O and producing reports from Dynamics
Criteria 4 - SQL / DB (15 Points)
- Demonstrated experience with data manipulation languages (T-SQL, PL/SQL), data definition languages, query performance analysis & tuning
- Demonstrated experience with SQL Server, Oracle, Azure SQL Databases
Criteria 5 - Azure DevOps (10 Points)
- Demonstrated experience with Azure DevOps for version control, managing code, tracking changes, and collaborating with team members.
-
Senior Data Engineer
5 days ago
Toronto, Ontario, Canada Cleo Consulting Full timeAbout the RoleCleo Consulting is seeking a highly skilled Senior Data Engineer to join our team as an Azure ETL Specialist. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data warehousing and ETL solutions on the Microsoft Azure platform.Key ResponsibilitiesDesign and develop data warehouses...
-
Senior Data Engineer
5 days ago
Toronto, Ontario, Canada Cleo Consulting Full timeAbout the RoleCleo Consulting is seeking a highly skilled Senior Data Engineer to join our team as an Azure ETL Specialist. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data warehousing and ETL solutions on the Microsoft Azure platform.Key ResponsibilitiesDesign and develop data warehouses...
-
Senior Data Engineer
5 days ago
Toronto, Ontario, Canada Cleo Consulting Full timeAbout the RoleCleo Consulting is seeking a highly skilled Senior Data Engineer to join our team as an Azure ETL Specialist. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data warehousing and ETL solutions on the Microsoft Azure platform.Key ResponsibilitiesDesign and develop data warehouses...
-
Azure Data Engineer
2 weeks ago
Toronto, Ontario, Canada Hafman Consulting Group Full timeHafman Consulting Group is seeking a highly skilled and experienced Data Engineer to join our growing team. In this role, you will play a pivotal part in designing, developing, and maintaining robust data infrastructures within the Microsoft Azure cloud environment. As a key member of our engineering team, you will be responsible for crafting efficient...
-
Azure Data Engineer
2 weeks ago
Toronto, Ontario, Ontario, Canada Themesoft Inc. Full timeRole: Azure Data EngineerLocation: Toronto, ON(Hybrid)Exp: 15+yearsResponsibilities:Oversee the integration of geospatial data from various sources using Azure Data Factory ETL and Azure Data Factory.Provide expertise in Databricks and Azure Databricks to optimize data processing workflows and enhance data analysis capabilities. Collaborate with...
-
Azure Data Engineer
20 hours ago
Toronto, Ontario, Canada Astra North Infoteck Inc. Full timeAbout the RoleAstra North Infoteck Inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data marts and data warehouses using Azure Data Factory and other cloud-based technologies.Key ResponsibilitiesData Mart Design and DevelopmentDesign and develop...
-
Azure Data Engineer
23 hours ago
Toronto, Ontario, Canada Astra North Infoteck Inc. Full timeAbout the RoleAstra North Infoteck Inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data marts and data warehouses using Azure Data Factory and other cloud-based technologies.Key ResponsibilitiesData Mart Design and DevelopmentDesign and develop...
-
Old Toronto, Ontario, Canada S I Systems Full timeSenior Data Engineer with ETL Data Integration and Development for Investment Data SolutionsJob Type: ContractPositions to fill: 1Job Overview:We are seeking a skilled Data Engineer to collaborate with teams of analysts and system architects to deliver robust, scalable data solutions for investment data. The ideal candidate will have a strong background in...
-
Old Toronto, Ontario, Canada S I Systems Full timeSenior Data Engineer with ETL Data Integration and Development for Investment Data SolutionsJob Type: ContractPositions to fill: 1Job Overview:We are seeking a skilled Data Engineer to collaborate with teams of analysts and system architects to deliver robust, scalable data solutions for investment data. The ideal candidate will have a strong background in...
-
Lead Azure Data Engineer
2 months ago
Toronto, Ontario, Canada Cognizant Full timeAt Cognizant, our global community sets us apart—an energetic, collaborative and inclusive workplace where everyone can thrive. And with projects at the forefront of innovation, you can build a varied, rewarding career and draw inspiration from dedicated colleagues and leaders. We are seeking someone who thrives in this setting and is inspired to craft...
-
Azure Data Engineer
2 weeks ago
Toronto, Ontario, Canada Astra North Infoteck Inc. Full timeAstra North Infoteck Inc. is seeking a highly skilled and experienced Azure Data Engineer to join our growing team. In this role, you will be responsible for designing, developing, and maintaining data pipelines and solutions within the Azure cloud environment.Responsibilities:Design, build, and maintain robust and scalable data pipelines using Azure Data...
-
Azure Data Engineer
6 days ago
Toronto, Ontario, Canada Astra North Infoteck Inc. Full timeAbout the RoleAstra North Infoteck Inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data marts and data warehouses using Azure Data Factory and other cloud-based technologies.Key ResponsibilitiesData Mart Design and DevelopmentDesign and develop...
-
Azure Data Engineer
5 days ago
Toronto, Ontario, Canada Astra North Infoteck Inc. Full timeAbout the RoleAstra North Infoteck Inc. is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data marts and data warehouses using Azure Data Factory and other cloud-based technologies.Key ResponsibilitiesData Mart Design and DevelopmentDesign and develop...
-
Senior Azure Data Solutions Engineer
4 weeks ago
Toronto, Ontario, Canada Astra North Infoteck Inc. Full timePosition OverviewWe are seeking a highly skilled Azure Data Engineer to join our dynamic team at Astra North Infoteck Inc. This role requires a deep understanding of data engineering principles and a strong background in cloud technologies.Key ResponsibilitiesEducational Background: A Bachelor's degree or relevant Technical Certification is...
-
ETL Development Lead
4 hours ago
Old Toronto, Ontario, Canada Blanc Labs Full timeBlanc Labs, a leading digital transformation partner for global enterprises, is seeking an experienced ETL Development Lead with deep expertise in Azure Data Factory to lead our ETL development efforts and work closely with one of our prestigious banking clients.The ideal candidate will have a proven track record in leading ETL projects, driving data...
-
ETL Development Lead
1 hour ago
Old Toronto, Ontario, Canada Blanc Labs Full timeBlanc Labs, a leading digital transformation partner for global enterprises, is seeking an experienced ETL Development Lead with deep expertise in Azure Data Factory to lead our ETL development efforts and work closely with one of our prestigious banking clients.The ideal candidate will have a proven track record in leading ETL projects, driving data...
-
Data Architect
3 days ago
Toronto, Ontario, Canada Pacific Data Integrators Full timeAbout the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, implement, and maintain data pipelines deployed to our client's investment entities, ensuring high...
-
Data Architect
3 days ago
Toronto, Ontario, Canada Pacific Data Integrators Full timeAbout the RolePacific Data Integrators is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in supporting our client's OCM Self-serve platform.Key ResponsibilitiesTechnical Operationalization: Design, implement, and maintain data pipelines deployed to our client's investment entities, ensuring high...
-
Data Engineering Lead
7 days ago
Toronto, Ontario, Canada Celebal Technologies Full timeAbout the RoleWe are seeking a highly skilled Sr Data Engineer to join our team at Celebal Technologies. As a key member of our data engineering team, you will be responsible for designing, implementing, and maintaining large-scale data processing systems.Key ResponsibilitiesTechnical Leadership: Provide technical guidance and expertise to the team on data...
-
Senior Azure Data Solutions Engineer
3 weeks ago
Toronto, Ontario, Canada Astra North Infoteck Inc. Full timePosition OverviewWe are seeking a highly skilled Azure Data Engineer to join our team at Astra North Infoteck Inc. This role requires a deep understanding of data engineering principles and a strong background in Azure technologies.Key ResponsibilitiesEducational Background: A Bachelor’s degree or relevant technical certification is required.Experience: At...
