Data Infrastructure Lead

2 months ago

Edmonton, Canada Government of Alberta Full time

**Job Information**:
Job Requisition ID: 46795

Ministry: Advanced Education

Location: Edmonton

Full or Part-Time: Full Time

Hours of Work: 36.25 hours per week

Regular/Temporary: Regular

Scope: Open Competition

Closing Date: August 28, 2023

Classification: Subsidiary 02B 3625 Program Services 4

**About Us**:
The Data Management and Governance (DMG) unit aims to improve the ministry’s data maturity, as follows:

- Develop, implement, and evolve and enterprise-wide data management and governance.
- Develop, implement, and evolve stewardship of the Department's major administrative datasets.
- Collect and provide oversight of key administrative data from the advanced learning system.

**Role**:
**Do you geek out about great data infrastructure? Does your curiosity drive you to the underlying problem? Are you keen to build up capacity in your colleagues? This opportunity may be for you**

Reporting to the Manager-Data Management, you will build data infrastructure to enable new digital services and business intelligence. This includes developing and optimizing pipelines, data warehouse and orchestration platforms, and cloud storage to reliably move data from multiple source systems, assessing existing infrastructure, and developing a roadmap for infrastructure improvement.

Your technical acumen, teaching skills, and listening attitude will help the DMG unit improve Advanced Education’s data management and governance capacity.

**Responsibilities**

**1. Build data infrastructure to meet AE's operational and analytic needs.**
- Build data pipelines from one or more sources to cloud storage and data warehouse in a customized way, including orchestration, masking, testing, reviewing, troubleshooting, scheduling, and documenting.
- Leverage replication tools (Nexla, Airbyte) to copy data from desperate sources into the centralized data storage location (Azure Blob Storage).
- Organize structured (e.g. postgres tables) and unstructured data (e.g. json) into analyst-friendly tables in the centralized data cloud (Snowflake).
- Develop messaging and alerting systems so that failure and error reporting happen in an automated, trusted way.
- Maintain the tooling libraries that enable automation and quality of the data warehouse: custom operators and scripts for orchestration (based on Astronomer/Airflow), continuous integration and deployment (CircleCI), code deployment process, and linting. Enable analysts and modellers to work effectively by supporting the tools they use, including Data Build Tool (DBT) for data transformations inside the centralized data cloud.**2. Implement best practices to guide infrastructure development and planning.**
- Own and drive AE's data infrastructure building standards, developing documentation and processes to support junior and future data infrastructure staff in the unit.
- Identify and prioritize building and maintenance work, taking in to account department business priorities, technical dependencies, and unit coordination and capacity.
- Develop and maintain a roadmap for development and improvement of infrastructure and standards.
- Build a library of data infrastructure documentation and resources for unit and Department staff.

**3. Back up data modelling and data reporting functions.**
- Cross train with data modelling and reporting colleagues to ensure business continuity.
- Draft, test, and review data model scripts.
- Develop and maintain data model documentation including standards.
- Draft and review reports, visualizations, and dashboards.
- Develop and maintain reporting and visualization documentation including standards.

**Qualifications**:
**Requirements**:
A University Degree in Computer Science, Data Science, Statistics, informatics or related field and minimum of 4 years related experience. Directly related experience or education considered as an equivalency on a one-for-one basis.

**Equivalency**: Directly related education or experience considered on the basis of:

- 1 year of education for 1 year of experience; or
- 1 year of experience for 1 year of education

The Data Infrastructure Lead must have at least four years of experience performing the following work:

- Optimizing data infrastructure/data pipeline architecture and building these structures from the ground up, including optimizing data flow and collection for cross-functional teams.
- Collaborating with teams of data analysts, data scientists, and software developers on data initiatives.

Related experience or education may be considered as an equivalency on a one-for-one basis.
- To be successful in this job, you need_
- A deep knowledge of data scripting languages Python, Data Build Tool (DBT), and Linux.
- Significant experience using version control systems (Github): branching, writing and saving code, creating pull requests, doing pull requests for code reviews, etc.
- Knowledge of orchestration (Airflow and Astronomer), cloud hosting and storage (Azure Blob Storage), and cloud

  • Data Analyst, Infrastructure

    3 weeks ago

    Edmonton, Canada University of Alberta Full time

    **Department** Vice-President Facilities & Operations - Planning, Information and Analytics **Salary range** $64,618.31 to $90,053.44 **Hours per week** 35 **Grade** 11 **Posted date** May 22, 2024 **Closing date** June 5, 2024 **Position Type** Full Time - Operating Funded **Description**: This position is a part of the Non-Academic Staff Association...

  • Data Analyst, Infrastructure

    2 months ago

    Edmonton, Canada University of Alberta Full time

    **VFO Asset Planning & Info**: - Competition No. **S103952533** - Posting Date **Feb 05, 2024** - Closing Date **Mar 01, 2024** - Position Type **Full Time - Operating Funded** - Salary Range **$64,618 to $90,053 per year** - Grade **11** - Hours **35** This position is a part of the Non-Academic Staff Association (NASA). This position has a term...

  • Infrastructure Crew Lead

    1 week ago

    Edmonton, Canada Tridon Full time

    Start your Career today with Tridon Infrastructure Crew Lead Edmonton Infrastructure Crew Lead Edmonton, Alberta Tridon Infrastructure is currently seeking an Experienced Crew Leader for work based in Edmonton, Alberta and surrounding communities. Job Summary: As a Crew Lead you will be responsible for overseeing and supervising the...

  • Infrastructure Crew Lead

    3 weeks ago

    Edmonton, Canada Tridon Full time

    Start your Career today with Tridon Infrastructure Crew Lead Edmonton Infrastructure Crew Lead Edmonton, Alberta Tridon Infrastructure is currently seeking an Experienced Crew Leader for work based in Edmonton, Alberta and surrounding communities. Job Summary: As a Crew Lead you will be responsible for overseeing and supervising the...

  • Infrastructure Crew Lead

    2 weeks ago

    Edmonton, Canada Tridon Communications Full time

    **Tridon Infrastructure is currently seeking an Experienced Crew Leader for work based in Edmonton, Alberta and surrounding communities.** **Job Summary**: As a Crew Lead you will be responsible for overseeing and supervising the work force, safety documentation and job preparation. You will be the main point of contact for the customer on site, resolving...

  • Practice Lead, Data Platform DevOps

    2 months ago

    Edmonton, Canada AIMCo (Alberta Investment Management Corporation) Full time

    DEPARTMENT: BT - Delivery & Operations - CLOSING DATE: - November 21, 2023 Opportunity Absolutely, this is an exceptional opportunity for an experienced professional in the field of Data Platform DevOps. As the Practice Lead, you'll play a pivotal role in shaping and managing AIMCo's Modern Data Platform (MDP). This platform lies at the heart of AIMCo's...

  • Network Analyst

    3 weeks ago

    Edmonton, Canada ATB Financial Full time

    **Our bottom line is different.** There’s something special about working at ATB, and it’s been recognized on every top employer list that matters. Maybe it’s our exceptional culture where your total wellness is supported through market-leading benefits and you’re free to bring your whole self to work. Maybe it’s our commitment to a growth mindset...

  • Technical Quality Coordinator and Handover Lead

    2 months ago

    Edmonton, Canada Marigold Infrastructure Partners DBJV Full time

    The City of Edmonton selected Marigold Infrastructure Partners to design and build the 14-kilometre Valley Line West LRT project from downtown to Lewis Farms. Construction has begun and will take five to six years to complete. Marigold is a design-build joint venture agreement between Colas and Parsons. We are looking for an experienced Technical Quality...

  • Team Lead, On-premise Infrastructure

    2 weeks ago

    Edmonton, Canada Ledcor Full time

    **Description** **Job Summary**: Reporting to the Director, Technical Operations, the Team Lead, On-premise Infrastructure is responsible for planning, administration, maintenance, documentation creation & upkeep, and technical leadership for all on-premise, virtualized and storage solutions, including infrastructure monitoring and analysis throughout the...

  • Team Lead, On-premise Infrastructure

    1 week ago

    Edmonton, Canada Ledcor Full time

    **Description** **Job Summary**: Reporting to the Director, Technical Operations, the Team Lead, On-premise Infrastructure is responsible for planning, administration, maintenance, documentation creation & upkeep, and technical leadership for all on-premise, virtualized and storage solutions, including infrastructure monitoring and analysis throughout the...

  • Infrastructure Asset Specialist

    2 months ago

    Edmonton, Canada University of Alberta Full time

    **VFO Asset Planning & Info**: - Competition No. **S103952526** - Posting Date **Feb 02, 2024** - Closing Date **Feb 16, 2024** - Position Type **Full Time - Operating Funded** - Salary Range **$73,849 to $102,918 per year** - Grade **11** - Hours **40** This position is a part of the Non-Academic Staff Association (NASA). This position offers a...

  • Infrastructure Asset Specialist

    6 days ago

    Edmonton, Canada University of Alberta Full time

    **VFO Asset Planning & Information**: - Competition No. **S100351531** - Posting Date **Jul 20, 2023** - Closing Date **Aug 02, 2023** - Position Type **Full Time - Operating Funded** - Salary Range **$72,757 to $101,397 per year** - Grade **11** - Hours **40** This position is a part of the Non-Academic Staff Association (NASA). This position...

  • Lead Scheduler- Lrt Construction

    1 month ago

    Edmonton, Canada Marigold Infrastructure Partners DBJV Full time

    **Company description** Our client is The City of Edmonton. Marigold Infrastructure Partners DBJV has the privilege and responsibility of designing and building a rapid transit system that not only serves communities and destinations but also integrated and identifies with them. The Valley Line LRT is a 27km low-floor, community-integrated LRT line that...

  • Cloud Data Specialist

    1 month ago

    Edmonton, Canada Government of Alberta Full time

    **Job Information** Job Requisition ID: 53495 Ministry: Advanced Education Location: Edmonton Full or Part-Time: Full Time Hours of Work: 36.25 hours per week Permanent/Temporary: Ongoing Scope: Open Competition Closing Date: February 26, 2024 Classification: Systems Analyst 3 **Salary**: $3106.31-$4114.41 Biweekly $81,074-$107,386/year) Advanced...

  • Consultant, Faculty Infrastructure

    2 months ago

    Edmonton, Canada University of Alberta Full time

    **ENG Dean Administration**: - Competition No. **A107450675** - Closing Date **Mar 17, 2023** This position is a part of the Association of the Academic Staff of the University of Alberta (AASUA). In accordance with the Administrative and Professional Officer Agreement, this full time continuing position offers a comprehensive benefits package found at...

  • Manager Infrastructure

    2 weeks ago

    Edmonton, Canada Alberta Pensions Services Corporation (APS) Full time

    **Position**: Manager Infrastructure and Technical Services **Position Type**: Full Time, Permanent, Management, Internal/External **Location**: Edmonton Area **Pay Group**: VI **Salary Range**: $91,496.00 to $130,709.00 to business challenges is what motivates you, then you belong in this role. What you’re passionate about A typical day for the...

  • Alignment-wide Technical Discipline Lead

    1 week ago

    Edmonton, Canada Marigold Infrastructure Partners DBJV Full time

    Proudly constructing the Valley Line West LRT The City of Edmonton selected Marigold Infrastructure Partners to design and build the 14-kilometre Valley Line West LRT project from downtown to Lewis Farms. Construction has begun and will take five to six years to complete. Marigold is a design-build joint venture agreement between Colas and Parsons. As we...

  • Senior Manager, IT Infrastructure

    1 day ago

    Edmonton, Canada Recruitment Partners Full time

    Posted On: Jun 5, 2024 Senior Manager, IT Infrastructure & Security We are seeking a Senior IT Infrastructure and Security Manager to oversee the client's service delivery for companies in the US, Canada, and Australia. This is a technical working lead position that requires an individual with experience in managing global infrastructure and security...

  • Senior Manager, IT Infrastructure

    1 day ago

    Edmonton, Canada Recruitment Partners Full time

    Posted On: Jun 5, 2024 Senior Manager, IT Infrastructure & Security We are seeking a Senior IT Infrastructure and Security Manager to oversee the client's service delivery for companies in the US, Canada, and Australia. This is a technical working lead position that requires an individual with experience in managing global infrastructure and security...

  • Senior Manager, IT Infrastructure

    3 days ago

    Edmonton, Canada Recruitment Partners inc. Full time

    We are seeking a Senior IT Infrastructure and Security Manager to oversee the client's service delivery for companies in the US, Canada, and Australia. This is a technical working lead position that requires an individual with experience in managing global infrastructure and security programs. Reporting to the Vice President of Information Technology, a...