Data Engineer

2 weeks ago


Edmonton AB, Canada Tundra Technical Solutions Inc. Full time

Our client has embarked on a major academic and administrative transformation. This new model promotes consistency, avoids duplication, and supports a one-university approach. Core to the model is fostering service excellence and improving improve both academic and administrative performance as One University. With this strategic direction in mind, the University has launched the Continuous Administrative Service Improvement Program (CASIP) to improve the service experience of staff and students by refining or redesigning our business processes and aligning our enterprise systems with those processes.

The program will deliver service improvements in the following streams:

  • Human Resources
  • Finance
  • Data Governance,

Management and Reporting -

Technology (with an initial focus on system integration)

  • Service Governance
  • Intranet

We are seeking a Data Engineer to build data pipelines using Azure Data Factory (ADF), and Azure Synapse pipelines, enhancing the University Azure cloud-based data platform.

Required Of This Data Engineer

  • Designing and implementing data ingestion pipelines to transfer Finance, Student, Staff, and Research data from PeopleSoft into a RAW zone within the data lake in Azure. This involves understanding the data structure of source data and using ADF for efficient data extraction.
  • Developing processes to comply with our Medallion data lakehouse layers (bronze, silver, gold) and transform raw data into cleansed, conformed data, as well as provide aggregated and enriched data suitable for analytics and BI reporting.
  • Creating and maintaining data products and datasets that are ready for consumption in data analysis and reporting for specific Business needs using ADF or Azure Synapse pipelines.
  • Populating semantic data models that provide meaningful business context to the data, making it understandable for end-users to use BI tools like Tableau.
  • Ensure efficient data processing, especially considering the costs of a scalable and flexible cloud environment such as Azure.
  • Working closely with data modelers, data analysts, and data scientists to understand their data needs and requirements. Ensuring that the data pipeline aligns with these needs and the overall data strategy of the organization.
  • Adherence to the University's data pipeline architecture and standards, ensuring alignment with overall data governance and compliance.
  • Streamlining data operations into an efficient and accessible data environment. Providing reports and insights on pipeline performance.

Skills Needed

  • Demonstrated proficiency with Azure data services, including Azure Synapse Analytics, Azure Data Lake, Azure Dedicated SQL Pool, ADF, data flow, and Azure Synapse Pipelines.
  • Strong foundation and specialized knowledge in data integration and the development of data pipelines.
  • Proven experience with Azure Data Factory (ADF) and Azure Synapse Analytics for data ingestion, transformation, and processing.
  • Experience with Azure data storage solutions, including Azure Data Lake, SQL-based databases, and Lakehouse.
  • Experience in developing data transformation processes in line with the Medallion architecture (bronze, silver, gold layers).
  • Knowledge of optimizing data processing for cost-effectiveness in Azure's scalable and flexible cloud environment.
  • Strong problem-solving skills and the ability to work on complex data platform.
  • Excellent communication skills, capable of engaging with both technical and non-technical stakeholders.
  • Certifications in Azure Data Engineering or Azure Architecture are highly beneficial.
  • Attention to detail and a focus on accuracy.
  • Self-motivated with the ability to prioritize and manage workloads.
  • Team player with a collaborative approach.

Job 69877

#J-18808-Ljbffr
  • Engineering Manager

    3 weeks ago


    Calgary, AB, Canada Data Theorem Full time

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them. As an Engineering Manager you will...


  • Calgary, AB, Canada Data Theorem Full time

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them. As an Engineering Manager you will...

  • Data Engineer

    2 weeks ago


    Calgary, AB, Canada Hubstaff Full time

    Based in Calgary, Alberta, Bow River Solutions provides Business Intelligence solutions that transform your data into actionable insights. With over 18 years of experience, we have forged partnerships with industry-leading vendors to provide cutting-edge analytics solutions. Our successful projects across Canada and the USA, spanning diverse sectors such...


  • Edmonton, AB, Canada LHR Américas Full time

    The company where energy is opportunity! Our client occupies a unique position in the global energy industry. They are the world's largest producer of hydrocarbons (oil and gas), with the lowest upstream carbon intensity of any major producer. With significant investment in technology and infrastructure, they strive to maximize the value of the energy they...


  • Calgary, AB, Canada ICES: Data, Discovery, Better Health Full time

    Lauren Services provides a full suite of project delivery services to various industrial sectors. We offer complete EPCM services including Project Management, Feasibility Studies, Full Service Engineering, Detailed Design, Procurement, Construction Management, Commissioning & Start-up and Operations Maintenance Support. At Lauren, we pride ourselves in...


  • Edmonton, AB, Canada Niche Engineering Full time

    Overview: The Software Integration Specialist at Niche Engineering will be responsible for managing all aspects of the company's software, IT infrastructure and hardware. They will provide technical support to ensure the smooth operation of computers, emails, websites, and other IT systems. Additionally, the IT Specialist will be involved in programming...

  • Senior BI

    3 weeks ago


    Edmonton, AB, Canada Vantix Systems Inc. Full time

    Our client is seeking contracting services for a Data Analyst to support the analytics initiatives prioritized by the BISC for 2024 and supplement other work required on the Data Management Program (DMP). The scope of the work will include (but is not limited to): Understand the business requirements to devise a technical solution that aligns with the...


  • Calgary, AB, Canada Daifuku Co Full time

    As a Principal Data Engineer, you will be responsible for designing, building, and maintaining Daifuku's data infrastructure. The ideal candidate will have extensive experience with data engineering, strong leadership skills, and the ability to work collaboratively with cross-functional teams. Daifuku's data stack includes Java, SQL, Kubernetes,...


  • Calgary, AB, Canada Daifuku Co Full time

    As a Principal Data Engineer, you will be responsible for designing, building, and maintaining Daifuku's data infrastructure. The ideal candidate will have extensive experience with data engineering, strong leadership skills, and the ability to work collaboratively with cross-functional teams. Daifuku's data stack includes Java, SQL, Kubernetes, Kafka,...

  • Data Engineer

    4 weeks ago


    Calgary, AB, Canada Vividtheory Full time

    At Vivid Theory we believe...“You Can!” Whether innovating a new idea, building amazing new software, or creating the next best marketing campaign, we live by the motto, “You Can”. Looking for someone who is experienced but still early in their career (roughly 2-6 years of experience) and feels ready to take on a large amount of responsibility and...


  • Edmonton, AB, Canada 2i Solutions, Inc Full time

    There is a contract opportunity for Sr. Data Migration Engineer. Role can be done remotely. Initial contract for 3 months, with potential for extension/ full time depending on project needs. Must have 10+ years’ experience writing complex queries, stored procedures and functions within a SQL Server environment. 5+ years’ experience with data...


  • Calgary, AB, Canada stellaralgo corp. Full time

    Who We Are At StellarAlgo we are inspired and united around innovating the future of fan experiences. We are brought together by the belief that accessible and actionable data inspires the personalized and authentic experiences that create lifelong fans. Through a combination of embracing challenges, a belief that alignment enables autonomy and a committed...

  • Data Engineer

    4 weeks ago


    Calgary, AB, Canada stellaralgo corp. Full time

    We are brought together by the belief that accessible and actionable data inspires the personalized and authentic experiences that create lifelong fans. Through a combination of embracing challenges, a belief that alignment enables autonomy and a committed team, we believe in empowering our players to achieve big things where it comes to solving interesting...

  • Data Scientist

    2 weeks ago


    Edmonton, AB, Canada BlueMarvel AI Full time

    OT Data Scientist Position Overview: As an OT Data Scientist at BlueMarvel.AI, you will be responsible for using advanced data analytics and machine learning techniques to derive actionable insights from our customers’ operational technology systems. You will work closely with cross-functional teams to drive development of data-driven solutions that...

  • Project Engineer

    4 weeks ago


    Calgary, AB, Canada ICES: Data, Discovery, Better Health Full time

    COMPANY OVERVIEW Lauren Services provides a full suite of project delivery services to various industrial sectors. We offer complete EPCM services including Project Management, Feasibility Studies, Full Service Engineering, Detailed Design, Procurement, Construction Management, Commissioning & Start-up and Operations Maintenance Support. At Lauren, we...


  • Calgary, AB, Canada AltaGas Full time

    AltaGas - Lead Operations Data Engineer Provide expertise to lead, develop, and maintain optimization on assigned Midstream managed applications (i.e. In addition to ensuring all applicable governance requirements on structure, reporting, documentation, and training are accurate and maintained in accordance with AltaGas requirements. Lead the analysis...


  • Calgary, AB, Canada AltaGas Full time

    Job Description AltaGas - Lead Operations Data Engineer Provide expertise to lead, develop, and maintain optimization on assigned Midstream managed applications (i.e. Aveva Pi) along with related applications and processes in AltaGas operations. In addition to ensuring all applicable governance requirements on structure, reporting, documentation, and...


  • Edmonton, AB, Canada Blend Full time

    Blendis a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to unlocking value and...

  • Engineering Assistant

    2 weeks ago


    Calgary, AB, Canada City of Calgary Full time

    If you are committed to public service, enjoy collaborating with others, share our values and have a desire to learn and grow, joinThe City of Calgary. City employees deliver the services, run the programs and operate the facilities which make a difference in our community. We support work-life balance, promote physical and psychological safety, and offer...

  • Data Entry Clerk

    2 weeks ago


    Edmonton, AB, Canada NES Fircroft Ltd Full time

    This Data Entry - Inventory Analyst position is for a special assignment of 12-18 months, but the successful candidate will also be exposed to other tasks associated with working in an Engineering Documentation office. This additional work could lead to an extended duration beyond 18 months. MAIN FUNCTIONS: Enters and updates information into computer...