Lead Data Engineer

Found in: Whatjobs CA C2 - 1 week ago

Etobicoke, Canada National Consultants Professionals Ltd Full time

The Lead Data Engineer will be responsible for leading a team of data engineers that build and deliver the components of an effective Data Warehouse, leveraging Azure Data Lake, Azure Synapse, Snowflake for data storage, utilising Azure Data Factory and Synapse Pipelines for data integration, Databricks for data transformation and PowerBI for end-user data analytics and reporting. This role will play a critical part in the architectural design and implementation of these elements - capable of meeting a wide range of financial and underwriting reporting/analytics needs. This role will encompass a mix of hands-on technical leadership, team management, strategy development, and stakeholder relations; supporting Sunwing to continue its journey to develop its data platform on next-generation technology.

The Lead Data Engineer will:

  • data engineering through both day-to-day data management (BAU) activities and strategic development projects, defining and orchestrating tasks and deliverables.
  • develop, and hold accountability for core data engineering services, encompassing the end-to-end data lifecycle journey from ingestion through to the Warehouse.
  • as a senior custodian of the Data Platform; administering CICD pipelines, completing peer/code reviews, ensuring the integrity of data, and holding accountability for access and security permissions.
  • and develop ETL/ELT processes, data lake storage architecture, data warehouse, data marts; in-line with the company data management framework and enterprise data strategy.
  • and develop models and databases both relational and dimensional to support reporting requirements.
  • reporting solutions in line with standards, architectural principles, and practices.
  • change impact assessment on live systems and processes.
  • in an agile, proactive manner, delivering high quality solutions in agreed timescale.
  • and support junior data engineers/developers in the team Principal Accountabilities:
  • as a senior custodian of the Data Platform, with performance, security, and data integrity at the forefront of all decisions, ensure that adequate steps are taken to protect data and the data platform.
  • in collaboration with Data Architects and act as a Senior contributor on the design, build, and management of the Data Platform; taking direct ownership of data engineering activities and responsibilities and ensure that all new data requirements are met using the most appropriate architecture components and engineering practices.
  • leadership of both senior and general data engineers.
  • ownership of incidents and define remediation plans, with the support of the wider team, to ensure production issues are resolved in line with expected RTO.
  • and enforce SDLC best practices, coding standards and design principles covering all aspects of data lifecycle management and BI solutions.
  • business requirements and build data solutions to meet business needs.
  • in developing data management framework policies, processes, and standards.
  • abreast of technology trends, state-of-the-art platforms, data engineering techniques/standards and industry trends to provide input on strategic roadmap.
  • maintains a low technical debt & identify area(s) for automation and continuous improvement.
  • Proof of Concepts to prove that business requirements can be met by technical solutions.
  • with building the team and hiring activities.


Education, Qualifications, Knowledge, Skills, and Experience:

Required Skills & Knowledge

  • hands-on experience with Azure Data Lake (incl. Blob Storage, Azure Synapse, Azure Data Factory, Azure Synapse and Snowflake
  • experience of SQL/Azure SQL data warehousing
  • experience of data engineering activities such as release management, environment controls, CICD pipeline orchestration
  • working with Python and Spark
  • ability of Microsoft BI software development including database / reporting development, full development cycle
  • data modelling, problem solving, information analysis, attention to detail, flexibility of approach.
  • ability to deal directly with business functions and interpret their thoughts into successful data & analytics solutions.
  • ability to design and develop complex BI solutions in line with agreed architectural principles and toolsets.
  • of working closely with the business and delivering complex requirements to tight timescales.
  • interest in latest data engineering technologies, best practises, techniques and trends in the data industry Highly Desirable Skills and Knowledge
  • experience in the design and build of data warehouse/data lake.
  • of Synapse.
  • development techniques (SCRUM, Kanban etc.) Required Toolsets.
  • Data Lake Storage, Analysis Services (Multidimensional/Tabular), Power BI, Azure Data Factory, Synapse pipelines, Azure Databricks, Spark.
  • SQL Server or Azure SQL DB.
  • knowledge of data modelling techniques is Desirable Toolsets.
  • working with Snowflake.
  • with API, Connectors, etc. is desirable.

  • Lead Data Engineer

    Found in: Appcast CA C2 Glassdoor - 1 week ago

    Etobicoke, Canada National Consultants Professionals Ltd Full time

    The Lead Data Engineer will be responsible for leading a team of data engineers that build and deliver the components of an effective Data Warehouse, leveraging Azure Data Lake, Azure Synapse, Snowflake for data storage, utilising Azure Data Factory and Synapse Pipelines for data integration, Databricks for data transformation and PowerBI for end-user data...

  • Lead Data Engineer

    Found in: Appcast CA A2 P - 7 days ago

    Etobicoke, Canada National Consultants Professionals Ltd Full time

    The Lead Data Engineer will be responsible for leading a team of data engineers that build and deliver the components of an effective Data Warehouse, leveraging Azure Data Lake, Azure Synapse, Snowflake for data storage, utilising Azure Data Factory and Synapse Pipelines for data integration, Databricks for data transformation and PowerBI for end-user data...

  • Data Analyst Intern

    5 days ago

    Etobicoke, Canada Give and Go Prepared Foods Full time

    It’s an exciting time to be part of the Give & Go team and we want you to be a part of our extraordinarily bright future! **Location**: - Hybrid - 15 Marmac Drive, Etobicoke, ON **Responsibilities**: - Assist with tasks around data type questions; respond to data or analytics related inquiries in real-time to support both business and technical...

  • Facilities Technical Lead

    Found in: beBee S CA - 2 weeks ago

    Etobicoke, Canada Cosma International Full time

    Job Number: 60276 Group: Cosma International Division: DECO AUTOMOTIVE EAST Job Type: Permanent/Regular Location: Etobicoke Group Description Cosma provides a comprehensive range of body, chassis and engineering solutions to global customers. Through our robust product engineering, outstanding tooling capabilities and diverse process expertise, we...

  • Facilities Technical Lead

    Found in: beBee jobs CA - 1 week ago

    Etobicoke, Ontario, Canada Magna International Inc. Full time

    Job Number: 60276 Group: Cosma International Division: DECO AUTOMOTIVE EAST Job Type: Permanent/Regular Location: Etobicoke Group DescriptionCosma provides a comprehensive range of body, chassis and engineering solutions to global customers. Through our robust product engineering, outstanding tooling capabilities and diverse process expertise, we continue...

  • Facilities Technical Lead

    Found in: beBee jobs CA - 1 week ago

    Etobicoke, Ontario, Canada Cosma International Full time

    Job Number: 60276 Group: Cosma International Division: DECO AUTOMOTIVE EAST Job Type: Permanent/Regular Location: Etobicoke Group Description Cosma provides a comprehensive range of body, chassis and engineering solutions to global customers. Through our robust product engineering, outstanding tooling capabilities and diverse process expertise, we...

  • Facilities Technical Lead

    Found in: beBee S CA - 2 weeks ago

    Etobicoke, Canada Magna International Inc. Full time

      Job Number: 60276 Group: Cosma International  Division: DECO AUTOMOTIVE EAST Job Type: Permanent/Regular Location: Etobicoke    Group Description Cosma provides a comprehensive range of body, chassis and engineering solutions to global customers. Through our robust product engineering, outstanding tooling capabilities and diverse...

  • Industrial Engineer

    Found in: beBee jobs CA - 1 week ago

    Etobicoke, Ontario, Canada Magna International Inc. Full time

    About us We see a future where everyone can live and move without limitations. That's why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above all, people. Forward. For all. Group Summary Cosma provides a comprehensive range of body, chassis and engineering solutions...

  • Industrial Engineer

    Found in: beBee S CA - 2 weeks ago

    Etobicoke, Canada Magna International Inc. Full time

    #jobreq_print_container div { line-height: 14px; } #jobreq_print_container div span { font-size: 12px; } About us   We see a future where everyone can live and move without limitations. That’s why we are developing technologies, systems and concepts that make vehicles safer and cleaner, while serving our communities, the planet and, above...

  • Data Scientist

    2 weeks ago

    Etobicoke, Canada KONI AMERI TECH SERVICES CANADA INC. Full time

    Education: Bachelor's degree - Experience: 1 year to less than 2 years - or equivalent experience **Tasks**: - Collect and document user's requirements - Data Science - Design, construct, modify, implement and test data models and database management systems - Operate database management systems to analyze data - Research and document data requirements,...

  • Mechanical Engineer

    Found in: beBee jobs CA - 1 week ago

    Etobicoke, Ontario, Canada BBA inc. Full time

    Type of position: RegularYour future role on our teamThis is a unique opportunity for you to work with experts and engineering professionals across Canada on interesting and challenging projects. Working closely with our experts, senior engineers and designers on heavy industrial projects in the mining and power sectors including studies, the Intermediate...

  • Master Data Intern

    5 days ago

    Etobicoke, Canada Give and Go Prepared Foods Full time

    It’s an exciting time to be part of the Give & Go team and we want you to be a part of our extraordinarily bright future! We are currently recruiting for a detail orientated **Master Data Summer Intern** to be part of our ITS team. The Master Data Summer Intern will work closely with the Visual ERP team and the business for maintaining accurate ERP...

  • Senior Electrical Engineer

    Found in: beBee jobs CA - 1 week ago

    Etobicoke, Ontario, Canada BBA inc. Full time

    Type of position: RegularYour future role on our teamThe ideal candidate is a professional who is equally comfortable in leading design projects and using his or her professional network of clients to generate requests for proposals, prepare and present proposals, and lead work execution. We provide a collaborative work environment, an engaged and collegial...

  • Senior Geotechnical Engineer

    Found in: beBee S CA - 2 weeks ago

    Etobicoke, Canada Englobe Full time

    Job Description Your EmployerAt Terraprobe, we adopt innovative, human-centered management. We welcome new ideas and are open to continuous Improvement. We are determined to succeed in partnership with our teams.We offer:A full range of benefits (group insurance with shared costs upon hiring, group RRSP)A telemedicine virtual healthcare serviceAn annual...

  • Senior Geotechnical Engineer

    Found in: beBee S CA - 1 week ago

    Etobicoke, Canada Englobe Full time

    Job Description Your EmployerAt Terraprobe, we adopt innovative, human-centered management. We welcome new ideas and are open to continuous Improvement. We are determined to succeed in partnership with our teams.We offer:A full range of benefits (group insurance with shared costs upon hiring, group RRSP)A telemedicine virtual healthcare serviceAn annual...

  • Senior Geotechnical Engineer

    Found in: beBee jobs CA - 1 week ago

    Etobicoke, Ontario, Canada Englobe Full time

    Job Description Your EmployerAt Terraprobe, we adopt innovative, human-centered management. We welcome new ideas and are open to continuous Improvement. We are determined to succeed in partnership with our teams.We offer:A full range of benefits (group insurance with shared costs upon hiring, group RRSP)A telemedicine virtual healthcare serviceAn annual...

  • Supplier Quality Engineer

    Found in: beBee jobs CA - 1 week ago

    Etobicoke, Ontario, Canada Magna International Inc. Full time

    Job Number: 63520 Group: Cosma International Division: DECO AUTOMOTIVE EAST Job Type: Permanent/Regular Location: Etobicoke Work Style: Division SummaryDeco Automotive, a Division of Magna International is located in Rexdale and Brampton, Ontario is an automotive parts manufacturing facility that produces structural automotive components for Original...

  • Electrical Engineering Intern

    Found in: beBee jobs CA - 1 week ago

    Etobicoke, Ontario, Canada BBA inc. Full time

    Type of position: TraineeYour future role on our teamBy joining our team, you'll have the opportunity to help with the various stages of high-, medium- and low-voltage project execution, from the proposal, study analysis of industrial power systems, detailed engineering and equipment specification to site surveys, site monitoring and equipment commissioning....

  • Clinical Lead

    5 days ago

    Etobicoke, Canada Bayshore HealthCare Full time

    **The Clinical Community Lead - Nursing is responsible for the daily operations. Responsibilities include planning and executing activities related to service delivery and performance management of nurses. Provides effective leadership and clinical support to nurses. In conjunction with the Clinical Manager, Bundled Care Programs, monitors contractual...

  • Quality Assurance Lead

    5 days ago

    Etobicoke, Canada ct bakery Full time

    Responsibilities: - Develop and implement quality assurance policies and procedures - Oversee and manage the quality assurance team - Conduct regular audits to ensure compliance with quality standards - Collaborate with cross-functional teams to identify areas for improvement and implement corrective actions - Develop and maintain quality metrics and...