Principal Data Engineer

4 weeks ago

Markham, Ontario, Canada Patch Tech Staffing Full time

About the Role

Our client is seeking a highly skilled and experienced Principal Data Engineer for a 6-month contract to play a crucial role in building a new, centralized data model. This is a unique opportunity to shape the future of the data landscape, working closely with a consultant to define the strategy and roadmap for syncing and centralizing data from legacy systems across the organization. You will be the technical authority on this project, responsible for establishing design patterns, identifying technical gaps and risks, and ultimately leading the hands-on development of the data model.

Key Responsibilities

  • Design, build, and optimize large-scale Azure-based data pipelines and architectures.
  • Develop and implement scalable ETL processes to extract, transform, and load data from multiple sources, with a focus on integrating legacy systems and using Change Data Capture (CDC) techniques.
  • Design and maintain data warehouse solutions using Azure Synapse Analytics, Snowflake, or BigQuery.
  • Lead the development and maintenance of a centralized data model, ensuring the integration of legacy systems with modern platforms, including the use of CDC for real-time data synchronization.
  • Implement data modeling best practices to support analytics and reporting needs.
  • Lead and mentor a team of data engineers, providing technical guidance and best practices while ensuring hands-on involvement in building key components of the data model.
  • Collaborate with data scientists and analysts to deliver high-quality datasets for machine learning and business intelligence.
  • Ensure seamless data integration across multiple platforms, optimizing data movement and storage for scalability.
  • Ensure data quality, governance, and security across all data platforms.
  • Optimize database performance and implement data storage solutions tailored for scalability.
  • Drive automation and CI/CD practices in data pipeline development.
  • Work with stakeholders to define data strategies and align them with business objectives.
  • Ensure compliance with data privacy regulations such as GDPR, HIPAA, or CCPA.

Required Qualifications & Experience

  • 10+ years of experience in data engineering, data architecture, or related fields.
  • Strong proficiency in programming languages such as Python, Scala, or Java.
  • Expertise in SQL and database technologies such as PostgreSQL, MySQL, or Azure SQL Database.
  • Hands-on experience with Azure data services (Azure Data Factory, Azure Synapse Analytics, Azure Data Lake).
  • Extensive experience with data warehousing, data modeling, and data integration, including integrating legacy systems into modern data architectures and implementing Change Data Capture (CDC).
  • Strong knowledge of ETL tools (Apache Airflow, Talend, Informatica, dbt) and CI/CD pipelines.
  • Familiarity with Azure DevOps, Kubernetes, Docker, and microservices for data engineering.
  • Proven ability to optimize and troubleshoot large-scale data processing systems.
  • Excellent leadership, communication, and problem-solving skills.
  • Bachelor's or Master's degree in Computer Science, Data Engineering, or a related field.

Preferred Qualifications

  • Experience working with real-time streaming data solutions (Azure Event Hubs, Apache Kafka, Flink, Spark Streaming).
  • Hands-on experience with machine learning data pipelines.
  • Industry certifications (Azure Data Engineer Associate, AWS Certified Data Analytics, Google Cloud Professional Data Engineer, etc.).

  • Principal Engineer

    3 days ago

    Markham, Ontario, Canada Huawei Full time

    Our team has an immediate permanent opening for a Principal Engineer.Responsibilities:Research and development of distributed, highly available transaction processing database management system focusing on algorithms for scale up and scale out.Work with a team of architects and engineers to develop proof-of-concept systems and components across the data...

  • Principal Engineer

    29 minutes ago

    Markham, Ontario, Canada Huawei Technologies Canada Co., Ltd. Full time

    Social network you want to login/join with:Location:Markham, CanadaJob Category:Information TechnologyJob Reference:86u31lmbJob Views:Posted:Expiry Date:06.05.2025Job Description:Huawei Canada has an immediate permanent opening for a Principal Engineer.About the team:Established in 2014, the Distributed Scheduling and Data Engine Lab is Huawei Cloud's...

  • Senior Principal Engineer

    4 weeks ago

    Markham, Ontario, Canada Huawei Full time

    Huawei Canada has an immediate permanent opening for Senior Principal Engineer.About the team:The Cloud Native Data Engine team within Distributed Scheduling and Data Engine Lab, led by esteemed technical experts with extensive industry and academic experience, merges software development with cutting-edge industrial research in the cloud database area. Our...

  • Senior Principal Engineer

    3 days ago

    Markham, Ontario, Canada Huawei Full time

    Huawei Canada has an immediate permanent opening for Senior Principal Engineer.About the team:The Cloud Native Data Engine team within Distributed Scheduling and Data Engine Lab, led by esteemed technical experts with extensive industry and academic experience, merges software development with cutting-edge industrial research in the cloud database area. Our...

  • Only 24h Left) Principal Engineer

    2 weeks ago

    Markham, Ontario, Canada Huawei Full time

    Our team has an immediate permanent opening for a Principal Engineer.Responsibilities:- Research and development of distributed, highly available transaction processing database management system focusing on algorithms for scale up and scale out.- Work with a team of architects and engineers to develop proof-of-concept systems and components across the data...

  • Principal Architect, Data

    4 weeks ago

    Markham, Ontario, Canada Sentrex Health Solutions Inc. Full time

    Job Category: Information Technology (IT)Requisition Number: PRINC002183Posted: February 18, 2025Full-TimeHybridLocationsShowing 1 locationDescriptionPosition Type: Full-timeDepartment: TechnologyWork Location: Markham, OntarioWork Hours: Monday - Friday, standard business hoursWork Arrangement: HybridA proudly Canadian company, Sentrex Health Solutions is a...

  • Principal Architect, Data

    3 days ago

    Markham, Ontario, Canada Sentrex Health Solutions Inc. Full time

    Job Category: Information Technology (IT)Requisition Number: PRINC002183Posted: February 18, 2025Full-TimeHybridLocationsShowing 1 locationDescriptionPosition Type: Full-timeDepartment: TechnologyWork Location: Markham, OntarioWork Hours: Monday - Friday, standard business hoursWork Arrangement: HybridA proudly Canadian company, Sentrex Health Solutions is a...

  • Data Engineer

    4 days ago

    Markham, Ontario, Canada Randstad Digital Full time

    Data Engineer (Contract Position) Number of Positions: 1 Duration: 6-12 months Location: North York, ON, CA Must be eligible to work in Canada Hybrid position, 2d/w onsite in the North York Offices mandatory Roles and responsibilities: Looking for a skilled Data Engineer with experience in AWS Cloud and ETL technologies to join our dynamic team. In...

  • Principal Software Engineer

    4 weeks ago

    Markham, Ontario, Canada Enercare Inc. Full time

    Principal Software Engineer">We are seeking a highly skilled and passionate Principal Software Engineer to join our team at Enercare. As a key player in creating technology that transforms how our customers experience their homes, you will be responsible for designing, developing, and deploying cutting-edge applications, tools, and...

  • Senior Principal Compiler Engineer

    4 weeks ago

    Markham, Ontario, Canada Huawei Full time

    Our team has an immediate permanent opening for a Senior Principal Compiler Engineer.About the Role:We are seeking a highly experienced compiler engineer to join our team and lead the development of software solutions that satisfy business requirements in a wide range of products.You will be responsible for designing, developing, and testing software...

  • Principal Data Management Specialist

    5 days ago

    Markham, Ontario, Canada Everest Clinical Research Full time

    We are a dynamic organization committed to delivering high-quality clinical research services. As a Principal Data Manager at Everest Clinical Research, you will have the opportunity to work on a wide range of projects, collaborate with cross-functional teams, and contribute to the growth and success of our company.About the JobThis role is responsible for...

  • Principal Software Engineer

    3 days ago

    Markham, Ontario, Canada Synopsys, Inc. Full time

    At Synopsys, we drive the innovations that shape the way we live and connect. Our technology is central to the Era of Pervasive Intelligence, from self-driving cars to learning machines. We lead in chip design, verification, and IP integration, empowering the creation of high-performance silicon chips and software content. Join us to transform the future...

  • Senior Principal Compiler Engineer

    4 weeks ago

    Markham, Ontario, Canada Huawei Full time

    Our team has an immediate permanent opening for a Senior Principal Compiler Engineer.Responsibilities:1. Design, develop, and test software to satisfy business requirements in a wide range of products.2. Analyze and optimize software system performance, and assist with software/hardware co-design.3. Liaise with internal and external stakeholders, determine...

  • Principal Software Engineer

    4 weeks ago

    Markham, Ontario, Canada Enercare Inc. Full time

    Posted Tuesday, February 18, 2025 at 5:00 AMProudly Canadian-owned, Enercare is committed to providing the best services, solutions and advice to make customer's homes as comfortable as they can be. With Enercare Advantage, we provide affordable clean air and water solutions for homes and workplaces. We are committed to operating in an environmentally...

  • Senior Principal Compiler Engineer

    4 weeks ago

    Markham, Ontario, Canada Huawei Full time

    We are currently seeking a highly skilled Senior Principal Compiler Engineer to join our team at {company}.Job SummaryThis is an immediate permanent opening for a Senior Principal Compiler Engineer with 8+ years of experience programming in large software projects, specifically in C++, C, or Java. The ideal candidate will have strong leadership skills,...

  • Data Engineering Expert

    4 days ago

    Markham, Ontario, Canada Randstad Digital Full time

    Job DescriptionWe are seeking a skilled Data Engineer with expertise in AWS Cloud and ETL technologies to join our dynamic team.The successful candidate will be responsible for designing, building, testing, training, validating, and deploying Generative AI (GenAI) solutions across pre-production and production environments.This role requires close...

  • Principal - Water Resources Engineering

    4 weeks ago

    Markham, Ontario, Canada WSP in Canada Full time

    Thornhill, ON, CanadaBurlington, ON, CanadaJob DescriptionThe OpportunityWSP is currently seeking a motivated Water Resources Principal Engineer to join our successful Water Resources Team based out of the Toronto Office. As a Principal Water Resources Engineer on the Land Development and Municipal Engineering team at WSP, you will have the chance to lead...

  • Data Systems Engineer

    8 hours ago

    Markham, Ontario, Canada Huawei Canada Full time

    Huawei Canada is looking for a talented Data Systems Engineer to join our Distributed Data Storage and Management Lab. The successful candidate will be responsible for designing and implementing the next-generation data and AI system.About the role:Design and develop framework/engine for distributed data systems.Analyze user scenarios to create optimized...

  • Principal Hardware Engineer

    7 days ago

    Markham, Ontario, Canada Advanced Micro Devices Full time

    About UsAdvanced Micro Devices is transforming the industry with our AI-based Graphic Processors. Our mission is to build great products that accelerate next-generation computing experiences – the building blocks for the data center, artificial intelligence, PCs, gaming, and embedded.The RoleThe Datacenter Graphics and Accelerated Computing (DCGPU)...

  • Principal Scientist

    4 weeks ago

    Markham, Ontario, Canada Huawei Full time

    Our team has an immediate permanent opening for a Principal Scientist.Responsibilities:1. Cooperate with the AI expert team to guide the design of the next-generation chip including computing power ratio, memory, cache and networking based on the characteristics of future AI workloads for the objectives of throughput, scalability, and stability.2. Build an...