Senior Data Engineer

2 weeks ago

Greater Toronto Area Canada, Ontario Encore Technical Solutions Inc. Full time

Data Engineer Consultant (Informatica, PostgreSQL, Hadoop, AWS)

3-6 month initial extendable contract

Start Date - November 2024

3 days per week in office (Markham)


This role is part of our client's Information Technology Enterprise Data Services Group, where you will take a lead role in architecture, design, analysis, and implementation within an experienced team. Drawing on your in-depth knowledge of both modern and legacy data platforms, you will develop robust data ecosystems that align with business needs and the enterprise architecture standards of the organization.


Our client is currently undertaking an exciting initiative to modernize and create a next-generation data platform, aimed at addressing growing data demands and harnessing AI capabilities to enhance business value.


Key Responsibilities:


  • Architect, build, and operationalize large-scale enterprise data solutions using platforms like Hadoop, Postgres, and Snowflake.
  • Apply advanced knowledge of AWS cloud services, with a particular focus on data engineering and analytics.
  • Re-engineer and migrate existing on-premises big data platforms to the cloud.
  • Design and implement solutions for data acquisition, integration, and data warehousing that cater to complex internal and external data sources.
  • Work closely with stakeholders including business teams, product owners, IT architects, developers, and analysts to ensure solutions meet both functional and technical standards.
  • Ensure compliance with enterprise-wide data governance and design frameworks.
  • Act as a technical resource for delivery teams, helping to resolve architectural and technical challenges for optimized delivery.
  • Build ETL pipelines for ingesting data into Hadoop from a variety of data sources, including files, mainframes, relational databases, and NoSQL systems, using Informatica BDM.
  • Promote and advocate for the use of data catalogs, governance, and high data quality practices.
  • Utilize strong problem-solving abilities to overcome technical challenges.
  • Operate within an Agile delivery framework, iterating on data models and solution designs to deliver incremental improvements.
  • Mentor and guide junior team members, providing leadership by example.
  • Focus on outcomes, using critical thinking and decision-making skills to challenge existing processes and improve overall efficiency.


Qualifications:


  • Education: Bachelor’s degree in Computer Science, Computer Engineering, or a related field.
  • Experience: 5+ years of experience in designing and implementing data lakes, data integration solutions, and data warehouses/marts.
  • Technical Expertise: Proficient with data technologies such as Hadoop, PostgreSQL, and the Informatica product suite.
  • ETL Proficiency: Hands-on experience with BDM execution engines like Spark, Hive, and Native, with deep knowledge of ETL processes using Informatica.
  • Cloud Data Lake: Solid experience with cloud-based data lake architectures, especially on AWS services such as S3, EMR, Redshift, and Data Catalog.
  • Data Governance: Proven ability to implement and maintain data governance practices.
  • Reporting Tools: Familiarity with tools like QlikSense, SAP Business Objects, SAS, and Dataiku.
  • Agile Experience: Background in Agile development methodologies.
  • Communication Skills: Strong written and verbal communication abilities.
  • Insurance Experience: Familiarity with Claim Center and Guidewire is an advantage, along with the ability to understand the business processes behind technical systems.

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data models, data warehouses, and data pipelines to support business...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems that support our business operations.Key ResponsibilitiesDesign and implement data models, data warehouses, and data pipelines to support business...

  • Senior Data Engineer

    3 weeks ago

    Old Toronto, Ontario, Canada Data Engineer Jobs Full time

    About This RoleWe are seeking a highly skilled Senior Data Engineer to join our Analytics Engineering team. As a key member of this team, you will be responsible for designing and building scalable data models and ETL pipelines to support business decisions.Key Responsibilities:Collaborate with data scientists to design data models and answer questions.Work...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Sage Lake Senior Living Full time $276

    Unlock Your Potential as a Senior Data EngineerAre you ready to take your data engineering career to the next level? We're seeking a highly skilled and experienced Senior Data Engineer to join our team at Enable Global Inc.About the RoleAs a Senior Data Engineer, you will play a key role in designing, developing, and deploying our SaaS products. You will...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Sage Lake Senior Living Full time $276

    Unlock Your Potential as a Senior Data EngineerAre you ready to take your data engineering career to the next level? We're seeking a highly skilled and experienced Senior Data Engineer to join our team at Enable Global Inc.About the RoleAs a Senior Data Engineer, you will play a key role in designing, developing, and deploying our SaaS products. You will...

  • Senior Blockchain Engineer

    2 months ago

    Toronto, Ontario, Canada Lawton Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Blockchain Engineer to join our team at Lawton Senior Living. As a Senior Blockchain Engineer, you will play a critical role in designing, building, and developing large-scale data systems that provide the foundational data on which all our products and services are built.Key ResponsibilitiesGain a solid...

  • Senior Blockchain Engineer

    2 months ago

    Toronto, Ontario, Canada Lawton Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Blockchain Engineer to join our team at Lawton Senior Living. As a Senior Blockchain Engineer, you will play a critical role in designing, building, and developing large-scale data systems that provide the foundational data on which all our products and services are built.Key ResponsibilitiesGain a solid...

  • Senior Data Developer

    2 months ago

    Toronto, Ontario, Canada Sage Lake Senior Living Full time $276

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team at Sage Lake Senior Living. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data platforms and systems.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using cloud-based technologies such as...

  • Senior Data Developer

    2 months ago

    Toronto, Ontario, Canada Sage Lake Senior Living Full time $276

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team at Sage Lake Senior Living. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data platforms and systems.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using cloud-based technologies such as...

  • Senior Data Engineer

    1 month ago

    Toronto, Ontario, Canada Enable International Full time $276

    Unlock Your Potential as a Senior Data Engineer at Enable InternationalWe're seeking a highly skilled Senior Data Engineer to join our vibrant team at Enable International. As a key member of our data engineering team, you'll play a crucial role in designing, developing, and deploying scalable data platforms that drive business growth and innovation.About...

  • Senior Data Engineer

    1 month ago

    Toronto, Ontario, Canada Enable International Full time $276

    Unlock Your Potential as a Senior Data Engineer at Enable InternationalWe're seeking a highly skilled Senior Data Engineer to join our vibrant team at Enable International. As a key member of our data engineering team, you'll play a crucial role in designing, developing, and deploying scalable data platforms that drive business growth and innovation.About...

  • Senior Data Developer

    2 months ago

    Old Toronto, Ontario, Canada Sage Lake Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Data Developer to join our team at Enable. As a Senior Data Developer, you will play a key role in designing and developing our data platform, working closely with our engineering team to ensure the delivery of high-quality data solutions.Key ResponsibilitiesDesign and develop data pipelines and...

  • Senior Data Developer

    2 months ago

    Old Toronto, Ontario, Canada Sage Lake Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Data Developer to join our team at Enable. As a Senior Data Developer, you will play a key role in designing and developing our data platform, working closely with our engineering team to ensure the delivery of high-quality data solutions.Key ResponsibilitiesDesign and develop data pipelines and...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Lorven Technologies Full time

    Job Title: Senior Data EngineerLorven Technologies is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key Responsibilities:Design and implement data pipelines using PySpark, Hudi, Iceberg, Airflow, and...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Lorven Technologies Full time

    Job Title: Senior Data EngineerLorven Technologies is seeking a highly skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and pipelines.Key Responsibilities:Design and implement data pipelines using PySpark, Hudi, Iceberg, Airflow, and...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Capgemini Full time

    Job Title: Senior Data EngineerJob Summary:We are seeking a highly skilled Senior Data Engineer to join our team at Capgemini. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems. You will work closely with our team of experienced data engineers to develop innovative solutions for...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Enable International Full time $276

    Unlock Your Potential as a Senior Data Engineer at Enable InternationalAre you ready to take your data engineering career to the next level? We're seeking a highly skilled and experienced Senior Data Engineer to join our vibrant team at Enable International.About the RoleAs a Senior Data Engineer, you will play a key role in designing, developing, and...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada CPP Investments Full time

    Transformative Data Engineer Opportunity at CPP InvestmentsAt CPP Investments, we're seeking a highly skilled Senior Data Engineer to join our team and contribute to the design and implementation of our data platform. As a key member of our data engineering team, you will play a critical role in building robust and scalable data systems aligned to our...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Fluent, LLC Full time

    Job Title: Senior Data EngineerFluent, LLC is seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining large-scale data pipelines using Databricks.Key Responsibilities:Design and implement data pipelines using DatabricksCollaborate with data...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Lyons Consulting Group Full time

    Job DescriptionJob Title: Senior Process Data EngineerJob Summary:We are seeking a highly skilled Senior Process Data Engineer to join our team at Lyons Consulting Group. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data engineering solutions to support our clients' business needs.Key...