Data Engineering Lead

7 days ago


Toronto, Canada Lorven Technologies Inc. Full time

Lorven Technologies Inc. is seeking a highly skilled Data Engineering Lead to join our team in Toronto. This is a contract position that requires extensive experience in designing and implementing data pipelines, ensuring operational excellence, and monitoring system performance.

The estimated salary for this position is $120,000 per annum, based on industry standards and the company's location in Toronto.

About the Job

This Data Engineering Lead role involves leading a team of data engineers in the design, development, and implementation of scalable data architectures using cloud-based technologies such as AWS. The successful candidate will have expertise in PySpark, Hudi, Iceberg, Airflow, EMR, and other related tools.

Required Skills and Qualifications

  • Data Mesh: Basic understanding of data mesh concepts and principles.
  • Data Pipelines: Expert-level skills in designing and implementing data pipelines using PySpark, Hudi, Iceberg, Airflow, and EMR.
  • Data Operations: Operational excellence, monitoring, and troubleshooting skills.
  • Data Quality: Great Expectations, AWS Glue DQ, Deequ expertise.
  • Entitlements: AWS Lakeformation expertise.
  • Infrastructure: Knowledge of AWS Data Eng. Services, AWS Compute Services, and AWS Storage Service.
  • DevOps: Terraform and Git Actions expertise.
  • Metadata: Knowledge of Neptune, OpenLineage, Angular, and DataZone.
  • Consumption: AWS Athena and Trino expertise.
  • Other Tools: JupyterLab and Databricks knowledge.

Good to Have

  • SQL: Comfortable working with production-level code and assets with clear understanding of DevOps and DataOps principles.

  • Data Engineer

    3 weeks ago


    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 299022 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to remotely join our team in or near Tornoto, Ontario (CA-ON), Canada (CA).We are...

  • Data Engineer

    3 weeks ago


    Toronto, Canada NTT DATA Services Full time

    Req ID: 299022 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to remotely join our team in or near Tornoto, Ontario (CA-ON), Canada (CA).  We are looking for a...

  • Azure Data Engineer

    3 weeks ago


    Toronto, Canada Ness Digital Engineering Full time

    Ness is a full lifecycle digital engineering firm offering digital advisory through scaled engineering services. Combining our core competence in engineering with the latest in digital strategy and technology, we seamlessly manage Digital Transformation journeys from strategy through execution to help businesses thrive in the digital economy. As your tech...


  • Old Toronto, Canada Data Engineer Jobs Full time

    As a Senior Data Engineer at Mozilla, you will play a pivotal role in shaping the company's data strategy and driving business growth through informed decision-making.About the RoleWe are seeking an experienced data engineer to join our Analytics Engineering team. In this role, you will work closely with data scientists to design and implement scalable data...

  • Data Engineering Lead

    3 weeks ago


    Toronto, Ontario, Canada Ripple Full time

    Unlock Your Potential as a Data Engineering LeadRipple, a pioneer in decentralized technologies, is seeking an exceptional data engineering lead to join our team. As a key player in shaping our data infrastructure, you will play a crucial role in driving innovation and growth.About RippleWe're revolutionizing the way value moves across borders, leveraging...

  • Data Engineering Lead

    22 hours ago


    Toronto, Canada Tactable Full time

    A Data Engineering Lead at Tactable drives the development and implementation of scalable data pipelines, utilizing Python, data storage solutions, and ETL tools. This role requires expertise in designing and maintaining automation workflows to boost team efficiency.Key ResponsibilitiesDevelop and lead data engineering projects from inception to...

  • Data Engineering Lead

    2 weeks ago


    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job Description:Astra North Infoteck Inc. is seeking a highly skilled Data Engineering Lead to join our team.About the RoleWe are looking for an experienced Data Architect who can lead our data engineering efforts and drive digital transformation across the organization.Key Responsibilities:Contribute expertise in data engineering and architecture to firm...


  • Toronto, Canada Finance Professionals Inc. Full time

    Finance Professionals Inc.Salary: $120,000 - $180,000 per yearAbout the RoleWe are seeking an experienced Data Engineering Lead to join our team at Finance Professionals Inc. in Downtown, Toronto. This is a hybrid role with 3 days onsite and offers a chance to work with a dynamic team on challenging projects.Job DescriptionThis is a 1-year contract...


  • Toronto, Ontario, Canada Finance Professionals Inc. Full time

    At Finance Professionals Inc., we are seeking an experienced Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing, developing, and maintaining robust data pipelines and solutions that meet the needs of our business stakeholders.We are looking for someone with 5-7 years of experience...

  • Lead Data Engineer

    3 months ago


    Toronto, Canada Scotiabank Full time

       Requisition ID: 205976Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. The Wealth Data engineering team within the Global Wealth Engineering (GWE) is the key team delivering operational data solutions to various stake holders within Wealth Management. We are seeking an experienced Lead Data...


  • Toronto, Canada NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Data Engineering Lead

    4 weeks ago


    Toronto, Ontario, Canada National Bank Full time

    Senior Data Engineer Job DescriptionWe are seeking a highly skilled Senior Data Engineer to join our Data Solutions team at National Bank.Job SummaryThe successful candidate will be responsible for designing, developing, and maintaining robust data pipelines that extract, transform, and load (ETL) data from various sources and store in our data warehouse....


  • Toronto, Canada Tata Consultancy Services Full time

    Tata Consultancy Services (TCS) is a leading IT services company with over 55 years of experience in partnering with top businesses worldwide.Salary: $120,000 - $180,000 per year, depending on location and experience.Job Overview:We are seeking an experienced Data Engineering Lead to join our team. In this role, you will be responsible for designing,...

  • Data Engineering Lead

    3 weeks ago


    Toronto, Ontario, Canada Lorven Technologies Full time

    About Lorven TechnologiesWe are a leading technology firm based in Ontario, Canada.Salary:$125,000 - $180,000 per yearJob DescriptionWe are seeking an experienced Data Engineer to lead our big data team.Key ResponsibilitiesDesign and implement scalable big data solutions using Scala, Java, Hive, HDFS, Unix shell scripting, SQL, and Snowflake.Develop and...


  • Toronto, Canada GalaxEons Full time

    GalaxEons seeks a seasoned Data Engineering Lead to spearhead the development of optimal data pipelines. About the RoleThe successful candidate will be responsible for creating and maintaining robust data architectures, implementing data products, and ensuring data quality and integrity. Key ResponsibilitiesDesign and develop scalable data pipelines...


  • Toronto, Canada Quantum World Technologies Inc. Full time

    We are seeking a skilled Data Engineering Lead to join our team at Quantum World Technologies Inc. in Toronto, ON Canada.As a key member of our data engineering team, you will play a crucial role in designing and implementing scalable data pipelines on cloud providers, preferably AWS.The ideal candidate will have at least 8+ years of experience in data...


  • Toronto, Ontario, Canada Scotiabank Full time

    At Scotiabank, we're looking for a talented Data Analytics Engineering Lead to join our team. This is an exciting opportunity to work with industry leaders and contribute to the development of cutting-edge data analytics solutions.About the RoleWe're seeking a seasoned technical expert with a passion for data engineering and analytics. As a Data Analytics...


  • Toronto, Canada NTT DATA Full time

    Job Description: Job Requirements - 10+ years of experience in large Data Migration efforts, SAP Data Migration, ETL and LTMC experience, and 2 years in S/4 HANA Data Migration preferred - 3 - 4 full cycle data migration experience - Extensive experience in ETL using SAP BODS and SAP IS with respect to SAP Master / Transaction Data Objects in SAP FICO, SAP...


  • Old Toronto, Canada Tiger Analytics, LLC Full time

    Tiger Analytics, LLC is a pioneering analytics consulting firm. We collaborate with prominent Fortune 100 companies to unlock business value from data insights.We seek an exceptional professional with a balanced blend of business acumen and technical expertise in Data Engineering and reporting solutions.Key Responsibilities:This role demands a strong focus...


  • Toronto, Ontario, Canada Virtual Labs IT Consulting Full time

    Company OverviewVirtual Labs IT Consulting is a dynamic consulting firm that provides innovative solutions to businesses worldwide. Our team of experts delivers cutting-edge technology services, including data engineering and database management. Salary$120,000 - $180,000 per year, depending on experience. Job DescriptionWe are seeking an experienced Data...