Data Engineer

4 weeks ago

Kitchener ON, Canada ApplyBoard Full time

The Role:

The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and integrations. The team is also responsible for building and maintaining data access components and providing tooling and analytics that are required for our predictive/ML models.

What you will be doing:

  • Build and maintain analytics with Python (pandas/pyspark)
  • Build and maintain ETL pipelines on AWS (EC2/Glue ETLs/Airflow)
  • Build and maintain Infrastructure components to support our pipelines and integrations(CDK)
  • Setup and maintain integrations between different systems to enable data flow between these systems (Appflow)
  • Actively contribute to shaping the direction of our data platform including architecting our data warehouse, machine learning deployment infrastructure, and ETL/ELT workflows
  • Gather and understand data requirements by working with stakeholders across multiple teams
  • Working closely with Engineering, IT, and Security to build processes and standards for our data science platform and how it integrates with data sources across the company
  • Developing ingestion, transformation, and cleansing pipelines to prepare a variety of structured and unstructured data sources for data analytics
  • Maintaining our data platform including managing and improving our redshift cluster and monitoring our data pipelines
  • Developing infrastructure using CDK to deploy data products to internal and external users
  • Providing operational support to the data science team
  • Being a go-to person about data-related questions company-wide

What you bring to this role:

  • Bachelor’s degree in Engineering, Computer Science, Mathematics, or a related technical discipline
  • 4+ years experience in the data engineering field
  • Experience in setting up and maintaining a high volume of ETL pipelines
  • Experience in setting up ETL orchestration
  • Familiarity with infrastructure as code (CDK or Terraform) is a plus
  • Advanced knowledge of SQL and knowledge of NoSQL (MongoDB)
  • Ability to communicate effectively with people who are both highly technical, and non-technical alike
  • Strong analytical skills and an understanding of data science
  • Driven, passionate and creative, and thrives in a fast-paced environment
  • Knowledge of data modeling and system design using UML
  • Experience with AWS computing (eg. EC2, Lambda) and data storage technologies (eg. Redshift)

Tech Stack:

  • PostgreSQL
  • Python
  • Pandas
  • Nice to have Pyspark
  • Nice to have CDK or Terraform
  • AWS

  • Data Engineer

    4 weeks ago

    Kitchener, Canada ApplyBoard Full time

    The Role: The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    4 weeks ago

    Kitchener, Canada ApplyBoard Full time

    The Role: The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    4 weeks ago

    Kitchener, Canada ApplyBoard Full time

    The Role: The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    4 weeks ago

    Kitchener, Canada ApplyBoard Full time

    The Role: The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    4 weeks ago

    Kitchener, Canada ApplyBoard Full time

    The Role:The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    4 weeks ago

    Kitchener, Canada ApplyBoard Full time

    The Role:The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    4 weeks ago

    Kitchener, Canada ApplyBoard Full time

    The Role: The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    3 days ago

    Kitchener, Canada Applyboard Full time

    The Role:The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    6 days ago

    Kitchener, Canada ApplyBoard Full time

    The Role:The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Engineer

    4 weeks ago

    Kitchener, Canada ApplyBoard Full time

    ApplyBoard simplifies the study abroad search, application, and acceptance process by connecting international students, recruitment partners, and educational institutions on one intuitive and personalized platform. ApplyBoard is a mission-driven, hyper-growth organization. It has been attracting dedicated individuals for more than eight years who are...

  • Data Engineer

    6 days ago

    Kitchener, Canada ApplyBoard Full time

    The Role: The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining th

  • Data Engineer

    1 week ago

    Kitchener, Ontario, Waterloo region, Canada ApplyBoard Full time

    The Role:The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and...

  • Data Architect Data Analytics

    4 weeks ago

    Kitchener, ON, Canada ApplyBoard Full time

    The data engineering team is an experienced team, responsible for supporting our product development and the entire organization. In addition to building ETL pipelines to automate analytics and building integrations between systems , the team is responsible for building and maintaining the infrastructure used to host these pipelines and integrations. The...

  • Data Engineer

    1 hour ago

    Toronto, ON, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming, and implementation of data platform components and serve as a...

  • Data Engineer

    57 minutes ago

    Toronto, ON, Canada hireVouch Full time

    Our client is a Canadian-based international real estate investor, developer, and property manager. They are growing their team and looking for a passionate Data Engineer to join.The Data Engineer will be responsible for building, processing, reviewing, and managing data alongside support from a data scientist. Enhance your skills working with ETL pipelines,...

  • Data Engineer

    2 days ago

    Cambridge, ON, Canada Farm Mutual Re Full time

    Join our Canadian reinsurance company and help us empower and advance our mutual insurance community! We have an excellent opportunity to join one of Waterloo Region’s top employers as a Data Engineer in our Innovation department. With this position, you will have the opportunity to join a culture that takes pride in being honest, delivering on promises...

  • Senior Director of Data Analytics Engineering

    2 days ago

    Kitchener, Ontario, Canada McAfee Full time

    Role Overview:As the leader of McAfee's Enterprise Data Analytics team, you will drive ownership of data insights at McAfee. You will manage McAfee's data curation and governance function and lead a high-performing, cross-functional team of data Engineers and Technical Data Stewards to deliver data of high quality and reliability.This is a remote position;...

  • Data Engineer

    1 hour ago

    Toronto, ON, Canada Rebelstork Full time

    About Us:Rebelstork is the largest baby gear liquidator and returns recommerce platform in North America, committed to diverting open box returns, overstock, and quality used items from landfills into the hands of parents at the best prices. Our mission is to revolutionize sustainable commerce and make a positive impact on the planet.Job Description:We're...

  • Data Engineer

    1 hour ago

    Toronto, ON, Canada Procom Labs Full time

    The role: In collaboration with the Business Intelligence (BI) Manager, the Data Engineer will undertake the responsibility of executing and managing Azure Data Factory Pipelines. This includes the design and implementation of the Data Lake, as well as the optimization of data refresh performance. The role encompasses ownership (both execution and...

  • Senior Data Engineer

    58 minutes ago

    Toronto, ON, Canada Prodigy Labs Full time

    Data Engineer with Databricks & Spark ExperienceWe are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.ResponsibilitiesDesign, develop, and maintain data...