Data Engineer-SQL, Python, ETL- Canada

4 weeks ago


Vancouver, Canada Zortechsolutions Full time
Role: Data Engineer-SQL, Python, ETL

Location: Vancouver/CANADA

Duration: Full Time

Job Description

Key Skills required:

  • We are looking for Senior Data Engineering Candidates based out of the Canada.
  • Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in Scala and legacy ones on SQL (which require ongoing maintenance).

Minimum Requirements

  • 5 years experience building scalable Spark data pipelines (preferably using Scala)
  • 3-5 years experience in high level programming languages such as Java, Scala, or Python
  • Proficiency in Spark/MapReduce development and expertise with data processing (ETL) technologies to build and deploy production-quality ETL pipelines
  • Good understanding of distributed storage and compute (S3, Hive, Spark)
  • Experience using ETL framework (ex: Airflow, Flume, Oozie etc.) to build and deploy production-quality ETL pipelines
  • Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
  • Working knowledge of relational databases and expertise in query authoring (SQL) on large datasets
  • Experienced with big data technologies such as Hadoop, Spark, Hive, etc.
  • Experience working with Git and Jira (or other source control and task management tools)
  • Good communication skills that allows smooth collaboration with stakeholders
#J-18808-Ljbffr

  • Vancouver, BC, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETL Location: Vancouver/CANADA Duration: Full Time Job Description Key Skills required: We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in...

  • Senior Data Engineer

    4 weeks ago


    Vancouver, BC, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETL Duration: Full Time We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in...


  • Vancouver, British Columbia, Canada Kabam Full time

    At Kabam, we're constantly raising the bar of excellence in free-to-play gaming. We hire for passion and diversity so that we can triumph in our collective skill. Our teams are made up of a fusion of personalities and interests bound together by a collaborative nature, fun-loving culture, and a drive to do what it takes to make great games. And this is where...

  • Data Engineer

    1 month ago


    Vancouver, BC, Canada MineSense Full time

    Metals are necessary for our world, but mining historically faced issues with waste, sustainability, and inefficiencies. Our solutions reduce mining waste and environmental impacts while increasing profits and efficiencies. Backed by the best in venture capital and government funds, and recognized by tech industry and sustainability programs, MineSense is...

  • Data Engineer

    1 month ago


    Vancouver, BC, Canada Sandman Hotel Group Full time

    Tuesday, February 20, 2024 Proud to be 100% Canadian-owned,Northland Properties' are recognized as one of the most trusted names in hotels, restaurants, resorts, sports, construction, and asset management. Our well-known and loved brands have been bringing people together to celebrate unforgettable experiences across Canada, the US, Ireland, and the UK for...

  • Data Engineer

    1 month ago


    North Vancouver, Canada CB Canada Full time

    Data Engineer (Python or Scala)On behalf of our client, Procom Consultants Group is currently looking for a Data Engineer (Python or Scala). This contract Data Engineer will be responsible for automating the fetching of claims documents from OpenText Content Server and using an open source tool tesseract to extract text from the documents. The extracted...


  • Vancouver, Canada Providence Healthcare Full time

    **Article Flag: Mandatory Vaccination Please Note**: As per the current Public Health Orders (Long Term Care/Seniors Assisted Living Provincial Health Order and the Health Sector Order), as of October 26, 2021, all employees working for Providence Health Care must be fully vaccinated against COVID-19. Proof of vaccination status will be...


  • Vancouver, Canada S I Systems Full time

    Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard Our construction client is looking for an Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard4...


  • Vancouver, Canada S I Systems Full time

    Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard Our construction client is looking for an Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard4...


  • Vancouver, Canada S I Systems Full time

    Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard Our construction client is looking for an Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard4...


  • Vancouver, British Columbia, Canada UBC Full time

    Staff - Non UnionJob CategoryM&P - AAPSJob ProfileAAPS Salaried - Information Systems and Technology, Level DJob TitleData Developer, ETL-1DepartmentReporting - OffboardCompensation Range$8, $12,575.08 CAD MonthlyThe Compensation Range is the span between the minimum and maximum base salary for a position. The midpoint of the range is approximately halfway...

  • Data Engineer

    20 hours ago


    Vancouver, Canada Beatdapp Full time

    Beatdapp is a venture-backed startup delivering the most advanced music streaming fraud and audit technology in the world. Our industry-leading software helps music labels and artists fight the over $2 billion royalties stolen from them each year. Plus, who doesn't love working with the world’s best streaming services, music labels, and artists all...

  • Data Engineer

    19 hours ago


    Vancouver, Canada Beatdapp Full time

    Beatdapp is a venture-backed startup delivering the most advanced music streaming fraud and audit technology in the world. Our industry-leading software helps music labels and artists fight the over $2 billion royalties stolen from them each year. Plus, who doesn't love working with the world’s best streaming services, music labels, and artists all...

  • Data Engineer

    18 hours ago


    Vancouver, Canada Beatdapp Full time

    Beatdapp is a venture-backed startup delivering the most advanced music streaming fraud and audit technology in the world. Our industry-leading software helps music labels and artists fight the over $2 billion royalties stolen from them each year. Plus, who doesn't love working with the world’s best streaming services, music labels, and artists all...

  • Senior Data Engineer

    20 hours ago


    Vancouver, Canada Vancouver Coastal Health Full time

    Salary The salary range for this position is CAD $44.15/Hr. - CAD $63.47/Hr. Job Summary Come work as a Senior Decision Support Advisor with Vancouver Coastal Health (VCH)! Vancouver Coastal Health is looking for a Senior Data Engineer to join the Data & Solutions Infrastructure Team. We are specifically looking for someone who has...

  • Staff Data Engineer

    18 hours ago


    Vancouver, Canada Life360 Full time

    About Life360 Life360’s mission is to keep people close to the ones they love. Our category-leading mobile app and Tile tracking devices empower members to protect the people, pets, and things they care about most with a range of services, including location sharing, safe driver reports, and crash detection with emergency dispatch. Life360 serves...

  • Staff Data Engineer

    18 hours ago


    Vancouver, Canada Life360 Full time

    About Life360 Life360’s mission is to keep people close to the ones they love. Our category-leading mobile app and Tile tracking devices empower members to protect the people, pets, and things they care about most with a range of services, including location sharing, safe driver reports, and crash detection with emergency dispatch. Life360 serves...

  • Staff Data Engineer

    20 hours ago


    Vancouver, Canada Life360 Full time

    About Life360 Life360’s mission is to keep people close to the ones they love. Our category-leading mobile app and Tile tracking devices empower members to protect the people, pets, and things they care about most with a range of services, including location sharing, safe driver reports, and crash detection with emergency dispatch. Life360 serves...


  • Vancouver, Canada Kabam Full time

    At Kabam, we’re constantly raising the bar of excellence in free-to-play gaming. We hire for passion and diversity so that we can triumph in our collective skill. Our teams are made up of a fusion of personalities and interests bound together by a collaborative nature, fun-loving culture, and a drive to do what it takes to make great games. And this is...

  • Data Engineer

    23 hours ago


    Vancouver, Canada Vancouver Coastal Health Full time

    Salary The salary range for this position is CAD $34.68/Hr. - CAD $49.86/Hr. Job Summary As a Data Warehouse Developer with Vancouver Coastal Health you will: Be a part of the Data Management and Reporting technical team with a primary focus on the ongoing sustainment and development of the organisation’s on-premises data...