Data Engineer-SQL, Python, ETL- Canada

1 month ago


Vancouver, Canada Zortechsolutions Full time
Role: Data Engineer-SQL, Python, ETL

Location: Vancouver/CANADA

Duration: Full Time

Job Description

Key Skills required:

  • We are looking for Senior Data Engineering Candidates based out of the Canada.
  • Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in Scala and legacy ones on SQL (which require ongoing maintenance).

Minimum Requirements

  • 5 years experience building scalable Spark data pipelines (preferably using Scala)
  • 3-5 years experience in high level programming languages such as Java, Scala, or Python
  • Proficiency in Spark/MapReduce development and expertise with data processing (ETL) technologies to build and deploy production-quality ETL pipelines
  • Good understanding of distributed storage and compute (S3, Hive, Spark)
  • Experience using ETL framework (ex: Airflow, Flume, Oozie etc.) to build and deploy production-quality ETL pipelines
  • Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
  • Working knowledge of relational databases and expertise in query authoring (SQL) on large datasets
  • Experienced with big data technologies such as Hadoop, Spark, Hive, etc.
  • Experience working with Git and Jira (or other source control and task management tools)
  • Good communication skills that allows smooth collaboration with stakeholders
#J-18808-Ljbffr

  • Vancouver, BC, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETL Location: Vancouver/CANADA Duration: Full Time Job Description Key Skills required: We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in...

  • Senior Data Engineer

    1 month ago


    Vancouver, BC, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETL Duration: Full Time We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in...

  • Senior Data Engineer

    2 weeks ago


    Vancouver, British Columbia, Canada Kabam Full time

    At Kabam, we're constantly raising the bar of excellence in free-to-play gaming. We hire for passion and diversity so that we can triumph in our collective skill. Our teams are made up of a fusion of personalities and interests bound together by a collaborative nature, fun-loving culture, and a drive to do what it takes to make great games. And this is where...

  • Data Engineer

    1 month ago


    Vancouver, BC, Canada MineSense Full time

    Metals are necessary for our world, but mining historically faced issues with waste, sustainability, and inefficiencies. Our solutions reduce mining waste and environmental impacts while increasing profits and efficiencies. Backed by the best in venture capital and government funds, and recognized by tech industry and sustainability programs, MineSense is...

  • Data Engineer

    1 month ago


    Vancouver, BC, Canada Sandman Hotel Group Full time

    Tuesday, February 20, 2024 Proud to be 100% Canadian-owned,Northland Properties' are recognized as one of the most trusted names in hotels, restaurants, resorts, sports, construction, and asset management. Our well-known and loved brands have been bringing people together to celebrate unforgettable experiences across Canada, the US, Ireland, and the UK for...

  • Data Engineer

    1 month ago


    North Vancouver, Canada CB Canada Full time

    Data Engineer (Python or Scala)On behalf of our client, Procom Consultants Group is currently looking for a Data Engineer (Python or Scala). This contract Data Engineer will be responsible for automating the fetching of claims documents from OpenText Content Server and using an open source tool tesseract to extract text from the documents. The extracted...


  • Vancouver, Canada Amazon Canada Fulfillment Services, ULC - B85 Full time

    As a Data Engineer, you will be working in one of the world's largest and most complex data warehouse environments. You will design, implement and support scalable data infrastructure solutions to integrate with multi heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in reporting, analysis, machine...


  • Vancouver, Canada Providence Healthcare Full time

    **Article Flag: Mandatory Vaccination Please Note**: As per the current Public Health Orders (Long Term Care/Seniors Assisted Living Provincial Health Order and the Health Sector Order), as of October 26, 2021, all employees working for Providence Health Care must be fully vaccinated against COVID-19. Proof of vaccination status will be...


  • Vancouver, Canada S I Systems Full time

    Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard Our construction client is looking for an Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard4...


  • Vancouver, Canada S I Systems Full time

    Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard Our construction client is looking for an Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard4...


  • Vancouver, Canada S I Systems Full time

    Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard Our construction client is looking for an Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard4...

  • Data Developer, ETL-1

    2 weeks ago


    Vancouver, British Columbia, Canada UBC Full time

    Staff - Non UnionJob CategoryM&P - AAPSJob ProfileAAPS Salaried - Information Systems and Technology, Level DJob TitleData Developer, ETL-1DepartmentReporting - OffboardCompensation Range$8, $12,575.08 CAD MonthlyThe Compensation Range is the span between the minimum and maximum base salary for a position. The midpoint of the range is approximately halfway...

  • Data Engineer

    7 days ago


    Vancouver, Canada Beatdapp Full time

    Beatdapp is a venture-backed startup delivering the most advanced music streaming fraud and audit technology in the world. Our industry-leading software helps music labels and artists fight the over $2 billion royalties stolen from them each year. Plus, who doesn't love working with the world’s best streaming services, music labels, and artists all...

  • Data Engineer

    7 days ago


    Vancouver, Canada Beatdapp Full time

    Beatdapp is a venture-backed startup delivering the most advanced music streaming fraud and audit technology in the world. Our industry-leading software helps music labels and artists fight the over $2 billion royalties stolen from them each year. Plus, who doesn't love working with the world’s best streaming services, music labels, and artists all...

  • Data Engineer

    7 days ago


    Vancouver, Canada Beatdapp Full time

    Beatdapp is a venture-backed startup delivering the most advanced music streaming fraud and audit technology in the world. Our industry-leading software helps music labels and artists fight the over $2 billion royalties stolen from them each year. Plus, who doesn't love working with the world’s best streaming services, music labels, and artists all...


  • Vancouver, Canada Vancouver Coastal Health Full time

    Salary The salary range for this position is CAD $44.15/Hr. - CAD $63.47/Hr. Job Summary Come work as a Senior Decision Support Advisor with Vancouver Coastal Health (VCH)! Vancouver Coastal Health is looking for a Senior Data Engineer to join the Data & Solutions Infrastructure Team. We are specifically looking for someone who has...

  • Staff Data Engineer

    7 days ago


    Vancouver, Canada Life360 Full time

    About Life360 Life360’s mission is to keep people close to the ones they love. Our category-leading mobile app and Tile tracking devices empower members to protect the people, pets, and things they care about most with a range of services, including location sharing, safe driver reports, and crash detection with emergency dispatch. Life360 serves...

  • Staff Data Engineer

    7 days ago


    Vancouver, Canada Life360 Full time

    About Life360 Life360’s mission is to keep people close to the ones they love. Our category-leading mobile app and Tile tracking devices empower members to protect the people, pets, and things they care about most with a range of services, including location sharing, safe driver reports, and crash detection with emergency dispatch. Life360 serves...

  • Staff Data Engineer

    7 days ago


    Vancouver, Canada Life360 Full time

    About Life360 Life360’s mission is to keep people close to the ones they love. Our category-leading mobile app and Tile tracking devices empower members to protect the people, pets, and things they care about most with a range of services, including location sharing, safe driver reports, and crash detection with emergency dispatch. Life360 serves...

  • Data Analyst

    5 days ago


    Vancouver, Canada Vancouver City Savings Credit Union Full time

    Vancity is the largest private sector Living Wage Employer in Canada and have been consistently recognized as one of the Top Employers in Canada. Come join our team of 2,600 diverse individuals and access competitive rewards & benefits, all while knowing you are a part of a greater movement. The** Data Analyst **is required to analyze the data requirements...