Data Engineer-SQL, Python, ETL- Canada

2 weeks ago


Vancouver BC, Canada Zortechsolutions Full time

Role: Data Engineer-SQL, Python, ETL

Location: Vancouver/CANADA

Duration: Full Time

Job Description

Key Skills required:

  • We are looking for Senior Data Engineering Candidates based out of the Canada.
  • Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in Scala and legacy ones on SQL (which require ongoing maintenance).

Minimum Requirements

  • 5 years experience building scalable Spark data pipelines (preferably using Scala)
  • 3-5 years experience in high level programming languages such as Java, Scala, or Python
  • Proficiency in Spark/MapReduce development and expertise with data processing (ETL) technologies to build and deploy production-quality ETL pipelines
  • Good understanding of distributed storage and compute (S3, Hive, Spark)
  • Experience using ETL framework (ex: Airflow, Flume, Oozie etc.) to build and deploy production-quality ETL pipelines
  • Demonstrated ability to analyze large data sets to identify gaps and inconsistencies, provide data insights, and advance effective product solutions
  • Working knowledge of relational databases and expertise in query authoring (SQL) on large datasets
  • Experienced with big data technologies such as Hadoop, Spark, Hive, etc.
  • Experience working with Git and Jira (or other source control and task management tools)
  • Good communication skills that allows smooth collaboration with stakeholders
#J-18808-Ljbffr

  • Vancouver, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETLLocation: Vancouver/CANADADuration: Full TimeJob DescriptionKey Skills required: We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala...


  • Vancouver, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETLLocation: Vancouver/CANADADuration: Full TimeJob DescriptionKey Skills required: We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala...


  • Vancouver, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETLLocation: Vancouver/CANADADuration: Full TimeJob DescriptionKey Skills required: We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala...

  • Senior Data Engineer

    2 weeks ago


    Vancouver, BC, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETL Duration: Full Time We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in...

  • Data Engineer

    6 days ago


    Vancouver, BC, Canada Knewin Full time

    We are at the forefront of geolocation, cybersecurity, and anti-fraud innovation, developing and delivering cutting-edge technologies to help ensure regulatory compliance, combat bad online actors, alleviate user friction, and protect businesses from fraud. Achieving significant business and revenue growth over the past three years and dubbed a tech...

  • Data Engineer

    4 weeks ago


    Vancouver, BC, Canada MineSense Full time

    Metals are necessary for our world, but mining historically faced issues with waste, sustainability, and inefficiencies. Our solutions reduce mining waste and environmental impacts while increasing profits and efficiencies. Backed by the best in venture capital and government funds, and recognized by tech industry and sustainability programs, MineSense is...

  • Data Engineer

    3 weeks ago


    Vancouver, BC, Canada Sandman Hotel Group Full time

    Tuesday, February 20, 2024 Proud to be 100% Canadian-owned,Northland Properties' are recognized as one of the most trusted names in hotels, restaurants, resorts, sports, construction, and asset management. Our well-known and loved brands have been bringing people together to celebrate unforgettable experiences across Canada, the US, Ireland, and the UK for...

  • Data Engineer

    3 weeks ago


    North Vancouver, Canada CB Canada Full time

    Data Engineer (Python or Scala)On behalf of our client, Procom Consultants Group is currently looking for a Data Engineer (Python or Scala). This contract Data Engineer will be responsible for automating the fetching of claims documents from OpenText Content Server and using an open source tool tesseract to extract text from the documents. The extracted...


  • Vancouver, Canada Providence Healthcare Full time

    **Article Flag: Mandatory Vaccination Please Note**: As per the current Public Health Orders (Long Term Care/Seniors Assisted Living Provincial Health Order and the Health Sector Order), as of October 26, 2021, all employees working for Providence Health Care must be fully vaccinated against COVID-19. Proof of vaccination status will be...


  • Vancouver, Canada S I Systems Full time

    Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard Our construction client is looking for an Intermediate ETL Developer specializing in Microsoft SQL Server and Power BI to Design and develop ETL processes to enable creation a comprehensive dashboard4...


  • Coquitlam, BC, Canada Factors Group of Nutritional Companies Full time

    As a leading manufacturer of nutritional supplements and other health-building products, we are dedicated to enhancing the wellbeing of our customers - through research, development and delivery of effective nutritional products. It is our mission to contribute to the lives of our customers, employees, suppliers and the communities we serve, in a cooperative...

  • Data Analyst

    1 week ago


    Vancouver, Canada CEO FOUNDRY Full time

    **Data Analyst** **Location: Vancouver, BC** **Position: FULL-TIME - Hybrid** **Responsibilities/ Qualifications**: - 6+ years experience in technical data roles, demonstrating expertise in transforming, shaping, querying and using data to guide decisions. - BA/BS in Computer Science, Mathematics, Statistics, or related field, OR equivalent experience -...


  • Vancouver, BC, Canada S.i. Systems Full time

    Our Healthcare client is seeking a Senior ETL Developer Our Healthcare client is seeking a Senior ETL Developer to work on an SSIS ETL Documentation and Reverse-Engineering Project for the Mental Health and Substance Use (MHSU) Minimum Reporting Requirements (MRR) Dataset Initiative. Contract starts May 15th - August 15th ( hours total) with possible...

  • Senior Consultant

    4 weeks ago


    Vancouver, BC, Canada Lightci Full time

    As our client's search partner, we facilitate the initial stages of the selection process on their behalf. Our client is a global travel & tourism data and analytics company. They help hundreds of tourism organizations navigate change and accelerate tourism by providing comprehensive tourism data (via their insights platform) and by providing a full suite of...

  • Lead Engineer

    1 week ago


    Vancouver, BC, Canada Zonda Full time

    Job Title: Lead Engineer (Data) Location: Vancouver, BC / GVRD Reports To: Director of Data Engineering Job Summary: We are seeking a highly skilled and motivated individual to join our team as a Lead Engineer in Data Operation. As a Lead Engineer in Data Operations, you will be responsible for driving the development of modern data pipelines and...


  • Vancouver, Canada Providence Health Care Full time

    REQ: PHC23-138759 - Work Area: HIM Business Solutions - Base Site: Hornby Street - City: Vancouver - Status: Regular Full Time - FTE: 1.00 - Job Category: Health Information Management - Post date: Jan 18, 2023 - Hours: 0800-1600 - As per the current Public Health Orders (Long Term Care/Seniors Assisted Living Provincial Health Order and the Health Sector...


  • Vancouver, BC, Canada railtown.ai Full time

    As a Senior Machine Learning Engineer, you will work with our growing AI team in developing AI and machine learning (ML) solutions for problems in the software development domain. This position will provide a mix of research and engineering problems as you will be involved in the development of the end-to-end machine learning pipeline, ranging from data...


  • Vancouver, BC, Canada Dentsu International Full time

    Merkle | Cardinal Path empowers brands to harness their data and activate against it in pursuit of their business goals. Our passionate experts act as an extension of our clients' teams, leveraging their deep knowledge to help brands maximize media and technology on the path toward digital transformation. Merkle | Cardinal Path is rapidly expanding its...

  • Senior Data Analyst

    4 weeks ago


    North Vancouver, BC, Canada DarkVision Technologies Full time

    DarkVision, a Koch Engineered Solutions company, is looking for a Senior Data Analyst to join the Data Development Team in North Vancouver, BC. In this role, you will work collaboratively with teammates and other departments in a fast-paced, ever-changing environment to develop and advance the data analysis deliverables supporting the multi-million-dollar...


  • Vancouver, BC, Canada ESSA Technologies Ltd Full time

    Financial Automation Programmer Part time hourly contract ESSA Technologies Ltd. (ESSA) is an employee-owned Canadian environmental consulting company with offices in British Columbia and Ontario. We envision a world where creativity, a focus on learning, and systems thinking are the foundation of innovative solutions to environmental challenges. Our...