Senior Data Engineer

3 weeks ago


Greater Vancouver, Canada Insight Global Full time

Must-haves

Masters Degree in Business Administration, Information Systems or equivalent.

Five years' recent, related experience including technical experience in working with databases and decision support tools, preferably in a health care setting or equivalent industry/certification experience (e.g. Databricks Data Engineer Associate, Databricks Data Engineer Professional, Microsoft Azure Data Engineer Associate).

Five years experience in Information Technology with focus in database development, warehousing, and/or data engineering.

Expertise using the Databricks platform and understanding the concepts of Databricks SQL, Delta Lake, cluster management.

Experience in optimization of pipelines and processes of Databricks platform.

Strong proficiency in Databricks SQL, Python, Scala with an ability to write efficient and scalable code for data processing/transformation tasks.

Experience building and optimizing data pipelines (ETL/ELT).

Strong understanding of DevOps and MLOps practices focusing on version control (Git), CI/CD pipelines, and automated testing frameworks.

Experience using big data processing frameworks such as Apache Spark & Hadoop.

Strong understanding of Spark RDD's, data frames, and API's for data manipulation.

Knowledge of data modelling and data warehousing principles.

Knowledge using cloud data warehousing solutions (e.g. Azure SQL, Synapse Analytics, Snowflake).

Advanced analytical and problem solving skills.

Plusses

Day-to-Day

Insight Global is looking for a Data Engineer to join the Data & Solutions Infrastructure team for one of BC's leading health authorities. This resource will be instrumental in maintaining and advancing data infrastructure. Take charge of both cloud-based and local data systems, ensuring their continuous improvement and operational stability.

This resource will be responsible for engineering scalable and efficient data integration systems that support extensive analysis, model crafting, validation, and deployment. Work alongside diverse teams to pinpoint and realize forward-thinking solutions that cater to the informational requisites of the health authority.



  • Vancouver, Canada Fraser Health Full time

    Salary range The salary range for this position is CAD $45.46 - $65.35 / hour Why Fraser Health? Fraser Health is responsible for the delivery of hospital and community-based health services to over 1.9 million people in 20 diverse communities from Burnaby to Fraser Canyon on the traditional territories of the Coast Salish and Nlaka'pamux Nations....


  • Vancouver, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems.We are a small company that encourages participation in the entire product development process. You will have the opportunity...

  • Senior Data Engineer

    3 weeks ago


    Vancouver, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems.We are a small company that encourages participation in the entire product development process. You will have the opportunity...

  • Senior Data Engineer

    3 weeks ago


    Vancouver, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems.We are a small company that encourages participation in the entire product development process. You will have the opportunity...

  • Senior Data Engineer

    3 weeks ago


    Vancouver, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems. We are a small company that encourages participation in the entire product development process. You will have the...


  • Vancouver, BC, Canada railtown.ai Full time

    As a Senior Machine Learning Engineer, you will work with our growing AI team in developing AI and machine learning (ML) solutions for problems in the software development domain. This position will provide a mix of research and engineering problems as you will be involved in the development of the end-to-end machine learning pipeline, ranging from data...

  • Data Engineer

    3 weeks ago


    Vancouver, BC, Canada Fraser Health Full time

    Salary range The salary range for this position is CAD $37.01 - $53.20 / hour Why Fraser Health? Fraser Health is responsible for the delivery of hospital and community-based health services from Burnaby to Fraser Canyon on the traditional, ancestral and unceded territories of the Coast Salish and Nlaka’pamux Nations and is home to six Métis Chartered...


  • Vancouver, Canada Celestial Systems Full time

    Celestial Systems, a name synonymous with Enterprise Softwaredevelopment since 2001. By designingreliable software,delivering quality services, and developing valuable partnerships, we are on a journey of continuousinnovation. Ourenterprise-level experience in engineering enables us to offer critical development services fororganizations to besuccessful in...


  • Vancouver, Canada Celestial Systems Full time

    Celestial Systems, a name synonymous with Enterprise Softwaredevelopment since 2001. By designingreliable software,delivering quality services, and developing valuable partnerships, we are on a journey of continuousinnovation. Ourenterprise-level experience in engineering enables us to offer critical development services fororganizations to besuccessful in...


  • Vancouver, Canada Celestial Systems Full time

    Celestial Systems, a name synonymous with Enterprise Softwaredevelopment since 2001. By designingreliable software,delivering quality services, and developing valuable partnerships, we are on a journey of continuousinnovation. Ourenterprise-level experience in engineering enables us to offer critical development services fororganizations to besuccessful in...

  • Senior Data Engineer

    2 weeks ago


    Vancouver, BC, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETL Duration: Full Time We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in...


  • Greater Vancouver, Canada Electronic Arts (EA) Full time

    Electronic Arts - Senior Systems EngineerThe Senior Systems Engineer (Perforce) is a subject matter expert and key technical contributor on our specialist operations team that supports EA’s large and complex source code and asset repositories across the globe. They use their Linux systems engineering and application support skills to maintain high quality...


  • Greater Vancouver, Canada Electronic Arts (EA) Full time

    Electronic Arts - Senior Systems EngineerThe Senior Systems Engineer (Perforce) is a subject matter expert and key technical contributor on our specialist operations team that supports EA’s large and complex source code and asset repositories across the globe. They use their Linux systems engineering and application support skills to maintain high quality...


  • Greater Vancouver, Canada Electronic Arts (EA) Full time

    Electronic Arts - Senior Systems Engineer The Senior Systems Engineer (Perforce) is a subject matter expert and key technical contributor on our specialist operations team that supports EA’s large and complex source code and asset repositories across the globe. They use their Linux systems engineering and application support skills to maintain high...


  • Vancouver, BC, Canada Celestial Systems Full time

    Celestial Systems, a name synonymous with Enterprise Softwaredevelopment since 2001. By designingreliable software,delivering quality services, and developing valuable partnerships, we are on a journey of continuousinnovation. Ourenterprise-level experience in engineering enables us to offer critical development services fororganizations to besuccessful in...


  • Vancouver, Canada Vancouver Airport Authority Full time

    YVR is made up of a team of diverse people who are working collaboratively to Connect BC Proudly to the World. Safety is at the core of everything we do; we’re innovative, fun, and we invest in our people. We’re a BC Top Employer for 14 years standing, with high engagement scores, an abundance of learning and development opportunities, and a holistic...


  • Vancouver, Canada Vancouver Airport Authority Full time

    YVR is made up of a team of diverse people who are working collaboratively to Connect BC Proudly to the World. Safety is at the core of everything we do; we’re innovative, fun, and we invest in our people. We’re a BC Top Employer for 14 years standing, with high engagement scores, an abundance of learning and development opportunities, and a holistic...


  • Vancouver, Canada Vancouver Airport Authority Full time

    YVR is made up of a team of diverse people who are working collaboratively to Connect BC Proudly to the World. Safety is at the core of everything we do; we’re innovative, fun, and we invest in our people. We’re a BC Top Employer for 14 years standing, with high engagement scores, an abundance of learning and development opportunities, and a holistic...


  • Vancouver, British Columbia, Canada Microsoft Canada Full time

    OverviewJoin our Data Engineering team as a Senior Software Engineer - Data Engineering to build the next-gen communication platform with Azure Communication Services. Azure Communication Services (ACS) is a rapidly growing product that provides reliable and high-quality SMS, Chat, PSTN, Audio/Video calling, meeting, and other communication services. We...

  • Senior Data Engineer

    2 weeks ago


    Vancouver, BC, Canada Knewin Full time

    We are at the forefront of geolocation, cybersecurity, and anti-fraud innovation, developing and delivering cutting-edge technologies to help ensure regulatory compliance, combat bad online actors, alleviate user friction, and protect businesses from fraud. Achieving significant business and revenue growth over the past three years and dubbed a tech...