Senior Data Engineer

3 weeks ago

Vancouver BC, Canada ActiveState Full time

Senior Data Engineer 
ActiveState is securing open source software supply chains and enhancing dependency management with an on-demand SaaS Platform and CLI tool that lets DevSecOps automatically build any runtime environment using any open source language ecosystem on any platform. We’re building an ambitious language distribution platform so that no engineer ever has to suffer dependency hell again, and we need your help

This position is open to full-time telecommuters anywhere in Canada or continental US. You can also choose to work from our headquarters in beautiful Vancouver, BC.
We’re building up our systems to scale out to more languages and ecosystems, and we’re looking for someone who knows how to find, ingest, analyze, interpret, and improve open source ecosystem data to help us secure the Internet’s source code
Our audacious goal is to build all of the open source software released on the internet completely from source, in an automated and repeatable way. As a Senior Data Ingestion Engineer, your challenge is to build repeatable and maintainable data ingestion pipelines where we can make improvements over time to get more and better data.
good coding skills are a must. We ingest information about open source languages and libraries from all corners of the Internet, including upstream code repositories, public source control hosting systems, and vulnerability tracking systems.
in many circumstances, the data we need is not available in an easily-accessible format and we need to invent ways to get it and get it right, at scale. Understanding and gathering data from the Internet for open source languages and libraries.
Improving the quality of our data and pipelines by building automated monitoring and improvements systems that allow our data to get better over time.
Designing, building, deploying, and managing tools and processes to help colleagues understand data, especially in the context of open source languages, libraries, and build systems.
Designing, building, and managing ETL and warehousing pipelines, including recommending tools, technologies, and practices for us to adopt.
Testing and documenting your work.
The chance to grow and grow with a team, as we expand our data portfolio and team.
The chance to work on a project that will change the work lives of developers around the world, including your own
3+ years of experience with ETL and data management technologies (for example, Airflow, Snowflake, and Matillion), especially for use with unstructured or semi-structured data
Strong development experience with at least one of the following languages:
Python
Ruby
Java

Demonstrated ability to develop, customize, deploy, and maintain and develop business intelligence software.
Experience creating and optimizing data models.
Demonstrated ability to perform, validate and document both ad hoc and automated data analysis and reporting. Ability to apply statistical methods to data sets is a plus.
Excellent written and spoken communication skills, both technical and non-technical, including the ability to make data and analysis understandable and relevant to a diverse set of audiences.
ASSETS
Build engineering, especially for languages such as Java, Go, and Rust
Open Source projects and culture, especially dependency management and library maintenance
Data processing, messaging, and workflow technologies such as Kafka, Map/Reduce, Hadoop, Hive, PrestoDB, Luigi, Airflow, Storm, Argo etc.
Data engineering in cloud environments, especially AWS and GCP
Agile processes, including breaking large projects up into smaller stories, estimation, working in branches (GitHub Flow), code review, and CI
Practical development in Go, Perl, Python, Tcl, Elm, Java, and Ruby
Data science and/or machine learning
We’re a polyglot company and embrace using the best language or tool for the given task at hand. We gladly use Python, Elm, JavaScript, Golang, Bazel, Docker, Kubernetes, Haskell, Airflow, and other modern tools. Quality is as important as speed. We’re building for the long run, so you’ll need to enjoy writing tests and documentation too.
We use open source software whenever possible, and we also like to contribute back to the open source ecosystem. Our day to day work practices are centered around GitHub, pull requests, code review, continuous testing, integration, and deployment, and agile development. We coordinate with each other and the rest of the company using Slack for chat, Zoom for video calls and screen sharing, Jira, and Google Drive. We’re always looking to improve our practices and we expect you to help us to do so.
Our company is a team of 65+ and growing, with half of the positions in technical roles. We maintain a set of core, overlapping hours, but we’re flexible with specific start and end times and are understanding about appointments and life events.

  • Senior Engineer- data engineering

    1 month ago

    Vancouver, BC, Canada railtown.ai Full time

    As a Senior Machine Learning Engineer, you will work with our growing AI team in developing AI and machine learning (ML) solutions for problems in the software development domain. This position will provide a mix of research and engineering problems as you will be involved in the development of the end-to-end machine learning pipeline, ranging from data...

  • Senior Data Engineer

    1 week ago

    Vancouver, BC, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems.We are a small company that encourages participation in the entire product development process. You will have the opportunity...

  • Senior Data Engineer

    4 weeks ago

    Vancouver, BC, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems.We are a small company that encourages participation in the entire product development process. You will have the opportunity...

  • Senior Data Engineer

    4 weeks ago

    Vancouver, BC, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems.We are a small company that encourages participation in the entire product development process. You will have the opportunity...

  • Senior Data Engineer

    1 week ago

    Vancouver, BC, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems.We are a small company that encourages participation in the entire product development process. You will have the opportunity...

  • Senior Data Engineer

    2 weeks ago

    Vancouver, BC, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems.We are a small company that encourages participation in the entire product development process. You will have the opportunity...

  • Senior Data Engineer

    3 weeks ago

    Vancouver, BC, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems. We are a small company that encourages participation in the entire product development process. You will have the...

  • Data Engineer

    2 months ago

    Vancouver, BC, Canada Fraser Health Full time

    Salary range The salary range for this position is CAD $37.01 - $53.20 / hour Why Fraser Health? Fraser Health is responsible for the delivery of hospital and community-based health services from Burnaby to Fraser Canyon on the traditional, ancestral and unceded territories of the Coast Salish and Nlaka’pamux Nations and is home to six Métis Chartered...

  • Senior Data Engineer

    1 month ago

    Surrey, BC, Canada Fraser Health Full time

    Salary range The salary range for this position is CAD $45.46 - $65.35 / hour Why Fraser Health? Fraser Health is responsible for the delivery of hospital and community-based health services to over 1.9 million people in 20 diverse communities from Burnaby to Fraser Canyon on the traditional territories of the Coast Salish and Nlaka’pamux Nations. Our...

  • Senior Data Engineer

    1 month ago

    Vancouver, BC, Canada Zortechsolutions Full time

    Role: Data Engineer-SQL, Python, ETL Duration: Full Time We are looking for Senior Data Engineering Candidates based out of the Canada. Expertise in SQL, Python and ETL flows is a must have. Medium expertise/working knowledge in Scala is also needed, as our data pipelines are written in both Scala and Hive/Spark SQL, with new pipelines being written in...

  • Senior Data Engineer

    3 weeks ago

    Vancouver, BC, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems. We are a small company that encourages participation in the entire product development process. You will have the...

  • Senior Data Engineers

    2 weeks ago

    Vancouver, British Columbia, Canada TEEMA Full time

    Job Title: Senior Data EngineersJob ID: GB Location: Vancouver, BCOverview:Our terrific client is a direct-to-consumer (DTC) ecommerce platform purpose built for the wine production industry. The platform architecture – a multi-tenant SaaS application - includes a data and analytics system for applying industry-wide analyses to increase sales by...

  • Senior Data Engineers

    1 week ago

    Vancouver, British Columbia, Canada TEEMA Full time

    Job Title: Senior Data EngineersJob ID: GB Location: Vancouver, BCOverview:Our terrific client is a direct-to-consumer (DTC) ecommerce platform purpose built for the wine production industry. The platform architecture – a multi-tenant SaaS application - includes a data and analytics system for applying industry-wide analyses to increase sales by...

  • Senior Data Engineer

    3 weeks ago

    Vancouver, Canada Vancouver Coastal Health Full time

    Salary The salary range for this position is CAD $44.15/Hr. - CAD $63.47/Hr. Job Summary Come work as a Senior Decision Support Advisor with Vancouver Coastal Health (VCH)! Vancouver Coastal Health is looking for a Senior Data Engineer to join the Data & Solutions Infrastructure Team. We are specifically looking for someone who has...

  • Senior Data Engineer

    2 weeks ago

    Vancouver, Canada Vancouver Coastal Health Full time

    Salary The salary range for this position is CAD $44.15/Hr. - CAD $63.47/Hr. Job Summary Come work as a Senior Decision Support Advisor with Vancouver Coastal Health (VCH)! Vancouver Coastal Health is looking for a Senior Data Engineer to join the Data & Solutions Infrastructure Team. We are specifically looking for someone who has...

  • Senior Data Engineer

    2 months ago

    Vancouver, Canada Unblocked Full time

    As a senior data engineer working at Unblocked, you will be part of an experienced group of engineers who thrive on building products that our customers love. We have a track record of building developer tools that solve real problems. We are a small company that encourages participation in the enti

  • Senior Data Engineer

    1 week ago

    Vancouver, British Columbia, Canada Kabam Full time

    At Kabam, we're constantly raising the bar of excellence in free-to-play gaming. We hire for passion and diversity so that we can triumph in our collective skill. Our teams are made up of a fusion of personalities and interests bound together by a collaborative nature, fun-loving culture, and a drive to do what it takes to make great games. And this is where...

  • Senior Data Engineer

    4 weeks ago

    Vancouver, British Columbia, Canada Kabam Full time

    At Kabam, we're constantly raising the bar of excellence in free-to-play gaming. We hire for passion and diversity so that we can triumph in our collective skill. Our teams are made up of a fusion of personalities and interests bound together by a collaborative nature, fun-loving culture, and a drive to do what it takes to make great games. And this is where...

  • Senior Engineer, Data

    4 weeks ago

    North Vancouver, BC, Canada Stellar Recruitment Inc. Full time

    Are you passionate about leveraging cutting-edge technologies to drive innovation? As a Senior DevOps Engineer with expertise in Machine Learning (ML), you'll spearhead the development of robust pipelines for ML systems in production, while championing best practices in MLOps. Responsibilities:Guide the development of pipelines for ML systems in production,...

  • Senior Software Engineer

    1 week ago

    Vancouver, Canada Microsoft Full time

    Overview Join our Data Engineering team as a Senior Software Engineer - Data Engineering to build the next-gen communication platform with Azure Communication Services. Azure Communication Services (ACS) is a rapidly growing product that provides reliable and high-quality SMS, Chat, PSTN, Audio/Video calling, meeting, and other communication...