Data Engineer

3 days ago

Victoria, British Columbia, Canada Atreides Full time
About Atreides

Atreides is a pioneering organization that specializes in transforming complex data into actionable insights. Our mission is to empower defense intelligence professionals with cutting-edge data solutions, enabling them to derive valuable insights in minutes.

Job Overview

We are seeking a highly skilled Data Engineer & DevOps Specialist to join our team. As a key member of our data engineering team, you will be responsible for designing, implementing, and optimizing data pipelines and storage solutions to manage our extensive datasets.

Key Responsibilities
  • Design and develop scalable data pipelines using Spark, Scala, Java, and Python.
  • Implement and manage Iceberg tables for efficient data storage and retrieval.
  • Develop and enforce data retention policies and ensure compliance with data governance standards.
  • Collaborate with infrastructure engineers to integrate data processes with AWS infrastructure and automation tools.
  • Ensure data security and implement necessary measures to protect sensitive information.
  • Monitor and troubleshoot data pipelines to ensure high availability and performance.
  • Document data engineering processes and maintain comprehensive documentation.
Requirements
  • 3+ years of experience in data engineering or related roles.
  • Proficiency in Spark, Scala, Java, and Python.
  • Strong understanding of data optimization, storage solutions, and data retention policies.
  • Familiarity with AWS or Azure infrastructure and site reliability engineering principles.
  • Knowledge of big data tools and environments, having previously worked with at least 100TB of data at production scale.
  • Familiarity with geospatial data formats such as Parquet/GeoParquet, GeoJSON, and Shapefiles.
  • Proven experience in implementing and managing Iceberg tables for efficient data storage and retrieval.
  • Experience with data orchestration tools such as Airflow, Prefect, Dagster, or Temporal.
What We Offer
  • Comprehensive health, dental, and vision insurance plans.
  • Flexible hybrid work environment.
  • Additional benefits like flexible hours, work travel opportunities, competitive vacation time, and parental leave.

  • Data Engineer

    6 days ago

    Victoria, British Columbia, Canada Atreides Full time

    About AtreidesAtreides is a fast-growing, early-stage company that specializes in transforming large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions. Our mission is to help organizations derive insights in minutes, making the world safer, stronger, and more prosperous.Job OverviewWe are seeking a skilled Data Engineer &...

  • Data Engineer

    7 days ago

    Victoria, British Columbia, Canada Atreides Full time

    About AtreidesAtreides is a fast-growing, early-stage company that specializes in transforming large and complex multi-modal datasets into information-rich, geo-spatial data subscriptions. Our mission is to help organizations derive insights in minutes, making the world safer, stronger, and more prosperous.Job OverviewWe are seeking a skilled Data Engineer &...

  • Senior DevSecOps Engineer

    4 days ago

    Victoria, British Columbia, Canada NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior DevSecOps Specialist to join our team at NTT DATA. As a key member of our team, you will be responsible for designing, implementing, and maintaining our cloud-based infrastructure and applications.Key ResponsibilitiesDesign and implement secure cloud-based infrastructure and applicationsDevelop and...

  • Senior DevSecOps Engineer

    3 days ago

    Victoria, British Columbia, Canada NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior DevSecOps Specialist to join our team at NTT DATA. As a key member of our team, you will be responsible for designing, implementing, and maintaining our cloud-based infrastructure and applications.Key ResponsibilitiesDesign and implement secure cloud-based infrastructure and applicationsDevelop and...

  • GIS Data Engineer with ETL Focus

    3 weeks ago

    Victoria, British Columbia, Canada VertiGIS Full time

    Shape the Future of Geospatial Data EngineeringVertiGIS is seeking a talented GIS-Data-Engineer to join our Professional Services team. As a key contributor, you will play a vital role in developing and implementing innovative tools and processes for automating data verification and migration tasks within utility networks.Your Responsibilities:Data...

  • Data Analyst

    6 days ago

    Victoria, British Columbia, Canada BCI Full time

    About the RoleWe are seeking a highly skilled Data Analyst to join our team at BCI. As a Data Analyst, you will play a key role in supporting our Public Markets Operations team by providing strategic insights through developing and implementing interactive, on-demand analytical tools and solutions.Key ResponsibilitiesCollaborate with Portfolio Managers and...

  • Data Analyst

    1 week ago

    Victoria, British Columbia, Canada BCI Full time

    About the RoleWe are seeking a highly skilled Data Analyst to join our team at BCI. As a Data Analyst, you will play a key role in supporting our Public Markets Operations team by providing strategic insights through developing and implementing interactive, on-demand analytical tools and solutions.Key ResponsibilitiesCollaborate with Portfolio Managers and...

  • Environmental Data Specialist

    4 weeks ago

    Victoria, British Columbia, Canada BC Transit Full time

    Position Overview:The Office of Sustainability is seeking a dedicated Sustainability Data Analyst to contribute to our mission of enhancing public transportation through data-driven insights.Employment Type: Temporary Full Time (12 months)As a member of our Enterprise Data & Analytics team, you will play a crucial role in maintaining the quality and...

  • GIS System Administrator

    1 week ago

    Victoria, British Columbia, Canada Pinchin Ltd. Full time

    About the RoleWe are seeking a highly skilled GIS System Administrator to join our Integrated Digital Services (IDS) Team at Pinchin Ltd. As a key member of our team, you will be responsible for the management, maintenance, and optimization of our Geographic Information System (GIS) infrastructure.Key ResponsibilitiesGIS Platform Management: Oversee the...

  • GIS System Administrator

    7 days ago

    Victoria, British Columbia, Canada Pinchin Ltd. Full time

    About the RoleWe are seeking a highly skilled GIS System Administrator to join our Integrated Digital Services (IDS) Team at Pinchin Ltd. As a key member of our team, you will be responsible for the management, maintenance, and optimization of our Geographic Information System (GIS) infrastructure.Key ResponsibilitiesGIS Platform Management: Oversee the...

  • Automation Engineer

    12 hours ago

    Victoria, British Columbia, Canada Associated Engineering Full time

    Job Title Instrumentation and Controls (Automation) Engineer or TechnologistLocation Various offices across British ColumbiaCategory Electrical Instrumentation & ControlsJob Type Full-time permanentJob Description Associated Engineering is seeking an experienced Instrumentation and Controls (Automation) Engineer or Technologist to join our team. As a key...

  • Automation Engineer

    8 hours ago

    Victoria, British Columbia, Canada Associated Engineering Full time

    Job Title Instrumentation and Controls (Automation) Engineer or TechnologistLocation Various offices across British ColumbiaCategory Electrical Instrumentation & ControlsJob Type Full-time permanentJob Description Associated Engineering is seeking an experienced Instrumentation and Controls (Automation) Engineer or Technologist to join our team. As a key...

  • Infrastructure Systems Engineer

    2 days ago

    Victoria, British Columbia, Canada S.i. Systems Full time

    Job Summary:S.i. Systems is seeking a highly skilled Infrastructure Systems Engineer to join our team. As a key member of our technical staff, you will be responsible for leading the migration of our DNS services to a third-party application, ensuring minimal disruption to our operational services.Key Responsibilities:Migrate existing in-house DNS services...

  • Infrastructure Systems Engineer

    2 days ago

    Victoria, British Columbia, Canada S.i. Systems Full time

    Job Summary:S.i. Systems is seeking a highly skilled Infrastructure Systems Engineer to join our team. As a key member of our technical staff, you will be responsible for leading the migration of our DNS services to a third-party application, ensuring minimal disruption to our operational services.Key Responsibilities:Migrate existing in-house DNS services...

  • Naval Architect Submarine Engineer

    4 days ago

    Victoria, British Columbia, Canada Babcock Mission Critical Services España SA. Full time

    Job SummaryWe are seeking a highly skilled Naval Architect Submarine Engineer to join our team at Babcock Mission Critical Services España SA. As a key member of our waterfront Naval Architecture team, you will provide professional engineering direction and oversight for the analysis and repair of submarine steel structures and hull systems.Key...

  • Naval Architect Submarine Engineer

    4 days ago

    Victoria, British Columbia, Canada Babcock Mission Critical Services España SA. Full time

    Job SummaryWe are seeking a highly skilled Naval Architect Submarine Engineer to join our team at Babcock Mission Critical Services España SA. As a key member of our waterfront Naval Architecture team, you will provide professional engineering direction and oversight for the analysis and repair of submarine steel structures and hull systems.Key...

  • Python and Kubernetes Software Engineer

    5 days ago

    Victoria, British Columbia, Canada Canonical - Jobs Full time

    Python and Kubernetes Specialist Engineer Canonical is a leading provider of open source software and operating systems to the global enterprise and technology markets. Our platform, Ubuntu, is widely used in breakthrough enterprise initiatives such as public cloud, data science, AI, engineering innovation and IoT. About the Role Collaborate on an...

  • Geotechnical Engineer in Training

    5 days ago

    Victoria, British Columbia, Canada Coast Geotechnical Consulting Full time

    About the Role:We are seeking a highly motivated and adaptable Geotechnical Engineer in Training to join our dynamic team at Coast Geotechnical Consulting. As a key member of our geotechnical team, you will have the opportunity to gain hands-on experience and mentorship while assisting with geotechnical site investigations, analysis, design, and construction...

  • Geotechnical Engineer in Training

    5 days ago

    Victoria, British Columbia, Canada Coast Geotechnical Consulting Full time

    About the Role:We are seeking a highly motivated and adaptable Geotechnical Engineer in Training to join our dynamic team at Coast Geotechnical Consulting. As a key member of our geotechnical team, you will have the opportunity to gain hands-on experience and mentorship while assisting with geotechnical site investigations, analysis, design, and construction...

  • Software Engineering Lead

    12 hours ago

    Victoria, British Columbia, Canada Infusion Edutainment AI&VR&AR Tech Development Ltd. Full time

    Job Title: Software Engineering LeadWe are seeking a highly skilled Software Engineering Lead to join our team at Infusion Edutainment AI&VR&AR Tech Development Ltd. The successful candidate will be responsible for leading the development of software and integrated information systems, process control software, and other embedded software control systems.Key...