Staff Data Engineer

2 months ago

Burnaby, British Columbia, Canada Infoblox Full time
About the Role

We are seeking a highly skilled Staff Data Engineer to join our Cloud Engineering team in Burnaby, BC, reporting to the senior manager of Software Engineering.

Key Responsibilities
  • Curate large-scale data from a multitude of sources into appropriate sets for research and development for the data scientists, threat analysts, and developers across the company.
  • Design, test, and implement storage solutions for various consumers of the data, especially data warehouses like ClickHouse and OpenSearch.
  • Design and implement mechanisms to monitor data sources over time for changes using summarization, monitoring, and statistical methods.
  • Design, develop, and maintain APIs that enable seamless data integration and retrieval processes for internal and external applications, and ensure these APIs are scalable, secure, and efficient to support high-volume data interactions.
  • Leverage computer science algorithms and constructs, including probabilistic data structures, to distill large data into sources of insight and enable future analytics.
  • Convert prototypes into production data engineering solutions through disciplined software engineering practices, Spark optimizations, and modern deployment pipelines.
  • Collaborate on design, implementation, and deployment of applications with the rest of software engineering.
  • Support data scientists and Product teams in building, debugging, and deploying Spark applications that best leverage data.
  • Build and maintain tools for automation, deployment, monitoring, and operations.
  • Create test plans, test cases, and run tests with automated tools.
Requirements
  • 12+ years of experience with Python3, and 2+ years of experience with Spark; Scala experience is helpful.
  • 5+ years of experience in data engineering, data science, and related data-centric fields using large-scale data environments.
  • 3+ years of experience in using SQL and working with modern relational databases, including MySQL or PostgreSQL.
  • 3+ years of experience with developing ETL pipelines and data manipulation scripts.
  • Experience working with ClickHouse data warehouse.
  • Expertise in designing and developing APIs, preferably RESTful, for data access and manipulation in a distributed environment.
  • Proficient in Object Oriented Design and S.O.L.I.D principles.
  • Emphasis on unit testing and code quality.
  • Proficient with AWS products, including EMR, S3, VPC, EC2, Athena, etc.
  • Bachelor's or master's degree in computer science or a related field, or equivalent work experience required.
What Success Looks Like
  • After six months, you will have completed onboarding by demonstrating knowledge of the Data Lake and associated technologies and CI/CD processes by deploying ETL pipelines for curation and warehousing to production.
  • After about a year, you will be an expert on the Data Lake target state architecture and drive engineering design and grooming sessions for new feature development.
About Infoblox

We've created a culture that embraces and rewards innovation, curiosity, and creativity. We achieve remarkable results by working together in a supportive environment that focuses on continuous learning and embraces change.

  • Staff Data Engineer

    3 weeks ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Staff Data EngineerInfoblox is seeking a highly skilled Staff Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a key member of our team, you will play a critical role in developing platforms and products for Infoblox's SaaS product line, delivering next-level networking for our customers.Key Responsibilities:Curate large-scale...

  • Staff Software Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Staff Software EngineerInfoblox is seeking a highly skilled Staff Software Engineer to join our Engineering team in Burnaby, BC. As a key member of our team, you will design and develop leading-edge cybersecurity solutions that empower organizations to take full advantage of the cloud.Key Responsibilities:Design and develop complex software...

  • Staff Software Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Staff Software EngineerInfoblox is seeking a highly skilled Staff Software Engineer to join our Engineering team in Burnaby, BC. As a key member of our team, you will design and develop leading-edge cybersecurity solutions that empower organizations to take full advantage of the cloud.Key Responsibilities:Design and develop complex software...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Join Our Team as a Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.About the RoleThis is a regular full-time position that requires a strong background in...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Join Our Team as a Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.About the RoleThis is a regular full-time position that requires a strong background in...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Join Our Team as a Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.About the RoleThis is an exciting opportunity to work with a talented team of data...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Join Our Team as a Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.About the RoleThis is an exciting opportunity to work with a talented team of data...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAABCAA is a leading provider of insurance, roadside assistance, auto repair, and other services in British Columbia. We're committed to delivering peace of mind to our customers and shaping the future of our province.Job SummaryWe're seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence. As a Senior Data Engineer,...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAABCAA is a leading provider of insurance, roadside assistance, auto repair, and other services in British Columbia. We're committed to delivering peace of mind to our customers and shaping the future of our province.Job SummaryWe're seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence. As a Senior Data Engineer,...

  • Data Engineer

    3 weeks ago

    Burnaby, British Columbia, Canada Celestial Systems Inc. Full time

    Celestial Systems Inc. - Data EngineerWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing data administration policies, standards, and models.Key Responsibilities:Design and develop database systems to store and manage large datasetsDevelop and implement data...

  • Staff Software Engineer

    1 month ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Staff Software EngineerInfoblox is seeking a highly skilled Staff Software Engineer to join our Engineering team in Burnaby, BC. As a key member of our team, you will design and develop leading-edge cybersecurity solutions that empower organizations to take full advantage of the cloud.Key Responsibilities:Develop deep mastery of assigned projects...

  • Staff Software Engineer

    1 month ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Staff Software EngineerInfoblox is seeking a highly skilled Staff Software Engineer to join our Engineering team in Burnaby, BC. As a key member of our team, you will design and develop leading-edge cybersecurity solutions that empower organizations to take full advantage of the cloud.Key Responsibilities:Develop deep mastery of assigned projects...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Job Title: Data EngineerBCAA is seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence (COE). As a key member of our team, you will play a critical role in designing, developing, and maintaining our data infrastructure to support business decision-making.About the Role:Design and implement scalable data pipelines to...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Job Title: Data EngineerBCAA is seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence (COE). As a key member of our team, you will play a critical role in designing, developing, and maintaining our data infrastructure to support business decision-making.About the Role:Design and implement scalable data pipelines to...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAABCAA is a leading provider of insurance, roadside assistance, auto repair, and other services in British Columbia. We're committed to delivering peace of mind to our customers and shaping the future of our province.Job SummaryWe're seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence. As a Senior Data Engineer,...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAABCAA is a leading provider of insurance, roadside assistance, auto repair, and other services in British Columbia. We're committed to delivering peace of mind to our customers and shaping the future of our province.Job SummaryWe're seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence. As a Senior Data Engineer,...

  • Data Engineer

    3 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAABCAA is a leading provider of insurance, roadside assistance, auto repair, and other services in British Columbia. We're committed to delivering peace of mind to our customers and shaping the future of our province.Job SummaryWe're seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence. As a key member of our...

  • Data Engineer

    3 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAABCAA is a leading provider of insurance, roadside assistance, auto repair, and other services in British Columbia. We're committed to delivering peace of mind to our customers and shaping the future of our province.Job SummaryWe're seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence. As a key member of our...

  • Staff Software Engineer

    1 month ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Staff Software EngineerInfoblox is seeking a highly skilled Staff Software Engineer to join our Engineering team in Burnaby, BC. As a key member of our team, you will design and develop leading-edge cybersecurity solutions that empower organizations to take full advantage of the cloud.Key Responsibilities:Develop deep mastery of assigned projects...

  • Staff Software Engineer

    1 month ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Staff Software EngineerInfoblox is seeking a highly skilled Staff Software Engineer to join our Engineering team in Burnaby, BC. As a key member of our team, you will design and develop leading-edge cybersecurity solutions that empower organizations to take full advantage of the cloud.Key Responsibilities:Develop deep mastery of assigned projects...