Data Engineer

2 months ago

Burnaby, British Columbia, Canada Infoblox Full time
About the Role

We are seeking a highly skilled Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a Data Engineer, you will play a critical role in developing platforms and products for Infoblox's SaaS product line, delivering next-level networking for our customers.

Key Responsibilities
  • Curate large-scale data from various sources into appropriate sets for research and development, supporting data scientists, threat analysts, and developers across the company.
  • Design, test, and implement storage solutions for various consumers of the data, including data warehouses like ClickHouse and OpenSearch.
  • Design and implement mechanisms to monitor data sources over time for changes using summarization, monitoring, and statistical methods.
  • Design, develop, and maintain APIs that enable seamless data integration and retrieval processes for internal and external applications, ensuring scalability, security, and efficiency.
  • Leverage computer science algorithms and constructs to distill large data into sources of insight and enable future analytics.
  • Convert prototypes into production data engineering solutions through disciplined software engineering practices, Spark optimizations, and modern deployment pipelines.
  • Collaborate on design, implementation, and deployment of applications with the rest of software engineering.
  • Support data scientists and Product teams in building, debugging, and deploying Spark applications that best leverage data.
  • Build and maintain tools for automation, deployment, monitoring, and operations.
  • Create test plans, test cases, and run tests with automated tools.
Requirements
  • 12+ years of experience with Python3, and 2+ years of experience with Spark; Scala experience is helpful.
  • 5+ years of experience in data engineering, data science, and related data-centric fields using large-scale data environments.
  • 3+ years of experience in using SQL and working with modern relational databases, including MySQL or PostgreSQL.
  • 3+ years of experience with developing ETL pipelines and data manipulation scripts.
  • Experience working with ClickHouse data warehouse.
  • Expertise in designing and developing APIs, preferably RESTful, for data access and manipulation in a distributed environment.
  • Proficient in Object Oriented Design and S.O.L.I.D principles.
  • Emphasis on unit testing and code quality.
  • Proficient with AWS products, including EMR, S3, VPC, EC2, Athena, etc.
  • Bachelor's or master's degree in computer science or a related field, or equivalent work experience required.
What Success Looks Like
  • After six months, you will have completed onboarding by demonstrating knowledge of the Data Lake and associated technologies and CI/CD processes by deploying ETL pipelines for curation and warehousing to production.
  • After about a year, you will be an expert on the Data Lake target state architecture and drive engineering design and grooming sessions for new feature development.
About Infoblox

We've created a culture that embraces and rewards innovation, curiosity, and creativity. We achieve remarkable results by working together in a supportive environment that focuses on continuous learning and embraces change.

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Join Our Team as a Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.About the RoleThis is a regular full-time position that requires a strong background in...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Join Our Team as a Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing, developing, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.About the RoleThis is a regular full-time position that requires a strong background in...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Join Our Team as a Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.About the RoleThis is an exciting opportunity to work with a talented team of data...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Join Our Team as a Data EngineerWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing, building, and maintaining our data infrastructure, ensuring that our data is accurate, reliable, and secure.About the RoleThis is an exciting opportunity to work with a talented team of data...

  • Data Engineer

    3 weeks ago

    Burnaby, British Columbia, Canada Celestial Systems Inc. Full time

    Celestial Systems Inc. - Data EngineerWe are seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing data administration policies, standards, and models.Key Responsibilities:Design and develop database systems to store and manage large datasetsDevelop and implement data...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Job Title: Data EngineerBCAA is seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence (COE). As a key member of our team, you will play a critical role in designing, developing, and maintaining our data infrastructure to support business decision-making.About the Role:Design and implement scalable data pipelines to...

  • Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    Job Title: Data EngineerBCAA is seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence (COE). As a key member of our team, you will play a critical role in designing, developing, and maintaining our data infrastructure to support business decision-making.About the Role:Design and implement scalable data pipelines to...

  • Data Engineer

    3 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAABCAA is a leading provider of insurance, roadside assistance, auto repair, and other services in British Columbia. We're committed to delivering peace of mind to our customers and shaping the future of our province.Job SummaryWe're seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence. As a key member of our...

  • Data Engineer

    3 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAABCAA is a leading provider of insurance, roadside assistance, auto repair, and other services in British Columbia. We're committed to delivering peace of mind to our customers and shaping the future of our province.Job SummaryWe're seeking a highly skilled Data Engineer to join our Data and Analytics Centre of Excellence. As a key member of our...

  • Data Engineer

    2 weeks ago

    Burnaby, British Columbia, Canada BCAA Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at BCAA. As a Data Engineer, you will play a key role in designing and implementing scalable data solutions that meet the needs of our business.Key ResponsibilitiesDesign and implement data pipelines and architectures that support business intelligence and analyticsDevelop and...

  • Senior Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Cloud Data EngineerAt Infoblox, we're seeking a highly skilled Cloud Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a key member of our team, you'll play a critical role in designing, developing, and maintaining our cloud-based data platforms.Key Responsibilities:Curate large-scale data from various sources into appropriate sets for...

  • Senior Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Cloud Data EngineerAt Infoblox, we're seeking a highly skilled Cloud Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a key member of our team, you'll play a critical role in designing, developing, and maintaining our cloud-based data platforms.Key Responsibilities:Curate large-scale data from various sources into appropriate sets for...

  • Senior Data Engineer

    1 month ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and platforms that support our SaaS product line.Key Responsibilities:Curate large-scale...

  • Senior Data Engineer

    1 month ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and platforms that support our SaaS product line.Key Responsibilities:Curate large-scale...

  • Senior Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and platforms for Infoblox's SaaS product line.Key Responsibilities:Curate large-scale data...

  • Senior Data Engineer

    4 weeks ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job Title: Senior Data EngineerAbout the Role:We are seeking a highly skilled Senior Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a Senior Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and platforms for Infoblox's SaaS product line.Key Responsibilities:Curate large-scale data...

  • Senior Data Engineer

    1 month ago

    Burnaby, British Columbia, Canada Infoblox Full time

    About the RoleAt Infoblox, we're seeking a highly skilled Senior Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a key member of our team, you'll play a crucial role in developing platforms and products for Infoblox's SaaS product line, delivering next-level networking for our customers.Key ResponsibilitiesCurate large-scale data from...

  • Senior Data Engineer

    1 month ago

    Burnaby, British Columbia, Canada Infoblox Full time

    About the RoleAt Infoblox, we're seeking a highly skilled Senior Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a key member of our team, you'll play a crucial role in developing platforms and products for Infoblox's SaaS product line, delivering next-level networking for our customers.Key ResponsibilitiesCurate large-scale data from...

  • Senior Data Engineer

    1 day ago

    Burnaby, British Columbia, Canada BCAA Full time

    About BCAA's Data Engineering TeamAt BCAA, our Data Engineering team plays a vital role in shaping the future of our organization by leveraging data to drive business growth and innovation. We're seeking a highly skilled and experienced Senior Data Engineer to join our team and help us deliver cutting-edge data solutions.Your Key ResponsibilitiesDesign and...

  • Cloud Engineer for Data Solutions

    2 weeks ago

    Burnaby, British Columbia, Canada Infoblox Full time

    Job DescriptionOverviewWe are seeking a skilled Senior Data Engineer to join our Cloud Engineering team in Burnaby, BC. As a key member of our team, you will be responsible for developing platforms and products for Infoblox's SaaS product line, delivering next-level networking for our customers.Key ResponsibilitiesCurate large-scale data from various sources...