Current jobs related to Data Engineer with Spark Streaming/Flink - Halifax Nova Scotia, Nova Scotia - VLink Inc

  • Data Virtualization Engineer

    1 week ago

    Halifax, Nova Scotia, Nova Scotia, Canada Net2Source Inc. Full time

    We have an urgent opening for Data Virtualization Engineer with below JD. Could you please let us know if you will be able to share any profile matching with the below skillset. Dremio L3 Support Engineer -Data virtualization product – DremioMandatory skills – Dremio Internals, Architecture, Data Virtualization concepts, SQL, Query tuning &...

  • Data Engineer

    1 month ago

    Halifax, Nova Scotia, Canada WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands) Full time

    Empower Data-Driven Decision MakingAt WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands), we're on a mission to revolutionize the way we consume and interact with stories. As a Data Engineer, you'll play a pivotal role in empowering our engineers, analysts, and data scientists with cutting-edge tools and infrastructure that streamline...

  • Data Engineer

    1 month ago

    Halifax, Nova Scotia, Canada WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands) Full time

    Empower Data-Driven Decision MakingAt WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands), we're on a mission to revolutionize the way we consume and interact with stories. As a Data Engineer, you'll play a pivotal role in empowering our engineers, analysts, and data scientists with cutting-edge tools and infrastructure that streamline...

  • Data Engineer

    2 months ago

    Halifax, Nova Scotia, Canada WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands) Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands). As a Data Engineer, you will play a critical role in empowering our engineers, analysts, and data scientists with tools that enable and streamline data-driven decision making, analysis, and feature development.Key...

  • Data Engineer

    2 months ago

    Halifax, Nova Scotia, Canada WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands) Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands). As a Data Engineer, you will play a critical role in empowering our engineers, analysts, and data scientists with tools that enable and streamline data-driven decision making, analysis, and feature development.Key...

  • Data Engineer

    1 month ago

    Halifax, Nova Scotia, Canada Randstad Canada Full time

    Job Title: Data EngineerWe are seeking an experienced Data Engineer to play a pivotal role in designing, building, and optimizing our data integration platform. This individual will work closely with our IT team, consultants, and business units to ensure data is robust, scalable, and aligned to our needs.Key Responsibilities:Collaborate with stakeholders to...

  • Data Engineer

    1 month ago

    Halifax, Nova Scotia, Canada Randstad Canada Full time

    Job Title: Data EngineerWe are seeking an experienced Data Engineer to play a pivotal role in designing, building, and optimizing our data integration platform. This individual will work closely with our IT team, consultants, and business units to ensure data is robust, scalable, and aligned to our needs.Key Responsibilities:Collaborate with stakeholders to...

  • Data Engineer

    1 month ago

    Halifax, Nova Scotia, Canada WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands) Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands). As a Data Engineer, you will play a critical role in designing and implementing data infrastructure systems that enable data-driven decision making and analysis.Key Responsibilities:Collaborate with data...

  • Data Engineer

    1 month ago

    Halifax, Nova Scotia, Canada WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands) Full time

    Job Title: Data EngineerWe are seeking a highly skilled Data Engineer to join our team at WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands). As a Data Engineer, you will play a critical role in designing and implementing data infrastructure systems that enable data-driven decision making and analysis.Key Responsibilities:Collaborate with data...

  • Dremio Data Virtualization Engineer

    4 weeks ago

    Halifax, Nova Scotia, Canada Compest Solutions Inc Full time

    Job Title: Dremio Data Virtualization Support EngineerJob Summary:We are seeking a highly skilled Dremio Data Virtualization Support Engineer to join our team at Compest Solutions Inc. As a key member of our support team, you will be responsible for providing top-notch support to our clients, ensuring the smooth operation of our Dremio-based solutions.Key...

  • Dremio Data Virtualization Engineer

    4 weeks ago

    Halifax, Nova Scotia, Canada Compest Solutions Inc Full time

    Job Title: Dremio Data Virtualization Support EngineerJob Summary:We are seeking a highly skilled Dremio Data Virtualization Support Engineer to join our team at Compest Solutions Inc. As a key member of our support team, you will be responsible for providing top-notch support to our clients, ensuring the smooth operation of our Dremio-based solutions.Key...

  • Data Engineer for Business Intelligence

    4 weeks ago

    Halifax, Nova Scotia, Canada Randstad Canada Full time

    Job Title: Data Engineer BIWe are seeking an experienced Data Engineer to play a pivotal role in designing, building, and optimizing our centralized data integration platform and Business Intelligence (BI) Dashboard strategy within our port-wide ecosystem.ResponsibilitiesCollaborate with stakeholders to ensure data is robust, scalable, and aligned to...

  • Data Engineer for Business Intelligence

    4 weeks ago

    Halifax, Nova Scotia, Canada Randstad Canada Full time

    Job Title: Data Engineer BIWe are seeking an experienced Data Engineer to play a pivotal role in designing, building, and optimizing our centralized data integration platform and Business Intelligence (BI) Dashboard strategy within our port-wide ecosystem.ResponsibilitiesCollaborate with stakeholders to ensure data is robust, scalable, and aligned to...

  • Data Engineer

    1 month ago

    Halifax, Nova Scotia, Canada WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands) Full time

    Job Title: Data EngineerWattpad is a global multiplatform entertainment company that aims to entertain and connect the world through stories. Our Data Engineering team is responsible for empowering engineers, analysts, and data scientists with tools that enable and streamline data-driven decision making, analysis, and feature development.Job Summary:We are...

  • Data Engineer

    1 month ago

    Halifax, Nova Scotia, Canada WEBTOON Entertainment Inc. (Wattpad & WEBTOON Family of Brands) Full time

    Job Title: Data EngineerWattpad is a global multiplatform entertainment company that aims to entertain and connect the world through stories. Our Data Engineering team is responsible for empowering engineers, analysts, and data scientists with tools that enable and streamline data-driven decision making, analysis, and feature development.Job Summary:We are...

  • DevOps Engineer

    4 weeks ago

    Halifax, Nova Scotia, Canada NTT DATA Full time

    Job Title: DevOps EngineerWe are seeking a highly skilled DevOps Engineer to join our team at NTT DATA. As a DevOps Engineer, you will be responsible for designing, building, and maintaining our cloud-based infrastructure and applications.Key Responsibilities:Architect and implement CI/CD pipelines using Jenkins and Groovy scriptsDevelop and maintain bash...

  • DevOps Engineer

    4 weeks ago

    Halifax, Nova Scotia, Canada NTT DATA Full time

    Job Title: DevOps EngineerWe are seeking a highly skilled DevOps Engineer to join our team at NTT DATA. As a DevOps Engineer, you will be responsible for designing, building, and maintaining our cloud-based infrastructure and applications.Key Responsibilities:Architect and implement CI/CD pipelines using Jenkins and Groovy scriptsDevelop and maintain bash...

  • DevOps Engineer

    4 weeks ago

    Halifax, Nova Scotia, Canada NTT DATA Full time

    Job Title: DevOps EngineerWe are seeking a highly skilled DevOps Engineer to join our team at NTT DATA Services. As a DevOps Engineer, you will play a critical role in ensuring the smooth operation of our cloud-based infrastructure and applications.Key Responsibilities:Design and implement CI/CD pipelines using Jenkins and Groovy scriptingDevelop and...

  • DevOps Engineer

    4 weeks ago

    Halifax, Nova Scotia, Canada NTT DATA Full time

    Job Title: DevOps EngineerWe are seeking a highly skilled DevOps Engineer to join our team at NTT DATA Services. As a DevOps Engineer, you will play a critical role in ensuring the smooth operation of our cloud-based infrastructure and applications.Key Responsibilities:Design and implement CI/CD pipelines using Jenkins and Groovy scriptingDevelop and...

  • Senior Java Software Engineer

    1 week ago

    Halifax, Nova Scotia, Nova Scotia, Canada Capgemini Full time

    Job Role: Senior Java DeveloperLocation: Halifax CanadaJob Type: Permanent Fulltime Job Summary:We are seeking a skilled and experienced Senior Java Developer to join our dynamic team. The ideal candidate will have extensive experience in Java API development Spring Boot Angular HTML CSS AWS and JUnit. You will be responsible for designing developing and...

Data Engineer with Spark Streaming/Flink

2 months ago

Halifax Nova Scotia, Nova Scotia, Canada VLink Inc Full time

Job Title: Data Engineer

Location: Halifax , NS

Employment Type: (FTE )

Duration: FTE


About VLink: Started in 2006 and headquartered in Connecticut, VLink is one of the fastest growing digital technology services and consulting companies. Since its inception, our innovative team members have been solving the most complex business, and IT challenges of our global clients.


What is the role:

• Lead a group of developers building data pipelines using big data technologies (Spark, Flink, Databricks) on medium to large scale datasets for batch as well as real time streaming patterns

• Maintain existing data pipelines to support on premise clients and build the next generation ETL processes leveraging Databricks in Cloud

• Work in a creative & collaborative environment driven by agile methodologies with focus on CI/CD, Application Resiliency Standards

• Experimenting with and learning new technologies, participating in internal & external technology communities, and mentoring other members of the team

• Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in around data ingestion & transformation onprem and in cloud

• Collaborate with product owners, business stakeholders to understand requirements, prioritize tasks and work with the scrum master/development team to meet program timelines

• Mentor team on technical aspects, participate in design/code reviews to ensure code is designed well, elegantly coded, and effectively tuned for performance.


Qualifications

• Bachelor's Degree

• 8+ years of hands-on experience in solution, design and development of ETL applications using Spark (Pyspark preferred ) within Big Data space.

• 5+ years' experience managing a team of developers focused on data pipelines, providing oversight on implementation, performing code reviews and managing Production rollouts

• 2+ years of experience in streaming applications using Spark Streaming / Flink .

• 2+ year's experience building and working with rest api's using Java or python

• Knoledge of best practices , architectural patterns, limitations within Big Data ecosystem

• 2+ years of experience working with Agile Engineering practices.

• Knowledge and experience in non-functional requirements like Security, Performance, Vulnerabilities, etc.

Nice to Have:

• Good to have some experience / knowledge on cloud-based solutions on Azure, Databricks




Employment Practices:

EEO, ADA, FMLA Compliant

VLink is an equal opportunity employer. At VLink, we are committed to embracing diversity, multiculturalism, and inclusion. VLink does not discriminate on the basis of race, color, religion, sex, national origin, disability status, protected veteran status, or any other characteristic protected by law. All aspects of employment including the decision to hire, promote, or discharge, will be decided on the basis of qualifications, merit, performance, and business needs.