Big Data Engineer with Spark Streaming

1 month ago

Mississauga, Ontario, Canada VLink Inc Full time
Job Title: Big Data Engineer with Spark Streaming

We are seeking a highly skilled Big Data Engineer with expertise in Spark Streaming to join our team at VLink Inc.

Job Summary:

The successful candidate will lead a group of developers in building data pipelines using big data technologies, including Spark, Flink, and Databricks. They will maintain existing data pipelines, design and develop new ETL processes, and collaborate with Agile teams to implement technical solutions.

Responsibilities:

  • Design and develop data pipelines using Spark, Flink, and Databricks
  • Maintain existing data pipelines and develop new ETL processes
  • Collaborate with Agile teams to implement technical solutions
  • Mentor team members on technical aspects and participate in design/code reviews
  • Work with product owners and business stakeholders to understand requirements and prioritize tasks

Requirements:

  • 10+ years of experience in solution design and development of ETL applications using Spark
  • 5+ years of experience managing a team of developers focused on data pipelines
  • 2+ years of experience in streaming applications using Spark Streaming/Flink
  • 2+ years of experience building and working with REST APIs using Java or Python
  • Knowledge of best practices, architectural patterns, and limitations within the Big Data ecosystem
  • 2+ years of experience working with Agile Engineering practices

What We Offer:

VLink Inc offers a dynamic and collaborative work environment, opportunities for professional growth and development, and a competitive compensation package.

  • Senior Data Engineer

    4 weeks ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at AutoCapital Canada. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key...

  • Senior Data Engineer

    4 weeks ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at AutoCapital Canada. As a key member of our engineering team, you will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key...

  • Senior Data Engineer

    2 weeks ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Job DescriptionWe are seeking a highly skilled Data Engineer to join our team at AutoCapital Canada. As a Data Engineer, you will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key Responsibilities:Design and implement data...

  • Senior Data Engineer

    1 month ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at AutoCapital Canada. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key ResponsibilitiesDesign and implement data...

  • Senior Data Engineer

    1 month ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at AutoCapital Canada. As a Data Engineer, you will play a critical role in designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key ResponsibilitiesDesign and implement data...

  • Senior Data Engineer

    2 months ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at AutoCapital Canada. As a key member of our Engineering team, you will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes to extract, transform, and load large-scale datasets.Key ResponsibilitiesDesign and Implement Data Pipelines:...

  • Senior Data Engineer

    2 months ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking a highly skilled Data Engineer to join our team at AutoCapital Canada. As a key member of our Engineering team, you will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes to extract, transform, and load large-scale datasets.Key ResponsibilitiesDesign and Implement Data Pipelines:...

  • Data Engineer, Finance

    2 weeks ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Job Title: Data Engineer, FinanceAutoCapital Canada Inc. is a leading financial services company with a strong presence in the Canadian market. We are seeking a highly skilled Data Engineer to join our team and contribute to the development of our data-driven solutions.Key Responsibilities:Design, implement, and maintain robust data pipelines and ETL...

  • Senior Data Engineer

    3 days ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    About the RoleWe are seeking an experienced Data Engineer to join our team at AutoCapital Canada. As a Data Engineer, you will play a crucial role in designing, implementing, and maintaining robust data pipelines and ETL processes for efficient extraction, transformation, and loading of large-scale datasets.Key ResponsibilitiesData Pipeline Design and...

  • Senior Java Spark Engineer

    2 months ago

    Mississauga, Ontario, Canada CG Consulting Group Full time

    Position: Senior Java Spark EngineerJoin the esteemed team at CG Consulting Group, where we are seeking a highly skilled and motivated Senior Java Spark Engineer. About the Role:This position involves working with a prominent financial institution, focusing on the development of robust applications utilizing Java and Apache Spark. The ideal candidate will...

  • Senior Java Spark Engineer

    4 weeks ago

    Mississauga, Ontario, Canada CG Consulting Group Full time

    Position: Senior Java Spark EngineerJoin the esteemed team at CG Consulting Group, where we are seeking a highly skilled and motivated Senior Java Spark Engineer. About the Role:This position involves working with a prominent financial institution, focusing on the development of robust applications utilizing Java and Apache Spark. The ideal candidate will...

  • Senior Java Spark Engineer

    4 weeks ago

    Mississauga, Ontario, Canada CG Consulting Group Full time

    Position Overview:We are seeking a highly skilled and experienced Java Spark Developer to contribute to our innovative projects within a prominent IT services organization. This role is pivotal in delivering advanced solutions for large-scale data processing and analytics.Key Responsibilities:Design, develop, and maintain robust Java applications utilizing...

  • Senior Java Spark Engineer

    2 months ago

    Mississauga, Ontario, Canada CG Consulting Group Full time

    Position Overview:We are seeking a highly skilled and experienced Java Spark Developer to contribute to our innovative projects within a prominent IT services organization. This role is pivotal in delivering advanced solutions for large-scale data processing and analytics.Key Responsibilities:Design, develop, and maintain robust Java applications utilizing...

  • Senior Java Spark Engineer

    4 weeks ago

    Mississauga, Ontario, Canada CG Consulting Group Full time

    Position OverviewWe are seeking a highly skilled and experienced Java Spark Developer to contribute to our esteemed IT services firm, focusing on large-scale financial projects.Location: Mississauga, OntarioWork Arrangement: Hybrid - In-Office 3 days per weekEmployment Type: Permanent/Full-Time or Contract (initially 6 months)Compensation: Competitive salary...

  • Senior Java Spark Engineer

    2 months ago

    Mississauga, Ontario, Canada CG Consulting Group Full time

    Position OverviewWe are seeking a highly skilled and experienced Java Spark Developer to contribute to our esteemed IT services firm, focusing on large-scale financial projects.Location: Mississauga, OntarioWork Arrangement: Hybrid - In-Office 3 days per weekEmployment Type: Permanent/Full-Time or Contract (initially 6 months)Compensation: Competitive salary...

  • CM CanCap Management Senior Data Engineer

    2 weeks ago

    Mississauga, Ontario, Canada Data Engineer Jobs Full time

    Job Title: Senior Data EngineerAutoCapital Canada is a leading financial services company with a strong presence in the Canadian market. We are seeking a highly skilled Senior Data Engineer to join our team.About the Role:The Senior Data Engineer will be responsible for designing, implementing, and maintaining robust data pipelines and ETL processes for...

  • Senior Java Developer for Big Data Processing

    1 week ago

    Mississauga, Ontario, Canada https:www.pcrecruiter.netsitemap Full time

    Sr Java Spark DeveloperThis is a role with a large IT services firm for a major US-based bank.Candidate must have legal work status for Canada.Client Location is Mississauga, Ontario.Hybrid - In-Office 3 days per week.Perm/FT role, salary and benefits OR Contract (6 months to start) at market rate.ProfileWe are seeking a skilled and experienced Java Spark...

  • Data Engineer

    4 weeks ago

    Mississauga, Ontario, Canada CG Consulting Group Full time

    Job Title: Data Pipeline DeveloperWe are seeking a highly skilled Data Pipeline Developer to join our team at CG Consulting Group. As a Data Pipeline Developer, you will be responsible for designing, developing, and implementing high-performance, scalable, and reliable data pipelines using Java and Apache Spark.Key Responsibilities:Design and develop Java...

  • Data Engineer

    4 weeks ago

    Mississauga, Ontario, Canada CG Consulting Group Full time

    Job Title: Data Pipeline DeveloperWe are seeking a highly skilled Data Pipeline Developer to join our team at CG Consulting Group. As a Data Pipeline Developer, you will be responsible for designing, developing, and implementing high-performance, scalable, and reliable data pipelines using Java and Apache Spark.Key Responsibilities:Design and develop Java...

  • Data Pipeline Engineer

    2 weeks ago

    Mississauga, Ontario, Canada https:www.pcrecruiter.netsitemap Full time

    Sr Java Spark DeveloperWe are seeking a highly skilled and experienced Java Spark Developer to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing high-performance, scalable, and reliable applications using Java and Apache Spark.Key Responsibilities:Design and develop Java...