Spark Senior Developer

3 weeks ago


Mississauga ON, Canada VirtusaPolaris - Virtusa Corporation Full time

· 5-7+ years of experience in Hadoop/big data technologies.

· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging.

· Relational and NoSQL database integration and data distribution principles experience

· Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)

· Experience with API development and use of JSON/XML/Hypermedia data formats.

· Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)

· 3+ years of hands-on experience as a Scala developer (with previous Java background)

Knowledge/Experience (Preferred):

· Experience with containerization and related technologies (e.g. Docker, Kubernetes)

· Comprehensive knowledge of the principles of software engineering and data analytics

· Knowledge of agile(scrum) development methodology is a plus

· Cloudera/Hortonworks/AWS EMR, S3 experience a plus

Knowledge/Experience (Must):

· 5-7+ years of experience in Hadoop/big data technologies.

· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging.

· Relational and NoSQL database integration and data distribution principles experience

· Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)

· Experience with API development and use of JSON/XML/Hypermedia data formats.

· Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)

· 3+ years of hands-on experience as a Scala developer (with previous Java background)

Knowledge/Experience (Preferred):

· Experience with containerization and related technologies (e.g. Docker, Kubernetes)

· Comprehensive knowledge of the principles of software engineering and data analytics

· Knowledge of agile(scrum) development methodology is a plus

· Cloudera/Hortonworks/AWS EMR, S3 experience a plus

#J-18808-Ljbffr

  • Mississauga, ON, Canada VirtusaPolaris - Virtusa Corporation Full time

    · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...


  • Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time

    · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...


  • Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time

    · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...


  • Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time

    · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...


  • Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time

    · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...


  • Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time

    · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...


  • Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time

    · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...


  • Mississauga, ON, Canada Virtusa Full time

    Knowledge/Experience (Must): · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce,...


  • Mississauga, Canada Virtusa Full time

    Knowledge/Experience (Must): ·               5-7+ years of experience in Hadoop/big data technologies. ·               Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. ·               Relational and NoSQL database integration and data distribution principles...


  • Mississauga, Canada Virtusa Full time

    Knowledge/Experience (Must): ·               5-7+ years of experience in Hadoop/big data technologies. ·               Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. ·               Relational and NoSQL database integration and data distribution principles...


  • Mississauga, Canada Virtusa Full time

    Knowledge/Experience (Must): ·               5-7+ years of experience in Hadoop/big data technologies. ·               Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. ·               Relational and NoSQL database integration and data distribution principles...


  • Mississauga, Canada Spark Power Full time

    Spark Power, a trusted partner in energy in North America, is looking for an Apprentice Electrician to join our Mississauga team. In this role, you will be based out of our Mississauga office, servicing the GTA. As an apprentice, you will be working with the journeypersons on site, gaining new skills and experience and growing your career. **What will you...


  • Mississauga, Canada Spark Power Full time

    **Electrical Project Manager** **What you will do as a Project Manager**: - Managing electrical projects and ensure projects fall within budget, timeline, and quality requirements. - Continuously seek opportunities to present Spark Power as that customer's solution provider. - Must be meticulous about the safety, environmental and quality requirements of...


  • Cornwall, ON, Canada Spark Power Full time

    Spark Power is a leading independent power solutions provider to the electrical service industry across North America. We deliver technical solutions that help our customers transition to the grid of the future – Renewable Energy. The Solar Technician will travel to job sites around the defined service area and help build and maintain solar, battery...


  • London, ON, Canada Spark Power Full time

    Project Manager Spark Power, a trusted partner in energy in North America, is looking for an Electrical Project Manager to join our London team. The Project Manager is responsible for managing electrical projects, scheduling resources, ensuring that budgets and timelines are met, and managing assigned Field Electricians. What you will do as a Project...


  • Toronto, ON, Canada Procom Full time

    Senior Full Stack Developer On behalf of our client in the Government Services Sector, PROCOM is looking for a Senior Full Stack Developer. Senior Full Stack Developer - Job DescriptionThis role requires a seasoned professional capable of maintaining and enhancing complex legacy applications and developing scalable solutions on modern cloud platformsSenior...


  • Hamilton, ON, Canada Spark Power Corp Full time

    Spark Power, a trusted partner in energy in North America, is looking for an Electrical Project Manager to join our Hamilton. The Project Manager is responsible for managing electrical projects, scheduling resources, ensuring that budgets and timelines are met, and managing assigned Field Electricians. What you will do as a Project Manager: Managing...

  • IT Business Analyst

    3 weeks ago


    Oakville, ON, Canada Spark Power Corp Full time

    IT Business Analyst Spark Power, a trusted partner in energy in North America, is looking for an IT Business Analyst Reporting to the Manager, Business Analysis, you will conduct requirements analysis, assist in the design of scalable solutions and implement small to medium sized system enhancements. The individual in the role is driven to collaborate...


  • Mississauga, ON, Canada AstraZeneca Full time

    Job Title: Senior Global Development Scientist Director Locations: In Office in one of these locations - Boston Seaport, Warsaw PO, Barcelona SP or Mississauga CA As a Senior Global Development Scientist Director (SGDSD) you will independently provide scientific and clinical input to all aspects of late stage product development. This includes but is...

  • Finance Manager

    2 weeks ago


    Greater Sudbury Unitary Authority, ON, Canada Spark Employment Services Full time

    The Finance Manager is an integral part of the management team who provides strategic financial guidance to support the organization’s mission and goals.The core responsibilities include day to day financial and administrative oversight of the organization’s operations, including all financial aspects, ensuring compliance with relevant regulations and...