Spark Senior Developer
3 weeks ago
Knowledge/Experience (Must):
· 5-7+ years of experience in Hadoop/big data technologies.
· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging.
· Relational and NoSQL database integration and data distribution principles experience
· Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
· Experience with API development and use of JSON/XML/Hypermedia data formats.
· Strong development/automation skills
· Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)
· 3+ years of hands-on experience as a Scala developer (with previous Java background)
Knowledge/Experience (Preferred):
· Experience with containerization and related technologies ( Docker, Kubernetes)
· Comprehensive knowledge of the principles of software engineering and data analytics
· Knowledge of agile(scrum) development methodology is a plus
· Cloudera/Hortonworks/AWS EMR, S3 experience a plus
Primary Location Mississauga, Ontario, Canada Job Type Experienced Primary Skills Docker, Kubernetes, PySpark, Kafka, Java, HDFS Years of Experience 7 QualificationKnowledge/Experience (Must):
· 5-7+ years of experience in Hadoop/big data technologies.
· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging.
· Relational and NoSQL database integration and data distribution principles experience
· Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka, Kudu, Solr)
· Experience with API development and use of JSON/XML/Hypermedia data formats.
· Strong development/automation skills
· Experience with all aspects of DevOps (source control, continuous integration, deployments, etc.)
· 3+ years of hands-on experience as a Scala developer (with previous Java background)
Knowledge/Experience (Preferred):
· Experience with containerization and related technologies ( Docker, Kubernetes)
· Comprehensive knowledge of the principles of software engineering and data analytics
· Knowledge of agile(scrum) development methodology is a plus
· Cloudera/Hortonworks/AWS EMR, S3 experience a plus
Travel No-
Senior Spark Developer
3 weeks ago
Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time· 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...
-
Spark Senior Developer
3 weeks ago
Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time· 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...
-
Spark Senior Developer
3 weeks ago
Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time· 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...
-
Senior Spark Developer
3 weeks ago
Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time· 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...
-
Senior Spark Developer
4 weeks ago
Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time· 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...
-
Spark Senior Developer
4 weeks ago
Mississauga, Canada VirtusaPolaris - Virtusa Corporation Full time· 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...
-
Senior Spark Developer
3 weeks ago
Mississauga, ON, Canada VirtusaPolaris - Virtusa Corporation Full time· 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...
-
Spark Senior Developer
3 weeks ago
Mississauga, ON, Canada VirtusaPolaris - Virtusa Corporation Full time· 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce, Hive, Pig, Impala, Spark, Kafka,...
-
Spark Senior Developer
3 weeks ago
Mississauga, Canada Virtusa Full timeKnowledge/Experience (Must): · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles...
-
Spark Senior Developer
3 weeks ago
Mississauga, Canada Virtusa Full timeKnowledge/Experience (Must): · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles...
-
Spark Senior Developer
3 weeks ago
Mississauga, Canada Virtusa Full timeKnowledge/Experience (Must): · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles...
-
Electrical Apprentice
3 days ago
Mississauga, Canada Spark Power Full timeSpark Power, a trusted partner in energy in North America, is looking for an Apprentice Electrician to join our Mississauga team. In this role, you will be based out of our Mississauga office, servicing the GTA. As an apprentice, you will be working with the journeypersons on site, gaining new skills and experience and growing your career. **What will you...
-
Spark Senior Developer
2 weeks ago
Mississauga, ON, Canada Virtusa Full timeKnowledge/Experience (Must): · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience · Hands-on experience with the Hadoop eco-system (HDFS, MapReduce,...
-
Electrical Project Manager
3 days ago
Mississauga, Canada Spark Power Full time**Electrical Project Manager** **What you will do as a Project Manager**: - Managing electrical projects and ensure projects fall within budget, timeline, and quality requirements. - Continuously seek opportunities to present Spark Power as that customer's solution provider. - Must be meticulous about the safety, environmental and quality requirements of...
-
Application Development Senior Analyst
3 weeks ago
Mississauga, Canada Citi Full timeThe Applications Development Senior Programmer Analyst is an intermediate level position responsible for participation in the establishment and implementation of new or revised application systems and programs in coordination with the Technology team. The overall objective of this role is to contribute to applications systems analysis and programming...
-
Scala Developer
4 weeks ago
Mississauga, Canada Virtusa Full timeRole: Scala Lead ConsultantLocation: Mississauga, ONFulltime with VirtusaKnowledge/Experience (Must):· 5-7+ years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience·...
-
Scala Developer
4 weeks ago
Mississauga, Canada Virtusa Full timeRole: Scala Lead ConsultantLocation: Mississauga, ONFulltime with VirtusaKnowledge/Experience (Must):· 5-7+ years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience·...
-
Scala Developer
4 weeks ago
Mississauga, Canada Virtusa Full timeRole: Scala Lead ConsultantLocation: Mississauga, ONFulltime with VirtusaKnowledge/Experience (Must):· 5-7+ years of experience in Hadoop/big data technologies.· Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience·...
-
Scala Developer
4 weeks ago
Mississauga, Canada Virtusa Full timeRole: Scala Lead Consultant Location: Mississauga, ON Fulltime with Virtusa Knowledge/Experience (Must): · 5-7+ years of experience in Hadoop/big data technologies. · Experience with Spark/Storm/Kafka or equivalent streaming/batch processing and event based messaging. · Relational and NoSQL database integration and data distribution principles experience...
-
Senior Data Engineer
3 weeks ago
Mississauga, Canada Axelon Services Corporation Full timeGlobal Financial Firm located in MISSISSAUGA, ON has an immediate contract opportunity for an experienced Senior Data Engineer"This role is currently on a Hybrid Schedule.You will need to have reliable internet, computer and android or iphone for remote access into the client systems during remote work.We will be expected in the office weekly 2-3 days...