Big Data Developer

2 weeks ago

Toronto, Canada First Derivative Full time

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?


First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.


Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.


Big Data Engineer


Job Description:

- Bachelor’s Degree or Master’s in Computer Science, Engineering, Software Engineering or a relevant field.

- 10+ years of software development experience building large scale distributed data processing systems/application or large-scale internet systems.

- Must have good communication skills, writing clean code.

- Strong experience in Python, Kafka, Spark, SQL, Hive, Couchbase, Impala, Hadoop, Splunk, Autosys, shell scripting etc.

- Strong Cloud experience on AWS Lambda, AWS EMR, AWS S3, AWS EC2, EKS.

- Experience in DevOps Activity (Snow, Build (TeamCity, Jenkins, Terraform) and U-Deploy.

- Good knowledge on Capital Market and Data Analysis.

- Experience in dealing with Huge Volume of Data operations.

- Design best architecture and select the most appropriate modeling techniques and data visualization for big data analysis.

- Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera/Hadoop logs)

- Experience with Linux-based infrastructures, Linux/Unix administration, and Cloud.


FD provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.


Candidate personal data will be processed in line with our Global Candidate Privacy Notice available on our website.

  • Big Data Developer

    1 week ago

    Toronto, Canada IBU Consulting Full time

    Big Data Developer Toronto, Ontario, Canada Fulltime Job Description: 6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Backend development Optimization of Big data apps. Developing micro-service...

  • Big Data Developer

    1 day ago

    Toronto, Ontario, Canada isgSearch Full time

    iSearch is seeking a skilled Big Data Developer to design and implement innovative data solutions using big data frameworks.Main ResponsibilitiesDevelop and maintain data pipelines using PySpark and AWS services.Implement efficient search and retrieval systems using ElasticSearch, HBase, or Vector Databases.Collaborate with Data Science and Analytics teams...

  • Big Data Developer

    2 weeks ago

    Toronto, Canada Open Systems Technologies Full time

    Open Systems Tech is looking for a Big Data Developer for one of our financial services clients. This is a time sensitive opportunity, please apply ASAP. Job Title: Big Data Developer Location: Mississauga - 3 days - Hybrid Term: 12 months contract plus extension Job Description: • 10+ years of hands-on experience in big data development using Python...

  • Big Data Developer

    1 week ago

    Toronto, Ontario, Canada IBU Consulting Full time

    Big Data DeveloperToronto, Ontario, CanadaFulltimeJob Description:6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitBackend development Optimization of Big data apps. Developing micro-service architectureDesired...

  • Big Data Developer

    1 week ago

    Toronto, Ontario, Canada IBU Consulting Full time

    Big Data Developer Toronto, Ontario, Canada Fulltime Job Description: 6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Backend development Optimization of Big data apps. Developing micro-service architecture ...

  • Big Data Developer

    1 week ago

    Toronto, Canada IBU Consulting Full time

    Big Data Developer Toronto, Ontario, Canada Fulltime Job Description: 6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Backend development Optimization of Big data apps. Developing micro-service architecture...

  • Big Data Developer

    1 week ago

    Toronto, Canada IBU Consulting Full time

    Big Data DeveloperToronto, Ontario, CanadaFulltimeJob Description:6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitBackend development Optimization of Big data apps. Developing micro-service architectureDesired...

  • Big Data Developer

    2 weeks ago

    Toronto, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Role Description Backend development Optimization of Big data apps. Developing micro-service architecture Desired Skill Set Experience in building end to end data...

  • Big Data Developer

    2 weeks ago

    Toronto, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Role Description Backend development Optimization of Big data apps. Developing micro-service architecture Desired Skill Set Experience in building end to end data...

  • Big Data Developer

    2 weeks ago

    toronto, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitRole DescriptionBackend development Optimization of Big data apps. Developing micro-service architectureDesired Skill SetExperience in building end to end data...

  • Big Data Developer

    2 weeks ago

    Toronto, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitRole DescriptionBackend development Optimization of Big data apps. Developing micro-service architectureDesired Skill SetExperience in building end to end data...

  • Big Data Developer

    2 weeks ago

    Toronto, Ontario, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Role Description Backend development Optimization of Big data apps. Developing micro-service architecture Desired Skill Set Experience in building end to end data...

  • Big Data Developer

    4 days ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job Title: Big Data Developer Location: Toronto, ON Competencies: BigData and Hadoop Ecosystems, Digital : Amazon Web Service(AWS) Cloud ComputingExperience (Years):    8-10Essential Skills:          ·       What we absolutely need?? 8+ years of Software Engineering experience·       ?BS/MS/PhD in Computer Science, Math or...

  • Big Data Developer

    1 week ago

    Toronto, ON, Canada IBU Consulting Full time

    Big Data Developer Toronto, Ontario, Canada Fulltime Job Description: 6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Backend development Optimization of Big data apps. Developing micro-service architecture ...

  • Big Data Developer

    4 days ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job DescriptionJob Title: Big Data Developer Location: Toronto, ON Competencies: BigData and Hadoop Ecosystems, Digital : Amazon Web Service(AWS) Cloud ComputingExperience (Years):    8-10Essential Skills:          ·       What we absolutely need?? 8+ years of Software Engineering experience·       ?BS/MS/PhD in Computer Science,...

  • Big Data Developer

    2 days ago

    Toronto, Canada IBU Consulting Full time

    6+ years Big Data developer with hands-on experience in optimization using Scala and Spark. Hands-on experience in containerization with Docker, Kubernetes, and OpenShift. Working knowledge of Jenkins and Git.Responsibilities:Backend development optimization of Big Data applications.Developing micro-service architecture.Desired Skill Set:Experience in...

  • Big Data Developer

    2 weeks ago

    Toronto, ON, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Role Description Backend development Optimization of Big data apps. Developing micro-service architecture Desired Skill Set Experience in building end to end...

  • Big Data Developer

    2 weeks ago

    Toronto, ON, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Role Description Backend development Optimization of Big data apps. Developing micro-service architecture Desired Skill Set Experience in building end to end...

  • Big Data Developer

    2 weeks ago

    Toronto, Ontario, C6A, Ontario, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitRole DescriptionBackend development Optimization of Big data apps. Developing micro-service architectureDesired Skill SetExperience in building end to end data...

  • Senior Big Data Developer

    7 days ago

    Toronto, Ontario, Canada ProViso Staffing Full time

    Job Summary:This is a highly technical role that requires expertise in designing, developing, and maintaining large-scale data processing systems. As a Senior Big Data Developer at ProViso Staffing, you will be responsible for leading the development of real-time data processing solutions using Scala, Spark, and Akka frameworks.The ideal candidate will have...