Big Data Developer

4 days ago


Toronto, Ontario, Canada First Derivative Full time

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?

First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.

Big Data Developer

Job Description:

- Bachelor's Degree or Master's in Computer Science, Engineering, Software Engineering or a relevant field.

- 10+ years of software development experience building large scale distributed data processing systems/application or large-scale internet systems.

- Must have good communication skills, writing clean code.

- Strong experience in Core Java, Python, Kafka, Apache Spark, SQL, Hive, Couchbase, Impala, Hadoop, Splunk, Autosys, shell scripting etc.

- Strong Cloud experience on AWS Lambda, AWS EMR, AWS S3, AWS EC2, EKS.

- Experience in DevOps Activity (Snow, Build (TeamCity, Jenkins, Terraform) and U-Deploy.

- Good knowledge on Capital Market and Data Analysis.

- Experience in dealing with Huge Volume of Data operations.

- Design best architecture and select the most appropriate modeling techniques and data visualization for big data analysis.

- Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera/Hadoop logs)

- Experience with Linux-based infrastructures, Linux/Unix administration, and Cloud.

FD provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.

Candidate personal data will be processed in line with our Global Candidate Privacy Notice available on our website.


  • Big Data Developer

    3 weeks ago


    Toronto, Ontario, Canada IBU Consulting Full time

    Big Data DeveloperToronto, Ontario, CanadaFulltimeJob Description:6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitBackend development Optimization of Big data apps. Developing micro-service architectureDesired...

  • Big Data Developer

    3 weeks ago


    Toronto, Ontario, Canada IBU Consulting Full time

    Big Data Developer Toronto, Ontario, Canada Fulltime Job Description: 6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Backend development Optimization of Big data apps. Developing micro-service architecture ...

  • Big Data Developer

    4 weeks ago


    Toronto, Ontario, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Role Description Backend development Optimization of Big data apps. Developing micro-service architecture Desired Skill Set Experience in building end to end data...

  • Big Data Developer

    4 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitRole DescriptionBackend development Optimization of Big data apps. Developing micro-service architectureDesired Skill SetExperience in building end to end data...


  • Toronto, Ontario, Canada Bevertec Full time

    Bevertec is looking for a highly skilled Big Data Architect and Developer to join our team. In this role, you will be responsible for designing and implementing large-scale data architectures and developing data-intensive applications using cloud-based technologies.ResponsibilitiesDesign and develop big data architectures using Azure Data Lake and Synapse...

  • Big Data Developer

    4 weeks ago


    Toronto, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Big Data Developer

    2 weeks ago


    Toronto, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...


  • Toronto, Ontario, Canada Hager & North Investment Funds Ltd Full time

    Job SummaryJob DescriptionBig Data DeveloperWhat is the opportunity?You will join the Liquidity Risk Management Team as a Big Data Developer, responsible for providing an in-house analysis/reporting platform to a global group of enterprise liquidity risk analysts and managers. You will work closely with developers to analyze business, technical and system...

  • Big Data Developer

    4 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Big Data Expert

    21 hours ago


    Toronto, Ontario, Canada B.M.S IT solutions Full time

    Job DescriptionB.M.S IT Solutions is seeking a seasoned Big Data Developer to join our team. The ideal candidate will have a strong background in Big Data, Python, and PySpark, with experience working on large-scale data processing projects.Key Responsibilities:Develop and maintain high-quality big data applications using PySparkCollaborate with data...


  • Toronto, Ontario, Canada Citi Full time

    Citi is looking for a talented Senior Spark Java Developer to join our team.About the RoleThe successful candidate will be responsible for developing and optimizing data pipelines for risk calculations, trade analytics, and regulatory reporting.ResponsibilitiesDevelop scalable data pipelines for processing and analyzing large financial datasets.Implement...

  • Big Data Specialist

    7 days ago


    Toronto, Ontario, Canada Autodesk, Inc. Full time

    About the RoleWe are seeking an experienced Big Data Specialist to join our team at Autodesk, Inc. In this role, you will be responsible for designing and developing complex data pipelines using big data technologies such as Airflow, EMR/Spark, Snowflake, Hadoop/Hive.Key ResponsibilitiesDevelop and implement scalable data architectures to support business...


  • Toronto, Ontario, Canada RBC Full time

    Job SummaryWe are seeking a Senior Big Data Developer to join the Capital Risk Measurement Team, delivering services to implement technical and business needs. The successful candidate will work closely with various partners across IT and business.Key ResponsibilitiesDesign and develop complex data-intensive systems using cloud & Big Data...

  • Big Data Developer

    1 day ago


    Toronto, Ontario, Canada Nous Infosystems Full time

    Senior Data ProfessionalWe are seeking a senior-level Big Data Developer - Databricks Expert to join our team at Nous Infosystems. As a Databricks Engineer, you will be responsible for designing, developing, and optimizing data pipelines and workflows using Python and PySpark.You will work closely with data engineers, analysts, and stakeholders to ensure...

  • Big Data Architect

    7 hours ago


    Toronto, Ontario, Canada Tiger Analytics Full time

    Tiger Analytics is a leader in advanced analytics consulting.We are seeking a seasoned Big Data Architect to drive our company's growth and success.This role involves:Designing and implementing large-scale data architecturesCollaborating with cross-functional teams to build data pipelines and machine learning solutionsEnsuring scalability and performance of...


  • Toronto, Ontario, Canada Lumenalta Full time

    We are seeking a highly skilled Senior Big Data Developer to join our team. As a key member of our technical group, you will be responsible for designing and implementing large-scale data systems using technologies such as Pyspark, AWS, and Databricks.Job RequirementsThe ideal candidate should have:10+ years of experience in a senior developer role using...

  • Big Data Specialist

    3 days ago


    Toronto, Ontario, Canada Rubicon Path Full time

    About Our Team\Rubicon Path is a leading provider of big data solutions. We are seeking a Big Data Specialist to join our team.\Responsibilities\Data Engineering\Designing technical solutions for data acquisition and storage into our centralized data repository.Developing ELT scripts, designing data-driven logic, and conducting unit testing.\Database...


  • Toronto, Ontario, Canada OnX Enterprise Solutions Full time

    About the RoleThis position involves collaborating with cross-functional teams to design optimal data models and architectures. You will optimize data pipelines for scalability, reliability, and high-performance processing, and provide innovative solutions to complex data-related challenges.You will ensure data quality through validation processes and...


  • Toronto, Ontario, Canada CG Consulting Group Full time

    Sr Java Developer with Big DataThis is with a large IT services firm for a major Canadian bank and its global markets division.Candidate must have legal work status for Canada.Client Location is downtown Toronto, Ontario. Near TTC and GO Train.Hybrid - In-Office 3 days per week. Perm/FT role, salary and benefits.Role OverviewWe are looking for a passionate...


  • Toronto, Ontario, Canada Jobber Full time

    **Job Description**As a Big Data Solutions Specialist at Jobber, you'll play a critical role in developing and implementing big data solutions that meet the needs of our organization. With a strong background in data engineering and experience working with large datasets, you'll be able to design and implement scalable data pipelines that are efficient,...