Big Data Developer

4 weeks ago


Toronto Ontario CA, Ontario First Derivative Full time

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?


First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.


Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.


Big Data Engineer


Job Description:

- Bachelor’s Degree or Master’s in Computer Science, Engineering, Software Engineering or a relevant field.

- 10+ years of software development experience building large scale distributed data processing systems/application or large-scale internet systems.

- Must have good communication skills, writing clean code.

- Strong experience in Python, Kafka, Spark, SQL, Hive, Couchbase, Impala, Hadoop, Splunk, Autosys, shell scripting etc.

- Strong Cloud experience on AWS Lambda, AWS EMR, AWS S3, AWS EC2, EKS.

- Experience in DevOps Activity (Snow, Build (TeamCity, Jenkins, Terraform) and U-Deploy.

- Good knowledge on Capital Market and Data Analysis.

- Experience in dealing with Huge Volume of Data operations.

- Design best architecture and select the most appropriate modeling techniques and data visualization for big data analysis.

- Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera/Hadoop logs)

- Experience with Linux-based infrastructures, Linux/Unix administration, and Cloud.


FD provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.


Candidate personal data will be processed in line with our Global Candidate Privacy Notice available on our website.


  • Big Data Developer

    3 weeks ago


    Toronto, Ontario, Canada IBU Consulting Full time

    Big Data DeveloperToronto, Ontario, CanadaFulltimeJob Description:6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitBackend development Optimization of Big data apps. Developing micro-service architectureDesired...

  • Big Data Developer

    3 weeks ago


    Toronto, Ontario, Canada IBU Consulting Full time

    Big Data Developer Toronto, Ontario, Canada Fulltime Job Description: 6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Backend development Optimization of Big data apps. Developing micro-service architecture ...

  • Big Data Developer

    4 weeks ago


    Toronto, Ontario, Canada Tekshapers Full time

    10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Role Description Backend development Optimization of Big data apps. Developing micro-service architecture Desired Skill Set Experience in building end to end data...


  • Toronto, Ontario, Canada Compunnel Inc. Full time

    At Compunnel Inc., we are seeking an experienced Big Data Developer to join our team. The ideal candidate will have a strong background in Python and scalable solutions, with a focus on Kafka. We are looking for someone who can design and develop streaming pipelines with Kafka by developing publisher and subscriber scripts.The successful candidate will have...

  • Big Data Developer

    2 weeks ago


    Toronto, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Big Data Developer

    6 days ago


    Toronto, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Big Data Developer

    7 days ago


    Toronto, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Big Data Developer

    4 weeks ago


    Toronto, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Big Data Developer

    2 weeks ago


    Toronto, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...


  • Toronto, Ontario, Canada Hager & North Investment Funds Ltd Full time

    Job SummaryJob DescriptionBig Data DeveloperWhat is the opportunity?You will join the Liquidity Risk Management Team as a Big Data Developer, responsible for providing an in-house analysis/reporting platform to a global group of enterprise liquidity risk analysts and managers. You will work closely with developers to analyze business, technical and system...

  • Big Data Expert

    3 days ago


    Toronto, Ontario, Canada B.M.S IT solutions Full time

    Job DescriptionB.M.S IT Solutions is seeking a seasoned Big Data Developer to join our team. The ideal candidate will have a strong background in Big Data, Python, and PySpark, with experience working on large-scale data processing projects.Key Responsibilities:Develop and maintain high-quality big data applications using PySparkCollaborate with data...


  • Toronto, Ontario, Canada Citi Full time

    Citi is looking for a talented Senior Spark Java Developer to join our team.About the RoleThe successful candidate will be responsible for developing and optimizing data pipelines for risk calculations, trade analytics, and regulatory reporting.ResponsibilitiesDevelop scalable data pipelines for processing and analyzing large financial datasets.Implement...


  • Toronto, Ontario, Canada RBC Full time

    Job SummaryWe are seeking a Senior Big Data Developer to join the Capital Risk Measurement Team, delivering services to implement technical and business needs. The successful candidate will work closely with various partners across IT and business.Key ResponsibilitiesDesign and develop complex data-intensive systems using cloud & Big Data...

  • Big Data Developer

    4 days ago


    Toronto, Ontario, Canada Nous Infosystems Full time

    Senior Data ProfessionalWe are seeking a senior-level Big Data Developer - Databricks Expert to join our team at Nous Infosystems. As a Databricks Engineer, you will be responsible for designing, developing, and optimizing data pipelines and workflows using Python and PySpark.You will work closely with data engineers, analysts, and stakeholders to ensure...

  • Big Data Architect

    3 days ago


    Toronto, Ontario, Canada Tiger Analytics Full time

    Tiger Analytics is a leader in advanced analytics consulting.We are seeking a seasoned Big Data Architect to drive our company's growth and success.This role involves:Designing and implementing large-scale data architecturesCollaborating with cross-functional teams to build data pipelines and machine learning solutionsEnsuring scalability and performance of...


  • Toronto, Ontario, Canada Lumenalta Full time

    We are seeking a highly skilled Senior Big Data Developer to join our team. As a key member of our technical group, you will be responsible for designing and implementing large-scale data systems using technologies such as Pyspark, AWS, and Databricks.Job RequirementsThe ideal candidate should have:10+ years of experience in a senior developer role using...

  • Big Data Specialist

    5 days ago


    Toronto, Ontario, Canada Rubicon Path Full time

    About Our Team\Rubicon Path is a leading provider of big data solutions. We are seeking a Big Data Specialist to join our team.\Responsibilities\Data Engineering\Designing technical solutions for data acquisition and storage into our centralized data repository.Developing ELT scripts, designing data-driven logic, and conducting unit testing.\Database...


  • Toronto, Ontario, C6A, Ontario, Canada Atlantis IT Group Full time

    5 – 10years experience as as a Informaitca data Quality Cloud developer Design and implement data quality rules for cleansing, deduplication, and standardization.Create data quality mappings and workflows to apply cleansing logic.Develop custom data quality functions and reference data tables.Integrate data quality processes with other data integration...


  • Toronto, Ontario, Canada Jobber Full time

    **Job Description**As a Big Data Solutions Specialist at Jobber, you'll play a critical role in developing and implementing big data solutions that meet the needs of our organization. With a strong background in data engineering and experience working with large datasets, you'll be able to design and implement scalable data pipelines that are efficient,...

  • Big Data Architect

    18 hours ago


    Toronto, Ontario, Canada Genesys Full time

    About the Role:We are seeking an experienced Cloud Analytics Engineer to join our team. As a key member of our Genesys Cloud Analytics platform, you will collaborate with software engineers, product managers, and data scientists to develop, operationalize, and maintain big data products that enhance customer experience.Key Responsibilities:Develop and deploy...