Big Data Developer
4 weeks ago
Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?
First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.
Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.
Big Data Engineer
Job Description:
- Bachelor’s Degree or Master’s in Computer Science, Engineering, Software Engineering or a relevant field.
- 10+ years of software development experience building large scale distributed data processing systems/application or large-scale internet systems.
- Must have good communication skills, writing clean code.
- Strong experience in Python, Kafka, Spark, SQL, Hive, Couchbase, Impala, Hadoop, Splunk, Autosys, shell scripting etc.
- Strong Cloud experience on AWS Lambda, AWS EMR, AWS S3, AWS EC2, EKS.
- Experience in DevOps Activity (Snow, Build (TeamCity, Jenkins, Terraform) and U-Deploy.
- Good knowledge on Capital Market and Data Analysis.
- Experience in dealing with Huge Volume of Data operations.
- Design best architecture and select the most appropriate modeling techniques and data visualization for big data analysis.
- Performance analysis, troubleshooting and resolution (this includes familiarity and investigation of Cloudera/Hadoop logs)
- Experience with Linux-based infrastructures, Linux/Unix administration, and Cloud.
FD provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.
Candidate personal data will be processed in line with our Global Candidate Privacy Notice available on our website.
-
Big Data Developer
3 weeks ago
Toronto, Ontario, Canada IBU Consulting Full timeBig Data DeveloperToronto, Ontario, CanadaFulltimeJob Description:6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, GitBackend development Optimization of Big data apps. Developing micro-service architectureDesired...
-
Big Data Developer
3 weeks ago
Toronto, Ontario, Canada IBU Consulting Full timeBig Data Developer Toronto, Ontario, Canada Fulltime Job Description: 6+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Backend development Optimization of Big data apps. Developing micro-service architecture ...
-
Big Data Developer
4 weeks ago
Toronto, Ontario, Canada Tekshapers Full time10+ years Big data developer with hands on experience in optimization using Scala, Spark. Hands on experience on containerization - Docker, Kubernetes, OpenShift. Working knowledge of Jenkins, Git Role Description Backend development Optimization of Big data apps. Developing micro-service architecture Desired Skill Set Experience in building end to end data...
-
Senior Big Data Developer
2 days ago
Toronto, Ontario, Canada Compunnel Inc. Full timeAt Compunnel Inc., we are seeking an experienced Big Data Developer to join our team. The ideal candidate will have a strong background in Python and scalable solutions, with a focus on Kafka. We are looking for someone who can design and develop streaming pipelines with Kafka by developing publisher and subscriber scripts.The successful candidate will have...
-
Big Data Developer
2 weeks ago
Toronto, Ontario, Canada First Derivative Full timeAre you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...
-
Big Data Developer
6 days ago
Toronto, Ontario, Canada First Derivative Full timeAre you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...
-
Big Data Developer
7 days ago
Toronto, Ontario, Canada First Derivative Full timeAre you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...
-
Big Data Developer
4 weeks ago
Toronto, Ontario, Canada First Derivative Full timeAre you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...
-
Big Data Developer
2 weeks ago
Toronto, Ontario, Canada First Derivative Full timeAre you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems? First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...
-
Big Data Developer, GFT
4 weeks ago
Toronto, Ontario, Canada Hager & North Investment Funds Ltd Full timeJob SummaryJob DescriptionBig Data DeveloperWhat is the opportunity?You will join the Liquidity Risk Management Team as a Big Data Developer, responsible for providing an in-house analysis/reporting platform to a global group of enterprise liquidity risk analysts and managers. You will work closely with developers to analyze business, technical and system...
-
Big Data Expert
3 days ago
Toronto, Ontario, Canada B.M.S IT solutions Full timeJob DescriptionB.M.S IT Solutions is seeking a seasoned Big Data Developer to join our team. The ideal candidate will have a strong background in Big Data, Python, and PySpark, with experience working on large-scale data processing projects.Key Responsibilities:Develop and maintain high-quality big data applications using PySparkCollaborate with data...
-
Senior Big Data Developer
6 days ago
Toronto, Ontario, Canada Citi Full timeCiti is looking for a talented Senior Spark Java Developer to join our team.About the RoleThe successful candidate will be responsible for developing and optimizing data pipelines for risk calculations, trade analytics, and regulatory reporting.ResponsibilitiesDevelop scalable data pipelines for processing and analyzing large financial datasets.Implement...
-
Senior Big Data Developer, GFT
4 weeks ago
Toronto, Ontario, Canada RBC Full timeJob SummaryWe are seeking a Senior Big Data Developer to join the Capital Risk Measurement Team, delivering services to implement technical and business needs. The successful candidate will work closely with various partners across IT and business.Key ResponsibilitiesDesign and develop complex data-intensive systems using cloud & Big Data...
-
Big Data Developer
4 days ago
Toronto, Ontario, Canada Nous Infosystems Full timeSenior Data ProfessionalWe are seeking a senior-level Big Data Developer - Databricks Expert to join our team at Nous Infosystems. As a Databricks Engineer, you will be responsible for designing, developing, and optimizing data pipelines and workflows using Python and PySpark.You will work closely with data engineers, analysts, and stakeholders to ensure...
-
Big Data Architect
3 days ago
Toronto, Ontario, Canada Tiger Analytics Full timeTiger Analytics is a leader in advanced analytics consulting.We are seeking a seasoned Big Data Architect to drive our company's growth and success.This role involves:Designing and implementing large-scale data architecturesCollaborating with cross-functional teams to build data pipelines and machine learning solutionsEnsuring scalability and performance of...
-
Senior Big Data Developer
4 days ago
Toronto, Ontario, Canada Lumenalta Full timeWe are seeking a highly skilled Senior Big Data Developer to join our team. As a key member of our technical group, you will be responsible for designing and implementing large-scale data systems using technologies such as Pyspark, AWS, and Databricks.Job RequirementsThe ideal candidate should have:10+ years of experience in a senior developer role using...
-
Big Data Specialist
5 days ago
Toronto, Ontario, Canada Rubicon Path Full timeAbout Our Team\Rubicon Path is a leading provider of big data solutions. We are seeking a Big Data Specialist to join our team.\Responsibilities\Data Engineering\Designing technical solutions for data acquisition and storage into our centralized data repository.Developing ELT scripts, designing data-driven logic, and conducting unit testing.\Database...
-
Informatica Data Quality
4 weeks ago
Toronto, Ontario, C6A, Ontario, Canada Atlantis IT Group Full time5 – 10years experience as as a Informaitca data Quality Cloud developer Design and implement data quality rules for cleansing, deduplication, and standardization.Create data quality mappings and workflows to apply cleansing logic.Develop custom data quality functions and reference data tables.Integrate data quality processes with other data integration...
-
Big Data Solutions Specialist
5 days ago
Toronto, Ontario, Canada Jobber Full time**Job Description**As a Big Data Solutions Specialist at Jobber, you'll play a critical role in developing and implementing big data solutions that meet the needs of our organization. With a strong background in data engineering and experience working with large datasets, you'll be able to design and implement scalable data pipelines that are efficient,...
-
Big Data Architect
18 hours ago
Toronto, Ontario, Canada Genesys Full timeAbout the Role:We are seeking an experienced Cloud Analytics Engineer to join our team. As a key member of our Genesys Cloud Analytics platform, you will collaborate with software engineers, product managers, and data scientists to develop, operationalize, and maintain big data products that enhance customer experience.Key Responsibilities:Develop and deploy...