Big Data Solutions Architect

7 days ago

Toronto, Ontario, Canada First Derivative Full time
Capital Markets Big Data Engineer Opportunity

We are seeking a highly skilled Big Data Engineer to join our team at First Derivative, the world's largest Capital Markets dedicated consultancy. As a Big Data Engineer, you will have the opportunity to work on mission-critical projects, collaborate with experienced professionals, and contribute to the development of innovative solutions.

About the Role

The successful candidate will have a strong background in software development, with experience in building large-scale distributed data processing systems and applications. They will also possess excellent communication skills, be proficient in writing clean code, and have expertise in programming languages such as Python, Kafka, Spark, SQL, Hive, Couchbase, Impala, Hadoop, Splunk, Autosys, and shell scripting.

In addition, the ideal candidate will have strong cloud experience on AWS Lambda, AWS EMR, AWS S3, AWS EC2, EKS, and proficiency in DevOps tools such as Snow, Build (TeamCity, Jenkins, Terraform), and U-Deploy. Knowledge of Capital Market and Data Analysis is also essential, as well as experience in dealing with huge volumes of data operations.

A Bachelor's Degree or Master's in Computer Science, Engineering, Software Engineering, or a relevant field is required, along with 10+ years of software development experience. The successful candidate will also have good knowledge of Linux-based infrastructures, Linux/Unix administration, and Cloud.

Key Responsibilities
  • Design and develop scalable, high-performance big data architectures
  • Develop and implement efficient data processing pipelines using technologies such as Apache Kafka, Apache Spark, and Apache Hadoop
  • Collaborate with cross-functional teams to identify business requirements and design solutions
  • Implement and maintain data quality, security, and governance processes
  • Provide technical guidance and support to junior engineers and other stakeholders
What We Offer

As a Big Data Engineer at First Derivative, you can expect a competitive salary of $140,000 - $180,000 per annum, depending on experience, plus a range of benefits including:

  • Health insurance
  • Pension scheme
  • 25 days' annual leave
  • Flexible working hours
  • Professional development opportunities

We are an equal opportunities employer and welcome applications from diverse candidates. Please note that we do not discriminate based on age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state, or local laws.

Our Global Candidate Privacy Notice is available on our website.

  • Big Data Solutions Architect

    3 weeks ago

    Toronto, Ontario, Canada Jay Analytix Full time

    Job OverviewJay Analytix is seeking a highly skilled Big Data Solutions Architect to join our team. As a key member of our technology group, you will be responsible for designing and implementing scalable data engineering solutions.About the RoleThis is a full-time position that involves working closely with portfolio managers, traders, operations staff, and...

  • Big Data Solutions Architect

    4 weeks ago

    Toronto, Ontario, Canada Amazon Development Centre Canada ULC Full time

    Job DescriptionAs a Software Development Manager at Amazon Development Centre Canada ULC, you will be responsible for leading the development of our big data processing platform. You will define and drive the multi-year vision for this platform, build and manage a team of innovative engineers, and deliver robust and scalable solutions towards your vision.Key...

  • Big Data Architect

    3 weeks ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job Description for Big Data LeadOverviewAstra North Infoteck Inc. is seeking an experienced Big Data Lead to lead our team in designing and implementing cutting-edge big data solutions. The ideal candidate will have a strong background in data quality, architecture, and engineering, with experience in leading teams and driving results.Key...

  • Senior Data Architect, Big Data Ecosystem

    1 week ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    About the RoleWe are seeking a Senior Data Architect to lead our Big Data ecosystem efforts. This is a key position that will play a critical role in shaping our data strategy and ensuring the effective use of Big Data technologies.

  • Big Data Engineer

    7 days ago

    Toronto, Ontario, Canada Teranet Inc. Full time

    Job Title: Big Data Engineer - Data ArchitectWe are seeking an experienced Contract Big Data Engineer to join our Data Analytics team at Teranet Inc. in Canada.About the Role:This is a contract position, with a duration of 1 year. As a Big Data Engineer - Data Architect, you will work collaboratively with data product owners, data analysts, and other data...

  • Data Engineering Leader for Big Data Solutions

    4 weeks ago

    Toronto, Ontario, Canada Autodesk Full time

    Overview of the PositionAutodesk is seeking a Senior Software Developer, Big Data to join our Enterprise Data Engineering & Visualization (EDEV) team. The EDEV Team's mission is to build data pipelines and solutions that enable users to gain valuable business insights.Estimated Salary: $150,000 - $180,000 per yearThe successful candidate will be responsible...

  • Big Data Architect Leader

    3 weeks ago

    Toronto, Ontario, Canada Amazon Development Centre Canada ULC Full time

    About Amazon Development Centre Canada ULCAmazon Development Centre Canada ULC is a leading technology company that operates one of the largest big data analytics systems at Amazon.We are responsible for end-to-end processing of impressions, views, and clicks as well as video interaction events and other rich media events in ads. Our team owns the campaign...

  • Strategic Data Solutions Architect

    4 weeks ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    About the RoleWe are seeking a highly skilled Strategic Data Solutions Architect to join our team in Canada. As a key member of our Data Intelligence team, you will play a critical role in designing and implementing tailored data solutions to meet customer needs.Key ResponsibilitiesProvide thought leadership by recommending the most appropriate technologies...

  • Azure Data Solutions Architect

    3 weeks ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Astra North Infoteck Inc.Job Title: Azure Data Solutions ArchitectDescription:We are seeking a highly skilled Azure Data Solutions Architect to join our team at Astra North Infoteck Inc. The ideal candidate will have experience designing and developing data pipelines using Cloud Technologies based on business requirements and technical design.The successful...

  • Data Solutions Architect

    4 weeks ago

    Toronto, Ontario, Canada Synpulse Schweiz AG Full time

    At Synpulse Schweiz AG, we seek a highly skilled and motivated Data Solutions Architect to join our dynamic team.About the RoleThis is an exciting opportunity for a seasoned Financial Analytics Leader to lead the design, development, and implementation of robust, scalable, and efficient data solutions using industry best practices and cutting-edge...

  • Big Data Engineer: Building Data Solutions

    3 weeks ago

    Toronto, Ontario, Canada Autodesk Full time

    Job OverviewAutodesk is seeking a highly skilled Senior Software Developer, Big Data to join our Enterprise Data Engineering & Visualization (EDEV) team. The EDEV Team is responsible for designing and implementing data pipelines and solutions that enable our users to gain valuable business insights. These solutions serve as the foundation for all data...

  • Data Architect

    4 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job DescriptionRequisition ID: 205977Key Team Member, committed to results, in an inclusive and high-performing culture.The Global Wealth Engineering (GWE) team within Scotiabank is seeking an experienced Data Engineer with deep expertise in Google Cloud Platform (GCP) to join our growing team.In this role, you will be responsible for designing, building,...

  • Senior Data Solutions Architect

    7 days ago

    Toronto, Ontario, Canada Triunity Software, Inc. Full time

    **Job Title:** Senior Data Solutions Architect**Location:** Toronto, ON (Hybrid - 2 days/week onsite)We are seeking a highly skilled Data Engineer to join our team at Triunity Software, Inc. in Toronto, ON. As a key member of our team, you will be responsible for designing and implementing optimal data pipeline architectures using Java and other big data...

  • Solutions Architect

    2 weeks ago

    Toronto, Ontario, Ontario, Canada Sigmoid Full time

    About Sigmoid Analytics:Sigmoid enables business transformation using data and analytics, leveraging real-time insights to make accurate and fast business decisions, by building modern data architectures using cloud and open source. Some of the world’s largest data producers engage with Sigmoid to solve complex business problems. Sigmoid brings deep...

  • Data Engineering Solutions Architect

    4 weeks ago

    Toronto, Ontario, Canada The Toronto-Dominion Bank (Canada) Full time

    Job Summary:We are seeking a highly skilled Data Engineering Solutions Architect to join our team at The Toronto-Dominion Bank (Canada). This role is responsible for designing and developing complex data engineering solutions, ensuring high-quality delivery of scalable and secure data infrastructure.Responsibilities:Design, develop, and implement large-scale...

  • Data Architect

    4 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    About the RoleWe are seeking a highly skilled Data Architect to join our team at Scotiabank. In this role, you will be responsible for designing and implementing scalable, extensible, and performant data engineering solutions.Participate in the implementation of data engineering and transformation solutions.Contribute to the delivery of data ingestion,...

  • Senior Data Architect

    3 weeks ago

    Toronto, Ontario, Canada CB Canada Full time

    Job OverviewWe are seeking a highly skilled Data Engineering Analyst to join our team at CB Canada. This is an exciting opportunity for a talented professional to design and develop state-of-the-art data analytics solutions for business problems.The ideal candidate will have a strong background in Big Data analytics and experience working with large-scale...

  • Cloud Data Architect Specialist

    3 weeks ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Astra North Infoteck Inc. is seeking an experienced Cloud Data Architect Specialist to join our team.About the RoleWe are looking for a highly skilled professional with expertise in designing and developing data pipelines using Cloud Technologies based on business requirements and technical design. The ideal candidate will have experience working as a Data...

  • Cloud Data Architect Canada

    2 weeks ago

    Toronto, Ontario, Canada Sigmoid Full time

    About SigmoidSigmoid enables business transformation using data and analytics, leveraging real-time insights to make accurate and fast business decisions, by building modern data architectures using cloud and open source technologies. As one of the world's largest data producers engages with us to solve complex business problems, we bring deep expertise in...

  • Azure Data Solutions Developer

    4 weeks ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job OverviewAstra North Infoteck Inc. is seeking an experienced Azure Data Solutions Developer to join our team. As a key member of our data engineering group, you will design and develop scalable data pipelines using Cloud Technologies.About the RoleThis role involves collaborating with stakeholders, business analysts, and data architects to translate...