Kafka Engineer

3 months ago

Toronto Ontario, Ontario, Canada First Derivative Full time

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?


First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.


Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.


Kafka Engineer


Essential Requirements:

  • Solid background in real-time data ingestion and processing preferably with Kafka and Flink for handling real-time data streams.
  • Proven experience with cloud platforms (e.g., AWS, Azure, GCP) is essential as our projects are developed and deployed in cloud environments.
  • Strong experience in designing, building, maintaining, and upgrading real-time data pipelines. Ability to create self-service tooling that delivers clean and efficient results.
  • Hands-on experience working in agile environments, including participation in sprints, scrums, and continuous delivery practices.
  • Proficiency in writing automated tests to ensure requirements are met and data integrity is maintained.
  • Deep understanding and experience with stream processing frameworks such as Flink, Spark Streaming, Kafka Streams, or similar technologies (preferably Flink).
  • Strong proficiency in relational databases and SQL, with the ability to optimize queries for performance.


Preferred Qualifications (Nice to Have):

  • Experience with the Confluent streaming platform or other streaming services like AWS Kinesis, Google Cloud Pub/Sub, etc.
  • Experience with Spark or equivalent technologies like Apache Beam for distributed data processing.
  • Experience in data architecture, specifically in designing Dimensional Models, Data Lakes, and Data Lakehouses.
  • Familiarity with best practices in data governance, including security, compliance, and data quality management.


Soft Skills:

  • Strong communication skills, with the ability to articulate complex technical concepts to diverse teams.
  • Proven ability to work effectively in cross-functional teams and collaborate with stakeholders to achieve project goals.


FD provides equal employment opportunities to all employees and applicants for employment and prohibits discrimination and harassment of any type without regard to race, color, religion, age, sex, national origin, disability status, genetics, protected veteran status, sexual orientation, gender identity or expression, or any other characteristic protected by federal, state or local laws.


Candidate personal data will be processed in line with our Global Candidate Privacy Notice available on our website.

  • Senior Java Developer with data engineering, Apache Flink, Beam and Kafka experience to work on a capital markets project with one of our major banking cli

    2 days ago

    Toronto, Ontario, C6A, Ontario, Canada S.i. Systems Full time

    Senior Java Developer with data engineering, Apache Flink, Beam and Kafka experience to work on a capital markets project with one of our major banking clients- 36062Location Address: Hybrid - Toronto (1/week) - *Can be a remote role with strong candidates are not available in GTA but has to be in Canada and available in EST time zone*Contract Duration: 6...

  • Senior API and Integration Architect responsible for design and providing guidance in API

    2 days ago

    Toronto, Ontario, C6A, Ontario, Canada S.i. Systems Full time

    Our Insurance client is looking for a Senior API and Integration Architect responsible for design and providing guidance in API & Integration Solutions (Kafka and Apigee) Permanent full time positionLocation: Toronto - on site 1-2 days a weekResponsibilities:Architect the enterprise API, Event and Microservice Integration Platforms, reporting directly to...

  • VP of Engineering

    4 months ago

    Toronto, Ontario, Ontario, Canada Understanding Recruitment Full time

    VP of Engineering (Platform)We are seeking a VP of Engineering for an innovative Series-C Scale-Up revolutionising customer service within the e-commerce space. The team have developed their own AI powered customer support platform designed specifically for e-commerce businesses. The platform helps to centralize customer interactions from various channels,...

  • Sr. Backend Java,

    1 month ago

    Toronto, Ontario, C6A, Ontario, Canada S.i. Systems Full time

    Sr. Backend Java, (Springboot/Spring) Developer working with Kafka and AWS to a support multi-year project for a banking client Duration: 6 months with strong possibility of extensionLocation: Hybrid (1-2 days a week in DT Toronto office)Description:Senior backend developer that can build strategic adaptors to consume batch as well as real-time messages,...

  • Senior Data Engineer

    2 days ago

    Toronto, Ontario, Ontario, Canada Finance Professionals Inc. Full time

    Senior Data Engineer Job Description Location: Hybrid, 3 days onsite – Downtown, Toronto Duration: 1 year (Extension - Yes depending on performance (looking for a long-term person)What you will do:• Work with business stakeholders and cross-functional teams to understand data requirements and deliver scalable data solutions. • Design, develop, and...

  • Senior Software Engineer II-Kafka Specialized in Data Streaming Platforms

    3 weeks ago

    Toronto, Ontario, Canada Confluent, Inc Full time

    At Confluent, Inc., we're building a new category in data infrastructure - data streaming. We're creating experiences and using the power of data in ways that profoundly impact the way we live.The Kora Control Plane team is responsible for infrastructure orchestration for Confluent Cloud Kafka. We own instantaneous provisioning, placement, capacity...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Crescens Inc. Full time

    About Crescens Inc.Crescens Inc. is a leading organization in the field of data engineering and architecture. We strive to provide innovative solutions for our clients and contribute to the growth of the industry.Job SummaryWe are seeking an experienced Data Architecture Specialist to join our team. The successful candidate will be responsible for designing,...

  • Performance Engineering Lead

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Tata Consultancy Services Full time

    About TCS: Tata Consultancy Services is an IT services, consulting, and business solutions organization that has been partnering with many of the world’s largest businesses in their transformation journeys for over 55 years. Its consulting-led, cognitive powered portfolio of business, technology, and engineering services and solutions is delivered through...

  • Senior Data Software Engineer

    2 days ago

    Toronto, Ontario, Ontario, Canada Delpath Full time

    Senior Data software EngineerLocation Address: Hybrid at Toronto (1/week)*Can be a remote role with strong candidates are not available in GTA but has to be in Canada and available in EST time zone*Contract Duration: 6 monthsExtension: Yes - subject to work demand.• Business group: Markets & enterprise technology - We are part of the Cross-Asset...

  • Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    About the OpportunityRoyal Bank of Canada is seeking an experienced Data Engineer to join its US Cash Management Technology team.Job SummaryThis role will offer an opportunity to build, enhance market-leading data capabilities that are secure and scalable.Key ResponsibilitiesCollaborate with teams to design and implement secure, highly available, and...

  • Data Science Engineer

    3 weeks ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Astra North Infoteck Inc.Job Title: Data Science EngineerAbout Astra North Infoteck Inc.We are a leading technology company that specializes in innovative solutions. Our team of experts is dedicated to delivering high-quality services and products that meet the needs of our clients.Estimated Salary Range:$120,000 - $180,000 per yearJob Description:We are...

  • Full Stack Software Engineer

    4 weeks ago

    Toronto, Ontario, Canada Fluent, LLC Full time

    We're looking for a highly skilled Full Stack Engineer to help us build cutting-edge backend solutions using a broad range of technologies. This role is perfect for someone with experience in Node.js, ASP.NET, and Docker, who can collaborate with cross-functional teams to optimize platforms for performance, scalability, and reliability.As a Full Stack...

  • Data Engineer

    2 days ago

    Toronto, Ontario, Ontario, Canada Agilus Work Solutions Full time

    Data Engineer – Term Contract – 16 monthsAgilus’ client is seeking an experienced Data Engineer to join our innovative team on a contract basis for 16 months. In this role you will design, optimize, and maintain scalable data infrastructure that supports various data initiatives, including AI and machine learning (ML) capabilities. You will be...

  • DevOps Engineer

    2 days ago

    Toronto, Ontario, Ontario, Canada Sigmaways Inc Full time

    We are seeking a Senior Software Engineer, DevOps to support our continued growth and success by scaling, modernizing, supporting, and advancing our Continuous Integration and Continuous Delivery strategies to build, test, deploy, package, and release software rapidly to production.Must have experience working with Jenkins pipelines, Shell scripting, Linux...

  • Platform Engineer

    2 days ago

    Toronto, Ontario, Ontario, Canada PRI Global Full time

    Jenkins pipelinesShell scripting, Linux system commands Azure CLI* Excellent knowledge of build and deployment tooling such as Jenkins pipelines, git, Nexus / Artifactory* Excellent knowledge in writing Chef automation code, both infrastructure and application deployment cookbooks* Advanced knowledge of Azure* Excellent research, analytical, and...

  • Cloud Engineer

    4 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job SummaryRequisition ID: 203739As a Platform Engineer at Scotiabank, you will play a key role in the success of our Event Driven Architecture and Real-time events platform. You will be responsible for designing, implementing, and ongoing supporting the production services, applications, and platform components that comprise our backend platform.Key...

  • Lead Engineering Director

    3 weeks ago

    Toronto, Ontario, Canada Understanding Recruitment Full time

    Unlock Your Potential as a High-Impact VP of EngineeringWe're seeking an exceptional Vice President of Engineering to join our innovative Series-C Scale-Up, revolutionizing customer service in the e-commerce space. Our cutting-edge AI-powered customer support platform empowers businesses to centralize interactions, enhance satisfaction, and drive sales...

  • Senior Java Software Engineer

    3 months ago

    Toronto, Ontario, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...

  • Senior Data Architect and Engineering Lead

    2 weeks ago

    Toronto, Ontario, Canada Foilcon Full time

    About FoilconFoilcon is a forward-thinking organization seeking an experienced Senior Data Architect and Engineering Lead to drive the development of our data infrastructure. This role offers a unique opportunity to shape the future of our company's data architecture and engineering practices.Job SummaryWe are looking for a highly skilled Senior Data...

  • Storytelling Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Wattpad Full time

    Job SummaryWe are seeking a highly skilled Data Engineer to join our team at Wattpad, a global multiplatform entertainment company. The successful candidate will be responsible for designing and evolving our existing data architecture, building and maintaining ETL pipelines, and creating data infrastructure systems.About UsWattpad is a remote-friendly...