Lead Big Data Developer

2 weeks ago

Toronto, Ontario, Canada Vybog Full time

Overview

Are you interested in building the next-generation platform that handles
petabytes of data
and powers
data insight creation
using cutting-edge
data science technologies
?

Are you excited about leveraging
Big Data
,
AI / Machine Learning
, and
Data Analytics
to deliver actionable insights?

We are a
dynamic team of top-notch engineers
dedicated to making a dent in the
FinTech universe
.

We're rapidly expanding in
Vancouver, beautiful British Columbia
, and if you wish to be part of this
Priceless experience
, read below.

The
Marketing Services (MS) Technology team
is looking for a
Senior Data Engineer
who is passionate about data and analytics, highly motivated, and capable of taking technical ownership of data solutions with an emphasis on
engineering efficiency
and
on-time delivery
.

The ideal candidate will be familiar with the fast-paced world of Big Data technologies and have experience building data solutions using
emerging tools
while ensuring
platform stability
. You'll work with diverse datasets and be at the forefront of transforming the way
Mastercard captures, processes, stores, and visualizes data
.

Role & Responsibilities

In this role, you will:

  • Design and develop batch and streaming solutions
    using various Big Data technologies.
  • Work closely with architects
    to design secure, scalable, and efficient data platforms.
  • Take ownership of
    assessing technologies and approaches
    for data ingestion, transformation, and storage.
  • Develop software
    utilizing open-source technologies to interface with distributed and relational data sources.
  • Collaborate with
    cross-functional Mastercard teams
    to identify functional and system requirements.

All About You

The ideal candidate for this position should have:

  • Hands-on experience
    with Big Data and analytics technologies, including
    Hadoop
    ,
    Spark
    , and related frameworks.
  • Programming expertise
    in
    Java
    ,
    Scala
    , or
    Python
    , with a focus on developing data processing and transformation logic.
  • Real-time and batch data processing
    experience, building robust data pipelines for real-time or near-real-time ingestion.
  • Proficiency in
    data modeling
    and
    schema design
    for both relational and non-relational databases, supporting high data volume and optimized query performance.
  • Exposure to
    cloud technologies
    with hands-on experience in
    Databricks
    and
    Cloudera
    , including knowledge of
    cloud architecture
    ,
    data security
    , and
    scalability best practices
    .
  • Experience in
    optimizing and managing ETL workflows
    using scheduling, monitoring, and debugging tools.
  • Strong
    problem-solving abilities
    with a mindset for
    automation and efficiency improvements
    .
  • Excellent
    communication and collaboration skills
    to work effectively across technical and business teams, promoting knowledge sharing and alignment on data engineering best practices.
  • Proven track record of
    delivering software projects
    and a willingness to roll up your sleeves to get the job done.
  • Excellent oral and written communication skills.
  • Familiarity with
    Agile / Scrum methodologies.
  • Ability to
    manage multiple priorities simultaneously.
  • A
    BS/BA degree
    in
    Computer Science, Information Systems
    , or a related field.

  • Big Data Developer

    24 hours ago

    Toronto, Ontario, Canada Pyramid Consulting, Inc Full time

    Immediate need for a talentedBig Data Developer.This is a06+ months contractopportunity with long-term potential and is located inToronto, ON (Onsite). Please review the job description below and contact me ASAP if you are interested.Job ID: Pay Range: CAD40- CAD42/hour on T4.Key Responsibilities:Migrate and refactor existing Java based Spark modules to...

  • Senior big Data Developer

    2 days ago

    Toronto, Ontario, Canada BULL-IT SOLUTIONS LTD Full time

    Tips: Provide a summary of the role, what success in the position looks like, and how this role fits into the organization overall.ResponsibilitiesTotal Experience: 7-12 yearsRole Description:• Design high quality deliverables adhering to business requirements with defined standards and design principles, patterns• Develop and maintain highly scalable,...

  • Lead Big Data Developer, GFT

    2 days ago

    Toronto, Ontario, Canada RBC Full time

    Job DescriptionWhat is the opportunity?As the Lead Big Data Developer lead the technical design and development of application systems on GFT - DaaS team. Apply extensive, in-depth knowledge, skills, and practices to perform complex assignments.Are you a talented, creative, and results-driven professional who thrives on delivering high-performing...

  • Consultant, Big Data Development

    1 week ago

    Toronto, Ontario, Canada CIBC Full time

    We're building a relationship-oriented bank for the modern world. We need talented, passionate professionals who are dedicated to doing what's right for our clients.At CIBC, we embrace your strengths and your ambitions, so you are empowered at work. Our team members have what they need to make a meaningful impact and are truly valued for who they are and...

  • Staff Product Data Analyst

    1 week ago

    Toronto, Ontario, Canada Big Viking Games Full time

    Important: This a full-time, hybrid role for Ontario-based employees only. The successful candidate will be required to work from our Toronto office (Queens Quay West) for a minimum of 3 days per week. About Us:Making fans - That's what we're all about Since our humble beginnings in 2011, these two words have driven Big Viking Games to become the successful...

  • Sr. Big Data Developer

    1 week ago

    Toronto, Ontario, Canada Continental Technology Solutions Full time

    Company Description Continental Technology Solutions is Our consulting and managed services deliver the resources and capabilities required to assess,design, build and manage an agile, flexible IT environment. You'll work with one dedicated team from strategy and assessment through design, implementation, management and optimisation to reach a true...

  • Java/J2EE & Microservices Developer/Lead - Remote

    1 week ago

    Toronto, Ontario, Canada NTT DATA Full time

    Req ID: 347511NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Java/J2EE & Microservices Developer/Lead - Remote to join our team in Toronto, Ontario (CA-ON), Canada (CA). Java/J2EE...

  • Lead Data Engineer

    14 hours ago

    Toronto, Ontario, Canada Scotiabank Full time

    Requisition ID: 237458Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.The Wealth Data engineering team within the Global Wealth Engineering (GWE) is the key team in meeting the operational data needs of the various stake holders within Wealth Management. The Lead Data Engineer will play a key role in...

  • Team Lead, Data Engineering

    1 week ago

    Toronto, Ontario, Canada HighlightTA Full time

    HighlightTA is the on-demand talent team for Q4 At Q4, we make an impact together, obsess over our customer, operate with integrity, and bring big ideas to life. Q4 is charting a bold new path for investor relations as the first AI-driven IR Ops Platform, providing everything an IR team needs to succeed on a single, powerful platform. The Q4 Platform...

  • Senior Developer, Data

    24 hours ago

    Toronto, Ontario, Canada Porter Airlines Inc. Full time

    Job SummaryData is a critical enabler of operational efficiency, performance insights, and growth at Porter. As a Senior Developer, Data, you will lead the design and implementation of scalable, resilient data integration solutions that support analytics, automation, and enterprise systems. You'll collaborate across teams to eliminate manual processes,...