Data Engineer

1 week ago

Québec, Quebec, Canada Princeton IT Services Full time $50,000 - $53,000 per year

Job Title: Data Engineer – Python, PySpark & SQL

Location: Canada

Job Type: Full time contract

We are looking for a strong Lead Data Engineer with deep experience in Python, PySpark, SQL, and AWS to design, develop, and optimize large-scale data pipelines. This role requires strong hands-on coding skills, the ability to validate and process complex raw data, and expertise in running and tuning PySpark jobs on EMR.

Responsibilities

  • Build scalable data ingestion and transformation pipelines using Python, PySpark, and SQL.
  • Process raw CSV/text files from AWS S3, including validating headers, schema checks, and malformed file detection.
  • Convert raw data into structured DataFrames and implement reusable data quality checks.
  • Develop advanced transformations using SQL/PySpark (Window functions, LAG(), grouping logic, date gap detection, etc.).
  • Deploy and tune PySpark applications on AWS EMR, optimizing executor memory, cores, shuffle behavior, and cluster performance.
  • Work with AWS services such as S3, EMR, Glue, Lambda, IAM.
  • Debug performance issues (OOM errors, shuffle spill, GC problems) and improve pipeline reliability.
  • Lead design discussions, code reviews, and mentor junior engineers.

Required Skills

  • 8+ years of experience in Data Engineering.
  • Expert Python (file processing, scripting, validation automation).
  • Strong PySpark (DataFrames, job tuning, distributed processing).
  • Advanced SQL (analytical functions, performance tuning).
  • Hands-on with AWS data stack: S3, EMR, Glue, Lambda.
  • Strong understanding of Spark memory allocation, YARN container usage, and EMR resource tuning.
  • Excellent debugging, communication, and problem-solving skills.

Nice to Have

  • Airflow or Databricks experience.
  • Terraform or CloudFormation.
  • Experience with data lake formats (Delta, Iceberg, Hudi).

Job Type: Full-time

Pay: $50.00-$53.00 per hour

Experience:

  • Data Engineer: 10 years (required)
  • Pyspark: 4 years (required)
  • Python: 6 years (required)
  • AWS: 4 years (required)

  • Marketing Operations Manager

    3 days ago

    Québec, Quebec, Canada Redpanda Data Full time US$133,000 - US$170,000 per year

    About the Role: In this role, we're looking for a data-driven marketing professional to work with the lead lifecycle, execute day-to-day marketing initiatives, oversee the martech stack and guide the business with performance insights. You will work closely with marketing and revops teams to implement the tools and systems crucial to supporting our...

  • Senior Software Engineer, User Data

    1 week ago

    Québec, Quebec, Canada StackAdapt Full time $120,000 - $200,000 per year

    StackAdapt is the leading technology company that empowers marketers to reach, engage, and convert audiences with precision. With 465 billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly connects brand and performance marketing to drive measurable results across the entire customer journey. The most...

  • Senior Software Engineer, User Data

    7 days ago

    Québec, Quebec, Canada StackAdapt Full time $120,000 - $180,000 per year

    StackAdapt is the leading technology company that empowers marketers to reach, engage, and convert audiences with precision. With 465 billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly connects brand and performance marketing to drive measurable results across the entire customer journey. The most...

  • Senior Staff Data Security Privacy Engineer

    3 days ago

    Québec, Quebec, Canada Coursera Full time US$200,000 - US$271,320 per year

    About CourseraCoursera was founded in 2012 by Stanford professors Andrew Ng and Daphne Koller to make world-class learning accessible to everyone, everywhere. Today, over 190 million learners and 375+ university and industry partners use our platform to gain skills in fields like AI, data science, technology, and business. As a Delaware public benefit...

  • Staff Software Engineer, User Data

    1 week ago

    Québec, Quebec, Canada StackAdapt Full time $175,000 - $525,000 per year

    StackAdapt is the leading technology company that empowers marketers to reach, engage, and convert audiences with precision. With 465 billion automated optimizations per second, the AI-powered StackAdapt Marketing Platform seamlessly connects brand and performance marketing to drive measurable results across the entire customer journey. The most...

  • Technicien D'assistance Informatique/ Desktop Support Technician

    1 week ago

    Québec, Quebec, Canada NTT DATA Full time $60,000 - $90,000 per year

    Req ID: 345364NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Technicien D'assistance Informatique/ Desktop Support Technician to join our team in Quebec City, Quebec (CA-QC),...

  • Project Manager, Data

    3 days ago

    Québec, Quebec, Canada nesto Full time $80,000 - $110,000 per year

    Our mission is to provide a positive, empowering, and transparent property financing experience that is simple from start to finish. Our team consists of skilled technology experts, caring mortgage specialists, and a diverse marketing team, all working together to lead change in the mortgage industry.At Nesto, We're Proud OfOur clients love our positive,...

  • Data Center Operations Engineer

    3 days ago

    Québec, Quebec, Canada Lambda Full time $68,300 - $102,700 per year

    Lambda, The Superintelligence Cloud, builds Gigawatt-scale AI Factories for Training and Inference. Lambda's mission is to make compute as ubiquitous as electricity and give every person access to artificial intelligence. One person, one GPU.If you'd like to build the world's best deep learning cloud, join us.Note: This position requires presence in our...

  • Data Center Operations Engineer

    3 days ago

    Québec, Quebec, Canada Lambda Full time $80,000 - $120,000 per year

    Lambda, The Superintelligence Cloud, builds Gigawatt-scale AI Factories for Training and Inference. Lambda's mission is to make compute as ubiquitous as electricity and give every person access to artificial intelligence. One person, one GPU.If you'd like to build the world's best deep learning cloud, join us. *Note: This position requires presence in our...

  • Data Center Operations Engineer

    15 hours ago

    Québec, Quebec, Canada Lambda Full time $100,000 - $120,000 per year

    Lambda, The Superintelligence Cloud, builds Gigawatt-scale AI Factories for Training and Inference. Lambda's mission is to make compute as ubiquitous as electricity and give every person access to artificial intelligence. One person, one GPU. If you'd like to build the world's best deep learning cloud, join us. *Note: This position requires...