Data Engineering Manager

5 hours ago

Toronto, Ontario, Canada TEEMA Full time

Hybrid onsite 2 days/week or 8 days/month

1 interview will be onsite (2 interview process)

Databricks is a must

AWS or Azure

Must be able to do code reviews of Python code

Create designs and validate code

"own" the architecture

As the Data Engineering Manager, you will be responsible for architecting, implementing, and optimizing end-to-end data solutions on Databricks while integrating with core AWS services. You will lead a technical team of data engineers, ensuring best practices in performance, security, and scalability. This role requires a deep, hands-on understanding of Databricks internals and a track record of delivering large-scale data platforms in a cloud environment.

  • Lead a team of data engineers in the architecture and maintenance of Databricks Lakehouse platform, ensuring optimal platform performance and efficient data versioning using Delta Lake
  • Manage and optimize Databricks infrastructure including cluster lifecycle, cost optimization, and integration with AWS services (S3, Glue, Lambda)
  • Design and implement scalable ETL/ELT frameworks and data pipelines using Spark (Python/Scala), incorporating streaming capabilities where needed
  • Drive technical excellence through advanced performance tuning of Spark jobs, cluster configurations, and I/O optimization for large-scale data processing
  • Implement robust security and governance frameworks using Unity Catalog, ensuring compliance with industry standards and internal policies
  • Lead and mentor data engineering teams, conduct code reviews, and champion Agile development practices while serving as technical liaison across departments
  • Establish and maintain comprehensive monitoring solutions for data pipeline reliability, including SLAs, KPIs, and alerting mechanisms
  • Configure and manage end-to-end CI/CD workflows using source control, automated testing, and version control
Qualifications

Your Role:

  • You have a Bachelor's Degree in Engineering, Computer Science or equivalent.
  • 5+ years of hands-on experience with Databricks and Apache Spark, demonstrating expertise in building and maintaining a production-grade data pipelines
  • Proven experience leading and mentoring data engineering teams in complex, fast paced environments
  • Extensive experience with AWS cloud services (S3, EC2, Glue, EMR, Lambda, Step Functions)
  • Strong programming proficiency in Python (PySpark) or Scala, and advanced SQL skills for analytics and data modeling
  • Demonstrated expertise in infrastructure as code using Terraform or AWS CloudFormation for cloud resource management
  • Strong background in data warehousing concepts, dimensional modeling, and experience with RDBMS systems (e.g., Postgres, Redshift)
  • Proficiency with version control systems (Git) and CI/CD pipelines, including automated testing and deployment workflows
  • Excellent communication and stakeholder management skills, with demonstrated ability to translate complex technical concepts into business terms
  • Has demonstrated the use of AI in the development lifecycle
  • Some travel may be required to the US
  • Knowledge of financial industry will be preferred
Workwolf

  • Associate (Co-op Winter Term) - Data Analytics & Engineering

    7 days ago

    Toronto, Ontario, Canada Data SEA Consulting Full time $60,000 - $80,000 per year

    Data SEA Consulting - Associate Co-op – Data Analytics & EngineeringCompany DescriptionAt Data SEA Consulting, we help mid-sized businesses unlock the power of their data. Our clients — from private equity funds to independent business owners — rely on us to design and implement modern analytics solutions that drive measurable value. We develop...

  • Forward Deployed Engineers

    4 hours ago

    Toronto, Ontario, Canada Data Intellect Full time US$80,000 - US$150,000 per year

    Company Description At Data Intellect it has never been just about data or technology, they are our tools. It's about human intellect, collaboration and providing solutions for the most complex of challenges.We do this by living the [DI] code:We are Problem Solvers who are Humble, possess a Can-do Attitude with a focus on Togetherness."We are not big on...

  • DevOps Engineer. Contract

    5 days ago

    Toronto, Ontario, Canada Data Intellect Full time $120,000 - $180,000 per year

    Company DescriptionAt Data Intellect it has never been just about data or technology, they are our tools. It's about human intellect, collaboration and providing solutions for the most complex of challenges.We do this by living the [DI] code:We are Problem Solvers who are Humble, possess a Can-do Attitude with a focus on Togetherness."We are not big on egos,...

  • DevOps Engineer. Contract

    6 days ago

    Toronto, Ontario, Canada Data Intellect Full time $80,000 - $120,000 per year

    Company Description At Data Intellect it has never been just about data or technology, they are our tools. It's about human intellect, collaboration and providing solutions for the most complex of challenges.We do this by living the [DI] code:We are Problem Solvers who are Humble, possess a Can-do Attitude with a focus on Togetherness."We are not big on...

  • Senior Quality Engineer

    6 days ago

    Toronto, Ontario, Canada NTT DATA Full time $80,000 - $120,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Quality Engineer - Remote to join our team in Toronto, Ontario (CA-ON), Canada (CA). Job Description:Senior Quality Engineer...

  • Engineering Manager, Data

    2 weeks ago

    Toronto, Ontario, Canada hive Full time $120,000 - $180,000 per year

    Our Engineering TeamOur Engineering Team owns the code and infrastructure that lets our customers do powerful things with our product, simply and intuitively. We care about delivering the right product iterations quickly - we build minimum viable products, deploy to production multiple times per day, listen to customer feedback, and iterate.At Hive, we...

  • Engineering Manager, Data

    1 week ago

    Toronto, Ontario, Canada hive Full time $120,000 - $180,000 per year

    Our Engineering Team Our Engineering Team owns the code and infrastructure that lets our customers do powerful things with our product, simply and intuitively. We care about delivering the right product iterations quickly - we build minimum viable products, deploy to production multiple times per day, listen to customer feedback, and iterate. At Hive, we...

  • Engineering Manager, Data Platform

    2 weeks ago

    Toronto, Ontario, Canada GlossGenius Full time US$120,000 - US$180,000 per year

    About GlossGeniusGlossGenius is building an ecosystem enabling entrepreneurs to succeed.  We empower small business owners to focus on being creators, not admins, by offering a range of business management tools including booking and scheduling, marketing, analytics, payment processing and much more. Over 100,000 small business owners have chosen to rely...

  • Senior Frontend Engineer, React

    2 weeks ago

    Toronto, Ontario, Canada Data Theorem Full time $120,000 - $180,000 per year

    RemoteFull TimeExperiencedData Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.As a Senior...

  • Senior Frontend Engineer, React

    2 weeks ago

    Toronto, Ontario, Canada Data Theorem Full time $80,000 - $140,000 per year

    Data Theorem is an exciting company focused on creating a more secure world for data. Rooted in a strong engineer first culture, every employee has an impact on product and direction. We are searching for exceptional talent pursuing an opportunity to grow and take ownership of the projects that resonate most with them.As a Senior Frontend Engineer, you will...