Manager/Lead Data Engineer >

3 weeks ago

Toronto ON, Canada Badal Full time

About Badal.io

We are a boutique, rapidly growing, GCP (Google Cloud Platform) consulting company based out of Toronto. We work with GCP’s top customers (banking, telco, energy, retail, etc.) to help them with cloud transformation, security, analytics, ML, and data governance. Clients usually engage us to solve their most challenging business problems and help raise the bar at their organization.

Why Badal?

You get the best of both worlds. We operate like an early-stage startup with all the associated benefits (e.g., talent, growth, learning opportunities, flexibility), but get to solve enterprise-level technical challenges.

• People: We hire top-tier talent. Our team consists of ex-Googlers, YCombinator Alumni, and individuals that built software for 400M users.

• GCP is the Best Cloud: Maybe we are biased, but GCP is the most cutting-edge cloud provider, building on technologies that have been pioneered by Google: BigQuery, K8s/Anthos, Vertex AI, etc.

• Growth: We have doubled in size in the last 6 months, and are looking to double again this year.

You will

• Manage a team who works closely with backend engineers, product managers, and analysts

• Provide leadership and contribute to the definition, development, integration, test, documentation, and support across multiple platforms

• Serve as a process expert and provide architectural leadership to Jr engineers as needed

• Work closely with technical leads and client teams to fully demonstrate the benefits of GCP technology•

• Introduce clients to data architecture and analytics best practices

• Solve some of the most challenging, high-scale data, and IoT problems (banking, telco, energy, retail, etc.).

• Write high-quality and testable batch and real-time data pipelines

• Work with Data Scientists to design pipelines that improve their productivity and enable them to implement their ideas

• Support clients in troubleshooting issues in their test and/or production environments and identifying root causes and solutions

You have

• Mentoring and helping the team build technical capability

• Ability to effectively communicate data insights and negotiate options at senior management levels

• Experience in leading significant project steps and communicating progress/approach with technical/non-technical peers/clients and leaders

• GCP experience ( for junior candidates, or exceptional talent with other cloud experience, we will provide training programs)

• Experience in large-scale, secure, and high-availability solutions in a Cloud environment, such as GCP.

• Experience with one Dataflow or Spark

• Experience with orchestration frameworks such as Airflow, Kubeflow, Azkaban, etc.

• Extensive programming experience in Python, Java and/or Scala.

• Good understanding of modern data architecture

• Good understanding of GCP services such as IAM, and Google Cloud Storage buckets

• Experience with business intelligence tools like QuickSight, Looker and Data Studio

• Technical writing experience; preparing and presenting technical material to a variety of audiences.

• Experience in working in or with, Agile delivery teams.

Nice to have

• Streaming experience with Dataflow, Spark, Flink, Kafka Streams, etc

• Strong understanding of Data Governance principles and experience working with tools such as Collibra or Immuta

Type of qualities we look for (across all roles)

• Passionate about delivering high-quality commercial software products and platforms to market

• Team player. We are a small team and enjoy working with each other and our clients - we would like to keep it the same way as we grow

• Strong understanding of modern software engineering processes

• Client-focused and passionate about delivering strong business values.

• Able to communicate clearly and effectively with various audiences, including developers, clients, customers, partners, and executives.

• Flexible and willing to use the right technology for each problem in the context of timelines and business goals

• Ability to complete the job regardless of the circumstance

Our Benefits

• Flexible vacation policy.

• Three weeks of vacation, plus we are closed over the winter holidays (+ ~1 week)

• One team-building event each quarter

• Great health benefits with a $1500-$3000 HSA/WSA

• Certification opportunities. We will pay for your GCP certification as well as other relevant training and certifications

• Learning opportunities. We work across different industries, technologies and roles and will work with you to help you explore your interests.

• Blogging, open source, meetups and conference opportunities. We will provide a platform and time for you to pursue your ideas

• Our organization values action over politics, and our management team is made up of engineers who thrive on achieving tangible results.

Badal is an equal-opportunity employer committed to creating a safe, diverse and inclusive environment. We encourage qualified applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, nationality, and education levels to apply. If you are contacted for an interview and require accommodation during the interviewing process, please let us know.

#J-18808-Ljbffr

  • Sr. Lead, Data Engineering

    3 weeks ago

    Burlington, ON, Canada TransUnion Full time

    Sr. Lead, Data Engineering page is loaded Sr. Lead, Data Engineering Apply locations Burlington, Canada time type Full time posted on Posted 16 Days Ago job requisition id 19029206 TransUnion's Job Applicant Privacy Notice What We'll Bring: At TransUnion, we are dedicated to finding ways information can be used to help people make better and...

  • Director, Head of Data Engineering

    2 weeks ago

    Burlington, ON, Canada TransUnion Full time

    Director, Head of Data Engineering page is loaded Director, Head of Data Engineering Apply locations Burlington, Canada time type Full time posted on Posted 30+ Days Ago job requisition id 19027489 TransUnion's Job Applicant Privacy Notice At TransUnion, we are dedicated to finding ways information can be used to help people make better and smarter...

  • Director, Head of Data Engineering

    2 weeks ago

    Burlington, ON, Canada TransUnion Full time

    Director, Head of Data Engineering page is loaded Director, Head of Data Engineering Apply locations Burlington, Canada time type Full time posted on Posted 30+ Days Ago job requisition id 19027489 TransUnion's Job Applicant Privacy Notice What We'll Bring: At TransUnion, we are dedicated to finding ways information can be used to help people make...

  • Manager/Lead- Data Engineering

    2 weeks ago

    Toronto, ON, C6A, Ontario, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success.In this role, you will be responsible for leading a team of data engineers in designing,...

  • Manager/Lead- Data Engineering

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success. In this role, you will be responsible for leading a team of data engineers in designing,...

  • Manager/Lead- Data Engineering

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success. In this role, you will be responsible for leading a team of data engineers in designing,...

  • Manager/Lead- Data Engineering

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success. In this role, you will be responsible for leading a team of data engineers in designing,...

  • Manager/Lead- Data Engineering

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success.In this role, you will be responsible for leading a team of data engineers in designing,...

  • Sr/Lead Data Engineer

    7 days ago

    Toronto, ON, Canada Asset Management Industry Full time

    Good day Data Engineers ! Insight Global is looking for 6 Sr or Lead Data Engineers to join a large Asset Management company in Toronto on a full time basis. The successful candidates will be responsible for leading projects end-to-end within the Data Distribution Team or Asset Management Team . This role is heavily hands on and requires strong...

  • Sr/Lead Data Engineer

    4 weeks ago

    Toronto, ON, Canada Asset Management Industry Full time

    Good day Data Engineers ! Insight Global is looking for 6 Sr or Lead Data Engineers to join a large Asset Management company in Toronto on a full time basis. The successful candidates will be responsible for leading projects end-to-end within the Data Distribution Team or Asset Management Team . This role is heavily hands on and requires strong...

  • Lead Data Engineer

    2 weeks ago

    Toronto, ON, Canada Sunwing Vacations Group Full time

    Sunwing Vacations Group is home to North America’s largest vacation brands, comprised of the leading Canadian leisure tour operators Sunwing Vacations and WestJet Vacations, along with the growing United States based tour operator Vacation Express, together with the Group’s own travel retail businesses SellOffVacations.Under Sunwing Vacations , we are...

  • Manager, Data Engineering

    7 days ago

    Toronto, ON, Canada hireVouch Full time

    Manager of Data Engineering Location: Toronto/GTA Company Overview: Our client is a premier Data Cloud and Business Intelligence consulting company specializing in helping businesses harness the power of cloud technologies to drive data-driven decision-making and innovation. Our team of experts is dedicated to delivering cutting-edge solutions that...

  • Manager, Data Engineering

    1 week ago

    Toronto, ON, Canada DraftKings Full time

    We’re defining what it means to build and deliver the most extraordinary sports and entertainment experiences. Our global team is trailblazing new markets, developing cutting-edge products, and shaping the future of responsible gaming. Here, “impossible” isn’t part of our vocabulary. You’ll face some of the toughest but most rewarding challenges...

  • Sr/Lead Data Engineer

    2 weeks ago

    Toronto, ON, C6A, Ontario, Canada Asset Management Industry Full time

    Good day Data Engineers !Insight Global is looking for 6 Sr or Lead Data Engineers to join a large Asset Management company in Toronto on a full time basis. The successful candidates will be responsible for leading projects end-to-end within the Data Distribution Team or Asset Management Team . This role is heavily hands on and requires strong experience...

  • Lead Data Engineer BI Big Data

    2 weeks ago

    Toronto, ON, Canada Crypto Recruiters Full time

    We are actively searching for a Lead Data Engineer to join our team on a permanent basis. This role does require onsite work as you will be leading a team that is building a data product that will give insights to investors in the crypto and Web3 industry. In this role, you will be responsible for designing and building cutting-edge data analysis systems,...

  • Lead Data Engineer

    2 weeks ago

    Toronto, ON, Canada Crypto Recruiters Full time

    We are actively searching for a Lead Data Engineer to join our team on a permanent basis. This role does require onsite work as you will be leading a team that is building a data product that will give insights to investors in the crypto and Web3 industry. In this role, you will be responsible for designing and building cutting-edge data analysis systems,...

  • Lead Data Engineer

    4 days ago

    Toronto, Canada Insight Global Full time

    Must-haves - 10-12 years experience working within data engineering roles - 5-7 years experience with AWS cloud services including: EMR, MWAA, LakeFormation, Glue, DMS, QuickSight, and AWS Athena - 8+ years experience with big data technologies including: Apache Spark, Apache Hudi, Hive, Airflow, Trino, and Databricks - CICD - Terraform for sure ,...

  • Manager, Data Engineering and Platform

    7 days ago

    Toronto, ON, Canada hireVouch Full time

    Manager of Data Engineering Our client is a premier Data Cloud and Business Intelligence consulting company specializing in helping businesses harness the power of cloud technologies to drive data-driven decision-making and innovation. Our team of experts is dedicated to delivering cutting-edge solutions that empower our clients to unlock the full...

  • Lead Data Engineer

    6 days ago

    Toronto, Canada Insight Global Full time

    Must-haves - 10-12 years experience working within data engineering roles - 5-7 years experience with AWS cloud services including: EMR, MWAA, LakeFormation, Glue, DMS, QuickSight, and AWS Athena - 8+ years experience with big data technologies including: Apache Spark, Apache Hudi, Hive, Airflow, Trino, and Databricks - CICD - Terraform for sure ,...

  • Lead Data Engineer

    6 days ago

    Toronto, Canada Insight Global Full time

    Must-haves - 10-12 years experience working within data engineering roles - 5-7 years experience with AWS cloud services including: EMR, MWAA, LakeFormation, Glue, DMS, QuickSight, and AWS Athena - 8+ years experience with big data technologies including: Apache Spark, Apache Hudi, Hive, Airflow, Trino, and Databricks - CICD - Terraform for sure ,...