Manager/Lead Data Engineer >

4 weeks ago

Old Toronto, Canada Badal Full time

About Badal.io

We are a boutique, rapidly growing, GCP (Google Cloud Platform) consulting company based out of Toronto. We work with GCP’s top customers (banking, telco, energy, retail, etc.) to help them with cloud transformation, security, analytics, ML, and data governance. Clients usually engage us to solve their most challenging business problems and help raise the bar at their organization.

Why Badal?

You get the best of both worlds. We operate like an early-stage startup with all the associated benefits (e.g., talent, growth, learning opportunities, flexibility), but get to solve enterprise-level technical challenges.

• People: We hire top-tier talent. Our team consists of ex-Googlers, YCombinator Alumni, and individuals that built software for 400M users.

• GCP is the Best Cloud: Maybe we are biased, but GCP is the most cutting-edge cloud provider, building on technologies that have been pioneered by Google: BigQuery, K8s/Anthos, Vertex AI, etc.

• Growth: We have doubled in size in the last 6 months, and are looking to double again this year.

You will

• Manage a team who works closely with backend engineers, product managers, and analysts

• Provide leadership and contribute to the definition, development, integration, test, documentation, and support across multiple platforms

• Serve as a process expert and provide architectural leadership to Jr engineers as needed

• Work closely with technical leads and client teams to fully demonstrate the benefits of GCP technology•

• Introduce clients to data architecture and analytics best practices

• Solve some of the most challenging, high-scale data, and IoT problems (banking, telco, energy, retail, etc.).

• Write high-quality and testable batch and real-time data pipelines

• Work with Data Scientists to design pipelines that improve their productivity and enable them to implement their ideas

• Support clients in troubleshooting issues in their test and/or production environments and identifying root causes and solutions

You have

• Mentoring and helping the team build technical capability

• Ability to effectively communicate data insights and negotiate options at senior management levels

• Experience in leading significant project steps and communicating progress/approach with technical/non-technical peers/clients and leaders

• GCP experience ( for junior candidates, or exceptional talent with other cloud experience, we will provide training programs)

• Experience in large-scale, secure, and high-availability solutions in a Cloud environment, such as GCP.

• Experience with one Dataflow or Spark

• Experience with orchestration frameworks such as Airflow, Kubeflow, Azkaban, etc.

• Extensive programming experience in Python, Java and/or Scala.

• Good understanding of modern data architecture

• Good understanding of GCP services such as IAM, and Google Cloud Storage buckets

• Experience with business intelligence tools like QuickSight, Looker and Data Studio

• Technical writing experience; preparing and presenting technical material to a variety of audiences.

• Experience in working in or with, Agile delivery teams.

Nice to have

• Streaming experience with Dataflow, Spark, Flink, Kafka Streams, etc

• Strong understanding of Data Governance principles and experience working with tools such as Collibra or Immuta

Type of qualities we look for (across all roles)

• Passionate about delivering high-quality commercial software products and platforms to market

• Team player. We are a small team and enjoy working with each other and our clients - we would like to keep it the same way as we grow

• Strong understanding of modern software engineering processes

• Client-focused and passionate about delivering strong business values.

• Able to communicate clearly and effectively with various audiences, including developers, clients, customers, partners, and executives.

• Flexible and willing to use the right technology for each problem in the context of timelines and business goals

• Ability to complete the job regardless of the circumstance

Our Benefits

• Flexible vacation policy.

• Three weeks of vacation, plus we are closed over the winter holidays (+ ~1 week)

• One team-building event each quarter

• Great health benefits with a $1500-$3000 HSA/WSA

• Certification opportunities. We will pay for your GCP certification as well as other relevant training and certifications

• Learning opportunities. We work across different industries, technologies and roles and will work with you to help you explore your interests.

• Blogging, open source, meetups and conference opportunities. We will provide a platform and time for you to pursue your ideas

• Our organization values action over politics, and our management team is made up of engineers who thrive on achieving tangible results.

Badal is an equal-opportunity employer committed to creating a safe, diverse and inclusive environment. We encourage qualified applicants of all backgrounds including ethnicity, religion, disability status, gender identity, sexual orientation, family status, age, nationality, and education levels to apply. If you are contacted for an interview and require accommodation during the interviewing process, please let us know.

#J-18808-Ljbffr

  • Manager/Lead- Data Engineering

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success. In this role, you will be responsible for leading a team of data engineers in designing,...

  • Manager/Lead- Data Engineering

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success. In this role, you will be responsible for leading a team of data engineers in designing,...

  • Manager/Lead- Data Engineering

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success. In this role, you will be responsible for leading a team of data engineers in designing,...

  • Manager/Lead- Data Engineering

    3 weeks ago

    Toronto, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success.In this role, you will be responsible for leading a team of data engineers in designing,...

  • Manager, Data Engineering

    7 days ago

    Old Toronto, Canada hireVouch Full time

    Manager of Data Engineering Location: Toronto/GTA Company Overview: Our client is a premier Data Cloud and Business Intelligence consulting company specializing in helping businesses harness the power of cloud technologies to drive data-driven decision-making and innovation. Our team of experts is dedicated to delivering cutting-edge solutions that empower...

  • Manager, Data Engineering

    7 days ago

    Old Toronto, Canada hireVouch Full time

    Manager of Data Engineering Location: Toronto/GTA Company Overview: Our client is a premier Data Cloud and Business Intelligence consulting company specializing in helping businesses harness the power of cloud technologies to drive data-driven decision-making and innovation. Our team of experts is dedicated to delivering cutting-edge solutions that empower...

  • Manager, Data Engineering

    7 days ago

    Old Toronto, Canada hireVouch Full time

    Manager of Data Engineering Location: Toronto/GTA Company Overview: Our client is a premier Data Cloud and Business Intelligence consulting company specializing in helping businesses harness the power of cloud technologies to drive data-driven decision-making and innovation. Our team of experts is dedicated to delivering cutting-edge solutions that empower...

  • Manager, Data Engineering

    1 week ago

    Old Toronto, Canada DraftKings Full time

    We’re defining what it means to build and deliver the most extraordinary sports and entertainment experiences. Our global team is trailblazing new markets, developing cutting-edge products, and shaping the future of responsible gaming. Here, “impossible” isn’t part of our vocabulary. You’ll face some of the toughest but most rewarding challenges of...

  • Manager, Data Engineering

    1 week ago

    Old Toronto, Canada DraftKings Full time

    We’re defining what it means to build and deliver the most extraordinary sports and entertainment experiences. Our global team is trailblazing new markets, developing cutting-edge products, and shaping the future of responsible gaming. Here, “impossible” isn’t part of our vocabulary. You’ll face some of the toughest but most rewarding challenges of...

  • Manager, Data Engineering

    1 week ago

    Old Toronto, Canada DraftKings Full time

    We’re defining what it means to build and deliver the most extraordinary sports and entertainment experiences. Our global team is trailblazing new markets, developing cutting-edge products, and shaping the future of responsible gaming. Here, “impossible” isn’t part of our vocabulary. You’ll face some of the toughest but most rewarding challenges of...

  • Manager/Lead- Data Engineering

    2 weeks ago

    Toronto, ON, C6A, Ontario, Canada hireVouch Full time

    Our client is a Toronto-based GCP consulting company that is focused on helping a variety of businesses through cloud-based solutions. They are growing their team and are looking for a passionate Data Engineering Manager/Lead to continue to guide them to success.In this role, you will be responsible for leading a team of data engineers in designing,...

  • Lead Data Engineer

    5 days ago

    Old Toronto, Canada Sun Life Financial Full time

    You are as unique as your background, experience and point of view. Here, you’ll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day,...

  • Lead Data Engineer

    5 days ago

    Old Toronto, Canada Sun Life Financial Full time

    You are as unique as your background, experience and point of view. Here, you’ll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day,...

  • Lead Data Engineer

    6 days ago

    Old Toronto, Canada Sun Life Financial Full time

    You are as unique as your background, experience and point of view. Here, you’ll be encouraged, empowered and challenged to be your best self. You'll work with dynamic colleagues - experts in their fields - who are eager to share their knowledge with you. Your leaders will inspire and help you reach your potential and soar to new heights. Every day,...

  • Lead Data Engineer

    4 days ago

    Toronto, Canada Insight Global Full time

    Must-haves - 10-12 years experience working within data engineering roles - 5-7 years experience with AWS cloud services including: EMR, MWAA, LakeFormation, Glue, DMS, QuickSight, and AWS Athena - 8+ years experience with big data technologies including: Apache Spark, Apache Hudi, Hive, Airflow, Trino, and Databricks - CICD - Terraform for sure ,...

  • Practice Manager, Data Engineering

    3 days ago

    Old Toronto, Canada Copperstone Connect Full time

    Direct message the job poster from Copperstone ConnectManaging Partner at Copperstone Connect - connecting great companies with top talent!Company DescriptionOur client is a mid-sized consulting firm located in the GTA and has focused on data and analytics, and systems integration for close to 20 years.They live and breathe data and enjoy taking on...

  • Practice Manager, Data Engineering

    3 days ago

    Old Toronto, Canada Copperstone Connect Full time

    Direct message the job poster from Copperstone ConnectManaging Partner at Copperstone Connect - connecting great companies with top talent!Company DescriptionOur client is a mid-sized consulting firm located in the GTA and has focused on data and analytics, and systems integration for close to 20 years.They live and breathe data and enjoy taking on...

  • Practice Manager, Data Engineering

    4 days ago

    Old Toronto, Canada Copperstone Connect Full time

    Direct message the job poster from Copperstone ConnectManaging Partner at Copperstone Connect - connecting great companies with top talent!Company DescriptionOur client is a mid-sized consulting firm located in the GTA and has focused on data and analytics, and systems integration for close to 20 years.They live and breathe data and enjoy taking on...

  • Lead Data Engineer

    6 days ago

    Toronto, Canada Insight Global Full time

    Must-haves - 10-12 years experience working within data engineering roles - 5-7 years experience with AWS cloud services including: EMR, MWAA, LakeFormation, Glue, DMS, QuickSight, and AWS Athena - 8+ years experience with big data technologies including: Apache Spark, Apache Hudi, Hive, Airflow, Trino, and Databricks - CICD - Terraform for sure ,...

  • Lead Data Engineer

    6 days ago

    Toronto, Canada Insight Global Full time

    Must-haves - 10-12 years experience working within data engineering roles - 5-7 years experience with AWS cloud services including: EMR, MWAA, LakeFormation, Glue, DMS, QuickSight, and AWS Athena - 8+ years experience with big data technologies including: Apache Spark, Apache Hudi, Hive, Airflow, Trino, and Databricks - CICD - Terraform for sure ,...