Data Engineering Specialist

7 days ago


Toronto, Ontario, Canada Scotiabank Full time

Overview


Data engineers at Scotiabank are responsible for designing, building, and operationalizing large-scale data systems using Google Cloud Platform (GCP) services.


About the Job


We are seeking an experienced data engineer to join our team. The successful candidate will have a minimum of 4+ years of experience as a GCP developer and 2+ years of experience in data engineering, performance optimization for large OLTP applications.


Job Description


This role involves designing, building, and operationalizing the Customer Profile Database using GCP data services such as DataProc, Dataflow, CloudSQL, BigQuery, CloudSpanner, and third-party tools like Spark, Apache Beam/composer, DBT, Cloud PubSub, Confluent Kafka, Cloud storage, Cloud Functions & Github.


The data engineer will work with senior data engineers to develop frameworks and custom code using best practices to meet demanding performance requirements.


Key Responsibilities:



  • Designing and implementing data ingestion patterns that support batch, streaming, and API interfaces on both Ingress and Egress.
  • Working with minimum supervision to design and build production data pipelines from data ingestion to consumption using GCP services, Java, Python, Scala, BigQuery, DBT, SQL, etc.
  • Experience using Cloud Dataflow with Java/Python for deploying streaming jobs in GCP as well as batch jobs using text/JSON files and writing them to BigQuery.
  • Building and managing data pipelines with a deep understanding of workflow orchestration, task scheduling, and dependency management.
  • Ability to do proof of technology using GCP technologies and work with data architects, solution architects to achieve desired results and performance.

Required Skills and Qualifications


We are looking for candidates with:



  • 2+ years of experience in data engineering, performance optimization for large OLTP applications with a minimum of 4+ years of working experience as a GCP developer.
  • Experience with primary managed data services within GCP, including DataProc, Dataflow, BigQuery/DBT, Cloud Spanner, Cloud SQL, Cloud Pub/Sub, etc.
  • Experience working with relational/NOSQL databases.
  • Experience with data streaming and technologies such as Kafka, Spark-streaming, etc.
  • Experience with Infrastructure as Code (IaC) practices and frameworks like Terraform.
  • Knowledge of Java microservices and Spring Boot.
  • Working knowledge of developing and scaling JAVA REST services using frameworks such as Spring.
  • Good communication and problem-solving skills, ability to effectively convey ideas to business and technical teams.

Benefits


We offer:



  • Diversity, Equity, Inclusion & Allyship - We strive to create an inclusive culture where every employee is empowered to reach their fullest potential, respected for who they are, and are embraced through bias-free practices and inclusive values across Scotiabank.
  • Accessibility and Workplace Accommodations - We value the unique skills and experiences each individual brings to the Bank, and are committed to creating and maintaining an inclusive and accessible environment for everyone.
  • Upskilling through online courses, cross-functional development opportunities, and tuition assistance.
  • Competitive Rewards program including bonus, flexible vacation, personal, sick days, and benefits starting on day one.
  • Community Engagement - Opportunities for community engagement & belonging with various programs such as hackathons, contests, cooking with friends, Humans of Digital, and more.

Estimated Salary: $120,000 - $180,000 per year


Location: Hybrid



  • Toronto, Ontario, Canada The Toronto-Dominion Bank (Canada) Full time

    **Key Responsibilities**We are seeking a highly skilled Data Engineering Specialist to join our team. The ideal candidate will have a strong background in data engineering, with expertise in data modeling, data quality, and data profiling.**Key Responsibilities:Design and implement data models to meet business requirementsDevelop and maintain ETL processes...

  • Senior Data Engineer

    1 month ago


    Old Toronto, Ontario, Canada Data Engineer Jobs Full time

    About This RoleWe are seeking a highly skilled Senior Data Engineer to join our Analytics Engineering team. As a key member of this team, you will be responsible for designing and building scalable data models and ETL pipelines to support business decisions.Key Responsibilities:Collaborate with data scientists to design data models and answer questions.Work...

  • Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Lyons Consulting Group Full time

    Job Title: Data Engineer - Cloud Data Warehouse SpecialistAbout the Role:We are seeking a highly skilled Data Engineer to join our team as a Cloud Data Warehouse Specialist. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems that enable our clients to make data-driven decisions.Key...


  • Toronto, Ontario, Canada Futran Tech Solutions Pvt. Ltd. Full time

    Job Title: Specialist - Data EngineeringLocation: Toronto, OntarioJob Description:We are seeking a highly skilled ETL Developer to join our team at Futran Tech Solutions Pvt. Ltd. in Toronto, Ontario. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing data integration solutions using Informatica...

  • Senior Data Engineer

    1 month ago


    Toronto, Ontario, Canada Ness Digital Engineering Full time

    Job DescriptionNess Digital Engineering is a full lifecycle digital engineering firm offering digital advisory through scaled engineering services. We combine our core competence in engineering with the latest in digital strategy and technology, seamlessly managing Digital Transformation journeys from strategy through execution to help businesses thrive in...

  • Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job Title: Data Engineer - Informatica SpecialistAstra North Infoteck Inc. is seeking a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for running data loads in PAT environments using Autosys and monitoring the load using Informatica WF Monitor.Key Responsibilities:Run data loads in PAT environments using AutosysMonitor...

  • Staff Data Engineer

    1 month ago


    Old Toronto, Ontario, Canada NTT DATA, Inc. Full time

    Job Title: Staff Data EngineerWe are seeking a highly skilled Staff Data Engineer to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing tailored data solutions to meet customer needs and use cases.Key Responsibilities:Provide thought leadership and recommend the most appropriate technologies...

  • Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Lyons Consulting Group Full time

    Job Title: Data Engineer - Cloud Data Warehouse SpecialistAbout the Role:We are seeking a highly skilled Data Engineer to join our team at Lyons Consulting Group. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems. Your primary focus will be on crafting data pipelines for a cloud data...

  • Data Engineer

    1 month ago


    Toronto, Ontario, Canada NTT DATA Services Full time

    Job Summary:We are seeking a highly skilled Staff Data Engineer with expertise in Google Cloud Platform to join our Data Intelligence team. The ideal candidate will be a growth-minded, adaptable, and collaborative individual with a strong background in designing and implementing tailored data solutions.Key Responsibilities:Provide thought leadership in...


  • Toronto, Ontario, Canada Wirehead Full time

    Wirehead is seeking an experienced Data Engineer ETL Specialist to join our team on a 4-month contract with a potential extension of up to 1 year. The successful candidate will be based in Toronto and work in a hybrid environment, commencing within 2-3 weeks.Key Responsibilities:The ideal candidate will have extensive experience working with ETL tools,...


  • Toronto, Ontario, Canada SAP Full time

    At SAP, we help the world run better.We’re looking for an experienced Cyber Platform Data Engineering Specialist to join our team. This role is perfect for someone who is passionate about information technology and wants to make a real impact.As a Cyber Platform Data Engineering Specialist, you will be responsible for helping us achieve our goal of making...

  • Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Global Pharma Tek Full time

    Job Title: Data Engineer - Business Intelligence SpecialistJob Summary: We are seeking a highly skilled Data Engineer to join our team at Global Pharma Tek. As a Data Engineer, you will be responsible for designing, developing, and maintaining large-scale data systems and architectures.Key Responsibilities:* Design and develop data models and architectures...


  • Toronto, Ontario, Canada Scotiabank Full time

    Transform Your Career with a Data-Driven Role at ScotiabankWe are seeking an experienced Data Engineer Transformation Specialist to join our team, where you will play a key role in designing and implementing scalable data solutions that drive business growth.About the Job:Design and develop high-performance data engineering solutions to support our...


  • Toronto, Ontario, Canada Randstad Full time

    Immerse Yourself in Data Access ExcellenceAt Randstad, we're building a workplace where you can thrive and grow. As a Data Access Engineering Specialist, you'll have the opportunity to design, implement, and operate processes and technologies that drive exceptional data access management solutions. Our team is dedicated to supporting and standardizing...


  • Toronto, Ontario, Canada Scotiabank Full time

    Job SummaryAs a Senior Data Analytics Engineering Specialist at Scotiabank, you will be a key member of our Data Analytics and Reporting team, responsible for developing and maintaining data engineering pipelines, business intelligence, and analytics solutions. This role requires a strong technical background in data modeling, database design, business...


  • Toronto, Ontario, Canada Crescens Inc. Full time

    About Crescens Inc.Crescens Inc. is a leading organization in the field of data engineering and architecture. We strive to provide innovative solutions for our clients and contribute to the growth of the industry.Job SummaryWe are seeking an experienced Data Architecture Specialist to join our team. The successful candidate will be responsible for designing,...

  • Data Engineer

    7 days ago


    Toronto, Ontario, Canada Guidepoint Full time

    About the Role:Guidepoint is a leading research enablement platform that empowers our clients' decision-making process with innovative technology, real-time data, and hard-to-source expertise.We are seeking an experienced Data Engineer - Advanced Analytics Specialist to join our Engineering team in Toronto, Canada. As a key member of our team, you will play...

  • Data Engineer

    4 weeks ago


    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job Description:At Astra North Infoteck Inc., we are seeking a highly skilled Data Engineer - Informatica Specialist to join our team. The ideal candidate will have experience with Informatica and Autosys, with a strong background in SQL and data loading. Key responsibilities include running data loads in PAT environments using Autosys, monitoring loads...

  • Bioprocess Engineer

    1 month ago


    Toronto, Ontario, Canada Hyde Engineering + Consulting Full time

    Job Title: Bioprocess SpecialistThe Bioprocess Specialist will play a crucial role in supporting the design phase of new production facilities, including conceptual, basis of design, and detailed design. This involves collaborating with cross-functional teams to ensure the successful execution of projects.Key Responsibilities:Design and specify cGMP...

  • Data Engineer

    7 days ago


    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Job SummaryAstra North Infoteck Inc. is seeking a highly skilled Data Engineer - MongoDB Specialist to join our team. The ideal candidate will have 8-10 years of experience in database administration and be proficient in MongoDB.Key Responsibilities:Administer and maintain large-scale MongoDB databasesDesign and implement efficient data models and querying...