Senior Data Engineer

2 months ago

Toronto, Canada Prodigy Labs a UST Company Full time

Data Engineer with Databricks & Spark Experience

We are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.

Responsibilities

  • Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed
  • Optimize data pipelines for performance, scalability, and reliability
  • Ensure data quality and integrity throughout the data lifecycle
  • Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs
  • Troubleshoot and resolve data-related issues, and provide root cause analysis and recommendations
  • Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management
  • Create new data validation methods and data analysis tools, and share best practices and learnings with the data engineering community
  • Implement ETL processes and data warehouse solutions, and ensure compliance with data governance and security policies

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent work experience
  • 5+ years of experience in data engineering with Databricks and Spark
  • Proficient in SQL and Python, and familiar with Java or Scala
  • Experience with cloud platforms, such as Azure or AWS
  • Experience with big data technologies, such as Kafka, Hadoop, Hive, etc.
  • Experience with data warehouse and data lake concepts and architectures
  • Experience with data integration and ETL tools, such as Azure Data Factory or Talend
  • Experience with data visualization and reporting tools, such as Power BI or Tableau
  • Strong analytical and problem-solving skills
  • Excellent communication and teamwork skills

  • Senior Data Engineer

    1 week ago

    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 276510 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our hybrid team.Data Engineer Responsibilities- (Informatica,...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Data Engineer to join our hybrid team.Data Engineer Responsibilities- (Informatica, Snowflake,...

  • Senior Data Engineer

    1 week ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our hybrid team. Data Engineer Responsibilities- (Informatica,...

  • Senior Data Engineer

    7 days ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276510  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Senior Data Engineer to join our hybrid team. Data Engineer Responsibilities- (Informatica,...

  • Senior Data Engineer

    1 week ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Senior Data Engineer

    1 week ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Senior Data Engineer

    1 week ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Senior Data Engineer

    1 week ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a...

  • Senior Data Engineer

    1 week ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a...

  • Senior Data Engineer

    1 week ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a...

  • Senior Data Engineer

    7 days ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a...

  • Senior Data Engineer

    7 days ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a...

  • Data Engineer

    7 days ago

    Toronto, Canada NTT Data Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA). Data Engineer...

  • Data Engineer

    7 days ago

    Toronto, Canada NTT DATA Full time

    Job Description Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer...

  • Data Engineer

    7 days ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create...

  • Data Engineer

    1 week ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 284188 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create...

  • Data Engineer

    5 days ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Data Engineer

    4 days ago

    Old Toronto, Canada NTT DATA, Inc. Full time

    Press Tab to Move to Skip to Content Link Select how often (in days) to receive an alert: Create Alert Select how often (in days) to receive an alert: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada S I Systems Full time

    Senior Data Engineer to support cloud integration on the AML team for a large banking client Interview Process: 1 round, potentially 2 (Webex or Teams)Work Location (Remote, Hybrid or Both?): Hybrid, onsite twice a week in Toronto Description The Business Information Management Specialist provides business technical leadership across a broad range of...

  • Senior Data Engineer

    7 days ago

    Toronto, Ontario, Canada S I Systems Full time

    Senior Data Engineer to support cloud integration on the AML team for a large banking client Interview Process: 1 round, potentially 2 (Webex or Teams)Work Location (Remote, Hybrid or Both?): Hybrid, onsite twice a week in Toronto Description The Business Information Management Specialist provides business technical leadership across a broad range of...