Senior Data Engineer

1 month ago

Toronto, Canada Prodigy Labs a UST Company Full time

Data Engineer with Databricks & Spark Experience

We are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.

Responsibilities

  • Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed
  • Optimize data pipelines for performance, scalability, and reliability
  • Ensure data quality and integrity throughout the data lifecycle
  • Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs
  • Troubleshoot and resolve data-related issues, and provide root cause analysis and recommendations
  • Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management
  • Create new data validation methods and data analysis tools, and share best practices and learnings with the data engineering community
  • Implement ETL processes and data warehouse solutions, and ensure compliance with data governance and security policies

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent work experience
  • 5+ years of experience in data engineering with Databricks and Spark
  • Proficient in SQL and Python, and familiar with Java or Scala
  • Experience with cloud platforms, such as Azure or AWS
  • Experience with big data technologies, such as Kafka, Hadoop, Hive, etc.
  • Experience with data warehouse and data lake concepts and architectures
  • Experience with data integration and ETL tools, such as Azure Data Factory or Talend
  • Experience with data visualization and reporting tools, such as Power BI or Tableau
  • Strong analytical and problem-solving skills
  • Excellent communication and teamwork skills

  • Senior Data Engineer

    5 days ago

    Toronto, Ontario, Canada S I Systems Full time

    Senior Data Engineer to support cloud integration on the AML team for a large banking client Interview Process: 1 round, potentially 2 (Webex or Teams)Work Location (Remote, Hybrid or Both?): Hybrid, onsite twice a week in Toronto Description The Business Information Management Specialist provides business technical leadership across a broad range of...

  • Sr Data Engineer

    5 days ago

    Toronto, Ontario, Canada NTT DATA Services Full time

    Req ID: NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA).Data Engineer Responsibilities-Create and...

  • Sr Data Engineer

    5 days ago

    Toronto, Canada NTT DATA Services Full time

    Req ID: 276517  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr Data Engineer to join our team in Toronto, Ontario (CA-ON), Canada (CA). Data Engineer...

  • Senior Data Engineer

    1 month ago

    Toronto, ON, Canada Dawn InfoTek Inc. Full time

    Dawn InfoTek Inc. is a professional IT consulting team that partners with major financial institutions, investment firms and government sectors. We have been dedicated to delivering cutting-edge consulting services and recruiting all levels of IT positions for our clients. We are currently seeking competent individuals to fulfill the role of Data Engineer...

  • Senior Data Engineer

    1 month ago

    Old Toronto, Canada Dawn InfoTek Inc. Full time

    Dawn InfoTek Inc. is a professional IT consulting team that partners with major financial institutions, investment firms and government sectors. We have been dedicated to delivering cutting-edge consulting services and recruiting all levels of IT positions for our clients. We are currently seeking competent individuals to fulfill the role of Data Engineer to...

  • Senior Data Engineer

    1 month ago

    Old Toronto, Canada Dawn InfoTek Inc. Full time

    Dawn InfoTek Inc. is a professional IT consulting team that partners with major financial institutions, investment firms and government sectors. We have been dedicated to delivering cutting-edge consulting services and recruiting all levels of IT positions for our clients. We are currently seeking competent individuals to fulfill the role of Data Engineer to...

  • Senior Data Engineer

    1 month ago

    Old Toronto, Canada Dawn InfoTek Inc. Full time

    Dawn InfoTek Inc. is a professional IT consulting team that partners with major financial institutions, investment firms and government sectors. We have been dedicated to delivering cutting-edge consulting services and recruiting all levels of IT positions for our clients. We are currently seeking competent individuals to fulfill the role of Data Engineer to...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Tiger Analytics Full time

    Tiger Analytics is a fast-growing advanced analytics consulting firm. Our consultants bring deep expertise in Data Science, Machine Learning and AI. We are the trusted analytics partner for several Fortune 100 companies, enabling them to generate business value from data. Our business value and leadership has been recognized by various market research firms,...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada Movable Ink Full time

    Movable Ink scales content personalization for marketers through data-activated content generation and AI decisioning. The world’s most innovative brands rely on Movable Ink to maximize revenue, simplify workflow and boost marketing agility. Headquartered in New York City with close to 600 employees, Movable Ink serves its global client base with...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada Hard Rock Digital Full time

    What are we building?Hard Rock Digital is a team focused on becoming the best online sportsbook, casino, and social casino company in the world. We’re building a team that resonates passion for learning, operating, and building new products and technologies for millions of consumers. We care about each customer's interaction, experience, behaviour, and...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada Hard Rock Digital Full time

    What are we building?Hard Rock Digital is a team focused on becoming the best online sportsbook, casino, and social casino company in the world. We’re building a team that resonates passion for learning, operating, and building new products and technologies for millions of consumers. We care about each customer's interaction, experience, behaviour, and...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada Hard Rock Digital Full time

    What are we building? Hard Rock Digital is a team focused on becoming the best online sportsbook, casino, and social casino company in the world. We’re building a team that resonates passion for learning, operating, and building new products and technologies for millions of consumers. We care about each customer's interaction, experience, behaviour, and...

  • Senior Data Engineer

    1 week ago

    Toronto, ON, Canada Hard Rock Digital Full time

    What are we building?Hard Rock Digital is a team focused on becoming the best online sportsbook, casino, and social casino company in the world. We’re building a team that resonates passion for learning, operating, and building new products and technologies for millions of consumers. We care about each customer's interaction, experience, behaviour, and...

  • Senior Data Engineer

    1 week ago

    Toronto, ON, Canada Hard Rock Digital Full time

    What are we building?Hard Rock Digital is a team focused on becoming the best online sportsbook, casino, and social casino company in the world. We’re building a team that resonates passion for learning, operating, and building new products and technologies for millions of consumers. We care about each customer's interaction, experience, behaviour, and...

  • Data Engineer

    1 month ago

    Toronto, Canada Bitstrapped Full time

    We are looking for a hands-on Senior Data Engineer in a full-time salaried position. The Data Engineer will work with our Data Services Practice and work alongside our talented cloud architects to play a key role in our delivery teams. The Data Engineer will be involved in the design, programming,

  • Senior Software Engineer, Data Analytics

    1 week ago

    Old Toronto, Canada VTS Full time

    Senior Software Engineer, Data Analytics Apply Now Senior Software Engineer, Data Analytics at VTS Toronto, Ontario, Canada We are seeking a highly skilled and motivated engineer to join the Data Science & Analytics Engineering (DSAE) team within the Platform organization. The DSAE team owns al

  • Senior Data Engineer

    1 week ago

    Toronto, Canada Lorven Technologies Full time

    Job Title: Senior Data Engineer Job Location: Toronto, ON, Canada (visiting the office 3-4 days per week) Job Type: Contract 12+ Months If you share a passion for performance, value a collegial and collaborative culture, and approach everything with the highest integrity, here's an opportunity. Required Experince:  Must have overall 8+...

  • Data Science Specialist, Investments

    5 days ago

    Toronto, Canada Amica Senior Lifestyles Full time

    Job Description: **About Us** Amica Senior Lifestyles is setting a new standard for senior living in Canada by combining unparalleled premium hospitality and amenities with expert care and support to deliver a personalized senior living experience. Committed to enriching the lives of seniors now and as their needs change, Amica offers Independent Living...

  • Senior Risk Data Engineer/ Risk Data Scientist

    4 days ago

    toronto, Canada Lorven Technologies Inc. Full time

    Senior Risk Data Engineer/ Risk Data Scientist Location: Toronto Job Type: Contract Job Description: • Experience working on projects (Agile methodologies) related to pricing/risk and Market and Credit/Counterparty data for Risk engines • Relevant Risk experience: Modeling of different produc

  • Senior Data Engineer

    1 week ago

    Toronto, Canada Resonaite Full time

    Our client in the financial services sector is looking for a Senior Data Engineer with expertise in ETL and PowerBI dashboards.Location: 1d - 2d/week in Toronto officeDuration: 6 months w/ extension optionResponsibilitiesDesign and develop reports and analytical dashboards in Power BIContribute to designing and implementation of data architecture and...