See more Collapse

Senior Data Engineer(Databricks)

3 months ago

Toronto, Canada Prodigy Labs Full time

Data Engineer with Databricks & Spark Experience

We are looking for a data engineer who has strong experience in building scalable and reliable data pipelines using Databricks and Spark. You will be working with various data sources and formats, and transforming them into valuable insights for our business.

Responsibilities

  • Design, develop, and maintain data pipelines using Databricks and Spark, and other cloud technologies as needed
  • Optimize data pipelines for performance, scalability, and reliability
  • Ensure data quality and integrity throughout the data lifecycle
  • Collaborate with data scientists, analysts, and other stakeholders to understand and meet their data needs
  • Troubleshoot and resolve data-related issues, and provide root cause analysis and recommendations
  • Document data pipeline specifications, requirements, and enhancements, and communicate them effectively to the team and management
  • Create new data validation methods and data analysis tools, and share best practices and learnings with the data engineering community
  • Implement ETL processes and data warehouse solutions, and ensure compliance with data governance and security policies

Please Note: This is a hybrid position and will require at least 2 days in the office per week. Successful candidates will need to complete a background check.

Requirements

Qualifications

  • Bachelor’s degree in Computer Science, Engineering, or related field, or equivalent work experience
  • 5+ years of experience in data engineering with Databricks and Spark
  • Proficient in SQL and Python, and familiar with Java or Scala
  • Experience with cloud platforms, such as Azure or AWS
  • Experience with big data technologies, such as Kafka, Hadoop, Hive, etc.
  • Experience with data warehouse and data lake concepts and architectures
  • Experience with data integration and ETL tools, such as Azure Data Factory or Talend
  • Experience with data visualization and reporting tools, such as Power BI or Tableau
  • Strong analytical and problem-solving skills
  • Excellent communication and teamwork skills

Benefits

Benefits

  • We are a collective group of people and collaboration is key to our process
  • We don’t work for our clients, we work with them
  • A Flexible Hybrid Working Environment
  • Easily accessible downtown location
  • Competitive compensation commensurate with experience
  • Everyone brings something valuable to the table in our supportive, challenging, and collaborative, diverse work environment

All Employees Can Participate in:

  • Company paid health benefits: 100% medical, dental and vision coverage
  • Corporate-discounted Gym Membership through GoodLife
  • Company discount program including Travel, Shopping, Attractions, Wellness, & Sporting events, just to name a few
  • Access to an Employee & Family Assistance program (EAP)
  • Employee Referral Program
  • Employee Opportunity Program
  • Professional Development Program
  • Philanthropic Events
  • Social Events



Inclusion & Diversity

We foster an inclusive and diverse workforce, believing our strength stems from our individual differences. Our employees, partners, and clients continuously benefit from the innovation and creativity grounded in these values. We strive to be a company that attracts a diverse group of highly skilled people who know that their contributions will be valued and that they will be heard. We are committed to building a corporate culture with people who are excited to join our team, do their best work, and grow with us

We have other current jobs related to this field that you can find below

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada Pacific Data Integrators Full time

    Position:Senior Data EngineerHybrid Role ROLE AND RESPONSIBILITIES1. Work closely with the Enterprise Data Engineering team to design and construct data architectures, databases, and processing systems that support big data transformation and structuring.2. Leverage deep understanding of SQL, data warehousing, ETL processes, and Python to develop large scale...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada Pacific Data Integrators Full time

    Position:Senior Data EngineerHybrid Role ROLE AND RESPONSIBILITIES1. Work closely with the Enterprise Data Engineering team to design and construct data architectures, databases, and processing systems that support big data transformation and structuring.2. Leverage deep understanding of SQL, data warehousing, ETL processes, and Python to develop large scale...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada Pacific Data Integrators Full time

    Position: Senior Data Engineer Hybrid Role ROLE AND RESPONSIBILITIES 1. Work closely with the Enterprise Data Engineering team to design and construct data architectures, databases, and processing systems that support big data transformation and structuring. 2. Leverage deep understanding of SQL, data warehousing, ETL processes, and Python to develop...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Canada Pacific Data Integrators Full time

    Position:Senior Data EngineerHybrid Role ROLE AND RESPONSIBILITIES1. Work closely with the Enterprise Data Engineering team to design and construct data architectures, databases, and processing systems that support big data transformation and structuring.2. Leverage deep understanding of SQL, data warehousing, ETL processes, and Python to develop large scale...

  • Senior Data Engineer

    2 weeks ago

    Toronto, ON, Canada Pacific Data Integrators Full time

    Position:Senior Data EngineerHybrid Role ROLE AND RESPONSIBILITIES1. Work closely with the Enterprise Data Engineering team to design and construct data architectures, databases, and processing systems that support big data transformation and structuring.2. Leverage deep understanding of SQL, data warehousing, ETL processes, and Python to develop large scale...

  • Solutions Architect

    1 month ago

    Toronto, Canada Databricks Full time

    P-225While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations in eastern CanadaAs a Solutions Architect at Databricks within the Field Engineering org you will partner with our customers to design scalable data architectures using Databricks technology and services. You have technical depth...

  • Senior Enterprise Sales Executive

    2 days ago

    Toronto, Ontario, Canada Databricks Full time

    Position Overview:As a Senior Enterprise Sales Executive at Databricks, you will leverage your extensive experience in engaging with large enterprise clients. Your expertise in driving innovation and facilitating change will be key in advancing customer visions and accelerating decision-making processes. You possess a deep understanding of our products and...

  • Solutions Architect Toronto, Ontario, Canada

    1 month ago

    Old Toronto, Canada Databricks Inc. Full time

    While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations in eastern CanadaAs a Solutions Architect at Databricks within the Field Engineering org you will partner with our customers to design scalable data architectures using Databricks technology and services. You have technical depth and...

  • Databricks Platform Engineer

    2 months ago

    Toronto, Canada Guidepoint Full time

    Overview:  Guidepoint’s Technology team thrives on problem-solving and creating happier users. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to improve our internal application architecture and create new...

  • Databricks Platform Engineer

    2 months ago

    Toronto, Canada Guidepoint Full time

    : Guidepoint’s Technology team thrives on problem-solving and creating happier users. As Guidepoint works to achieve its mission of making individuals, businesses, and the world smarter through personalized knowledge-sharing solutions, the engineering team is taking on challenges to improve our internal application architecture and create new AI-enabled...

  • Solutions Architect Montréal, Canada

    2 weeks ago

    Old Toronto, Canada Databricks Inc. Full time

    While candidates in the listed locations are encouraged for this role, we are open to remote candidates in other locations in eastern Canada.As a Solutions Architect at Databricks within the Field Engineering org, you will partner with our customers to design scalable data architectures using Databricks technology and services. You have technical depth and...

  • Start-up Account Executive

    3 months ago

    Toronto, Canada Databricks Full time

    R33 **The impact you will have**: - Present a territory plan within first 90 days - Grow Databricks usage in new and existing accounts - Exceed activity and revenue targets - Track all customer details including use case, purchase time frames, next steps, and forecasting in Salesforce - Use a solution approach to selling and creating value for customers -...

  • Startup Account Executive

    2 months ago

    Toronto, Canada Databricks Full time

    R29 **The impact you will have**: - Present a territory plan within first 90 days - Grow Databricks usage in new and existing accounts - Exceed activity and revenue targets - Track all customer details including use case, purchase time frames, next steps, and forecasting in Salesforce - Use a solution approach to selling and creating value for customers -...

  • Senior Data Engineer

    1 day ago

    Toronto, Canada Iris Software Inc. Full time

    Iris's client, the largest bank in the Canada is looking to hire Sr. Data Engineer/Databricks Engineer Please find below the job details and share your resume if interested at Job Description: Title: Sr. Data Engineer/Databricks Engineer Location: Toronto, ON (HYBRID) Duration: Long term a

  • Enterprise Account Executive

    3 months ago

    Toronto, Canada Databricks Full time

    As an Enterprise Account Executive at Databricks, you are a strategic sales professional experienced in selling into Regulated Industry accounts. You know how to sell innovation and change through customer vision expansion and can guide deals forward to compress decision cycles. You love understanding a product in depth and are passionate about communicating...

  • Named Enterprise Account Executive

    2 months ago

    Toronto, Canada Databricks Full time

    As an Enterprise Account Executive at Databricks, you are a strategic sales professional experienced in selling into Regulated Industry accounts. You know how to sell innovation and change through customer vision expansion and can guide deals forward to compress decision cycles. You love understanding a product in depth and are passionate about communicating...

  • Enterprise Account Executive

    2 months ago

    Toronto, Canada Databricks Full time

    As an Enterprise Account Executive at Databricks, you are an enterprise sales professional experienced in selling to Enterprise accounts in Eastern Canada. You know how to sell innovation and change through customer vision expansion and can guide deals forward to compress decision cycles. You love understanding a product in depth and are passionate about...

  • Strategic Account Executive for Enterprises

    3 days ago

    Toronto, Ontario, Canada Databricks Full time

    Position Overview:As a Senior Enterprise Sales Executive at Databricks, you will leverage your extensive sales expertise to engage with large-scale enterprise clients. Your ability to drive innovation and facilitate change through a deep understanding of customer needs will be crucial in advancing sales opportunities and shortening decision-making...

  • Named Enterprise Account Executive

    2 months ago

    Toronto, Canada Databricks Full time

    SLSQ225R100 As an Enterprise Account Executive at Databricks, you are a strategic sales professional experienced in selling into Regulated Industry accounts. You know how to sell innovation and change through customer vision expansion and can guide deals forward to compress decision cycles. You love understanding a product in depth and are passionate about...

  • Lead Enterprise Sales Consultant

    2 days ago

    Toronto, Ontario, Canada Databricks Full time

    Position Overview:As a Senior Enterprise Sales Executive at Databricks, you will leverage your extensive sales expertise to engage with large-scale enterprise clients. Your role involves championing innovation and facilitating transformative change by enhancing customer perspectives and accelerating decision-making processes. You possess a deep understanding...