Data Solutions Engineer

4 days ago

Canada Tredence Inc. Full time

Job Title

Databricks Architect

Job Summary

We are seeking a highly skilled Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in cloud-based data engineering, big data processing, and analytics, and a strong understanding of data architecture principles.

This role plays a pivotal part in delivering scalable, robust, and innovative data solutions that meet organizational goals.

About the Role

  • Design and develop end-to-end data architecture solutions on the Databricks platform.
  • Collaborate with stakeholders to understand business needs and translate them into technical requirements.
  • Lead the implementation of data pipelines and workflows using Databricks and other data engineering tools.
  • Optimize performance of Databricks notebooks, clusters, and jobs for efficiency and cost-effectiveness.
  • Integrate Databricks with cloud platforms (e.g., AWS, Azure, Google Cloud) and third-party tools.
  • Implement best practices for data governance, security, and compliance.
  • Drive the adoption of advanced analytics, machine learning, and AI use cases using Databricks.
  • Provide technical leadership, mentoring, and guidance to team members.
  • Monitor and troubleshoot data pipelines, ensuring high availability and reliability.
  • Stay up-to-date with the latest Databricks features and updates to recommend improvements.

Requirements

  • Bachelor's or master's degree in computer science, Data Engineering, or a related field.
  • 10+ years of experience in big data engineering, architecture, or related field.
  • Strong expertise in Databricks, Spark, and big data technologies.
  • Hands-on experience with cloud platforms (AWS, Azure, or Google Cloud).
  • Proficiency in programming languages such as Python, Scala, or Java.
  • Solid understanding of data modeling, ETL processes, and data warehousing.
  • Experience with CI/CD pipelines and DevOps practices for data engineering.
  • Knowledge of data governance, privacy, and security principles.
  • Excellent problem-solving, communication, and teamwork skills.

Desirable Skills

  • Databricks certification (e.g., Databricks Certified Professional).
  • Familiarity with machine learning frameworks and libraries (e.g., MLflow, TensorFlow, PyTorch).
  • Experience with visualization tools such as Power BI, Tableau, or Looker.
  • Knowledge of Kubernetes and containerization for big data workloads.
  • Understanding of streaming data frameworks like Kafka or AWS Kinesis.

  • Data Engineer

    2 days ago

    bc, canada | ca VeeRteq Solutions Inc. Full time

    Job Title: Data Engineer (AWS/Azure/GCP) Location: Canada Job Description: We are seeking a Data Engineer with expertise in cloud platforms (AWS, Azure, or GCP) to design, build, and optimize scalable data pipelines and architectures. The ideal candidate will have strong experience in ETL processes, data modeling, and big data technologies to support...

  • Data Engineer

    2 weeks ago

    Canada KData AI Full time

    Company DescriptionKData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. Follow us on Twitter: @KDataAI.Role DescriptionThis is a full time role for a Data Engineer....

  • Data Engineer

    1 week ago

    Canada KData AI Full time

    Company DescriptionKData AI is a leading firm in Data and AI Engineering in the cloud, dedicated to delivering exceptional results for businesses worldwide. We specialize in transforming data into actionable insights through innovative AI and engineering solutions. Follow us on Twitter: @KDataAI.Role DescriptionThis is a full time role for a Data Engineer....

  • Data Engineer

    4 days ago

    Canada Summer Full time

    Title: Data EngineerLocation: Remote CanadaAbout this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the success...

  • Data Engineer

    2 days ago

    Canada Summer Full time

    Title: Data Engineer Location: Remote Canada About this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the...

  • Data Engineer

    3 weeks ago

    Canada hireVouch Full time

    Our client is a leading data and cloud services provider that works with enterprise companies to build systems and infrastructures for them. As a Data Engineer, you'd be responsible for designing, building, and optimizing data pipelines, ensuring seamless data flow and analytics capabilities. This is a 6-month contract, with a possibility of extension. ...

  • Data Engineer

    5 days ago

    Canada hireVouch Full time

    Our client is a leading data and cloud services provider that works with enterprise companies to build systems and infrastructures for them. As a Data Engineer, you'd be responsible for designing, building, and optimizing data pipelines, ensuring seamless data flow and analytics capabilities. This is a 6-month contract, with a possibility of extension. ...

  • Data Engineer

    5 days ago

    Canada hireVouch Full time

    Our client is a leading data and cloud services provider that works with enterprise companies to build systems and infrastructures for them.As a Data Engineer, you'd be responsible for designing, building, and optimizing data pipelines, ensuring seamless data flow and analytics capabilities.This is a 6-month contract, with a possibility of...

  • Data Engineer

    3 weeks ago

    Canada hireVouch Full time

    Our client is a leading data and cloud services provider that works with enterprise companies to build systems and infrastructures for them. As a Data Engineer, you'd be responsible for designing, building, and optimizing data pipelines, ensuring seamless data flow and analytics capabilities. This is a 6-month contract, with a possibility of extension. ...

  • Data Engineer

    2 weeks ago

    Canada TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website.JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    4 weeks ago

    Canada TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website.JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    4 weeks ago

    Canada TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website. JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    4 weeks ago

    Canada, CA TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website.JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    3 weeks ago

    Canada TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website. JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    4 weeks ago

    Canada TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website. JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    4 weeks ago

    Canada TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website.JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    4 weeks ago

    Canada TMF Group Full time

    We never ask for payment as part of our selection process, and we always contact candidates via our corporate accounts and platforms. If you are approached for payment, this is likely to be fraudulent. Please check to see whether the role you are interested in is posted on our career website.JOB DESCRIPTION We are looking for a Data Engineer to join our...

  • Data Engineer

    4 weeks ago

    Canada Electric Mind inc. Full time

    As Data Engineer, you will provide hands-on expertise as it relates to data management, analytics, and business intelligence. This opportunity will allow you to utilize your unique blend of technical, software and cloud engineering experience.While working with teams in an Agile environment, you will be:Designing high quality data pipelines/architectures...

  • Data Engineer

    4 weeks ago

    Canada Electric Mind inc. Full time

    As Data Engineer, you will provide hands-on expertise as it relates to data management, analytics, and business intelligence. This opportunity will allow you to utilize your unique blend of technical, software and cloud engineering experience. While working with teams in an Agile environment, you will be: Designing high quality data pipelines/architectures...

  • Data Engineer

    4 weeks ago

    Canada Electric Mind inc. Full time

    As Data Engineer, you will provide hands-on expertise as it relates to data management, analytics, and business intelligence. This opportunity will allow you to utilize your unique blend of technical, software and cloud engineering experience. While working with teams in an Agile environment, you will be: Designing high quality data...