Databricks Platform Engineer

4 weeks ago

Toronto, Ontario, Canada Guidepoint Full time

Guidepoint is seeking a highly skilled Databricks Platform Engineer to join our Toronto-based Data/AI team. As a key member of our engineering team, you will play a crucial role in designing and implementing cloud solutions, building MLOps on cloud (Azure and Databricks), and providing infrastructure guidance on Databricks capabilities to accommodate business/technical use cases.

Key Responsibilities:

  • Design and implement cloud solutions, build MLOps on cloud (Azure and Databricks)
  • Build CI/CD pipelines orchestration using tools such as Azure DevOps
  • Proficiently use MLFlow and handle model serving and monitoring on Databricks
  • Tune Databricks for spark cluster performance and utilization optimization
  • Provide infrastructure guidance on Databricks capabilities to accommodate business/technical use cases
  • Automate and manage provisioning needs, including Databricks Cluster Policies, Unity Catalog, Secrets Management, Role-Based Access Control model, and permissions
  • Monitor and manage data and processes to control costs and optimize compute spend
  • Configure and manage monitoring/alerting around latency performance on the Databricks platform, including Delta Live Tables and Databricks Workflows and machine learning model performance
  • Coordinate and collaborate with dependent infrastructure teams and Azure services to integrate Databricks securely
  • Provide technical expertise and troubleshooting as well as support for change management, governance, compliance, internal audits, and remediations
  • Communicate with a team of data scientists, ML engineers, data engineers, and architects, and document the processes

Requirements:

  • Bachelor's Degree
  • 2+ years of relevant experience on Databricks, including performance tuning, infrastructure guidance, workflow automation and cost optimization strategies
  • Experience in cloud solutions, preferably on Azure
  • Skills in MLFlow, containerization, and deployment practices (Preferred)
  • Excellent communication and documentation skills to collaborate effectively with cross-functional teams

About Guidepoint:

Guidepoint is a leading research enablement platform designed to advance understanding and empower our clients' decision-making process. Powered by innovative technology, real-time data, and hard-to-source expertise, we help our clients to turn answers into action.

At Guidepoint, our success relies on the diversity of our employees, advisors, and client base, which allows us to create connections that offer a wealth of perspectives. We are committed to upholding policies that contribute to an equitable and welcoming environment for our community, regardless of background, identity, or experience.

  • Databricks Platform Engineer

    4 weeks ago

    Toronto, Ontario, Canada Guidepoint Full time

    Guidepoint is seeking a highly skilled Databricks Platform Engineer to join its Toronto-based Data/AI team. As a key member of the team, you will be responsible for designing and implementing cloud solutions, building MLOps on cloud (Azure and Databricks), and providing infrastructure guidance on Databricks capabilities to accommodate business/technical use...

  • Databricks Platform Engineer

    1 month ago

    Toronto, Ontario, Canada Guidepoint Full time

    Job Summary:Guidepoint is seeking an experienced Databricks Platform Engineer to join our Toronto-based Data/AI team. As a key member of our engineering team, you will design and implement cloud solutions, build MLOps on cloud (Azure and Databricks), and provide infrastructure guidance on Databricks capabilities to accommodate business/technical use...

  • International Azure Platform Specialist with Databricks and Data Factory Expertise

    3 weeks ago

    Toronto, Ontario, Canada S.i. Systèmes Full time

    About the RoleThe ideal candidate will possess extensive experience in Azure platform engineering, specifically with Databricks, Data Factory, and Purview. This individual will be responsible for collaborating with cross-functional teams to design, develop, and optimize data pipelines, architectures, and data sets. The successful candidate will also be...

  • Databricks ETL Engineering Specialist

    1 week ago

    Toronto, Ontario, Canada Paralucent Full time

    We are seeking an experienced Databricks ETL engineer to support our data warehousing, data lakes, and analytics initiatives. As a key member of our team, you will be responsible for designing, developing, and maintaining efficient ETL pipelines using Databricks and related tools.Key ResponsibilitiesDesign and implement scalable ETL processes to ingest,...

  • Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Fluent, LLC Full time

    Job DescriptionFluent, LLC is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a critical role in building the next generation of advertising networks. Your expertise in Databricks will be instrumental in executing our vision of creating a sophisticated data representation of customer journeys and marketplace...

  • Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Fluent, LLC Full time

    Job SummaryFluent, LLC is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data systems using Databricks.Key ResponsibilitiesDevelop and deploy scalable data pipelines on DatabricksDesign and implement data models and architecturesCollaborate with data...

  • Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Fluent, LLC Full time

    Job DescriptionFluent, LLC is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will play a crucial role in building and maintaining our data infrastructure, ensuring the accuracy and reliability of our data products.Key Responsibilities:Design, develop, and deploy scalable data pipelines on Databricks, ensuring robust...

  • Automation Platform Engineer

    2 weeks ago

    Toronto, Ontario, Canada Veeva Systems Full time

    Job Summary Veeva Systems is seeking an experienced Automation Platform Engineer to join our team. As a key member of our software engineering team, you will be responsible for designing, implementing, and maintaining our automation platform.Key ResponsibilitiesDesign and develop scalable automation pipelines using Java, JavaScript, and other...

  • Databricks Expert Software Engineer

    7 days ago

    Toronto, Ontario, Canada Fluent, LLC Full time

    About the RoleWe are seeking a highly skilled Databricks Expert Software Engineer to join our team at Fluent, LLC. This is an exciting opportunity to work on building data products that power our business lines.ResponsibilitiesYou will be responsible for developing, deploying, and managing scalable pipelines on Databricks, ensuring robust integration with a...

  • Databricks ETL Developer

    4 weeks ago

    Toronto, Ontario, Canada Paralucent Full time

    Job Title: Databricks ETL DeveloperJob Summary:We are seeking a skilled Databricks ETL Developer to support our data warehousing, data lakes, and analytics initiatives. As a key member of our team, you will be responsible for designing, developing, and maintaining ETL processes within Databricks to ensure efficient data transformation and movement.Key...

  • Databricks ETL Developer

    4 weeks ago

    Toronto, Ontario, Canada Paralucent Full time

    Job Title: Databricks ETL DeveloperWe are seeking a skilled Databricks ETL Developer to support our data warehousing, data lakes, and analytics initiatives. In this role, you will be responsible for developing, maintaining, and optimizing ETL processes within Databricks to ensure efficient data transformation and movement.Key Responsibilities: Design,...

  • Int. Azure Platform Engineer with Databricks, Data Factory

    3 weeks ago

    Toronto, Ontario, C6A, Ontario, Canada S.i. Systems Full time

    Int. Azure Platform Engineer with Databricks, Data Factory & Purview experience for our insurance client Duration: 6 Months (Extensions Likely)Location: Hybrid (3 days in office - Toronto or London, ON)Responsibilities: Collaborate with data engineers, data scientists, and stakeholders to understand complex data requirements.Assist in designing, developing,...

  • Data Engineering Expert

    5 days ago

    Toronto, Ontario, Canada Fluent, LLC Full time

    Fluent, LLC is revolutionizing the advertising industry with its cutting-edge technology. As a Data Engineer at Fluent, you will play a crucial role in building and operating high-impact data solutions that drive business growth.The ideal candidate will have extensive experience in software engineering, with expertise in Databricks and Spark. You will work...

  • Automation Platform Engineer

    4 weeks ago

    Toronto, Ontario, Canada Veeva Systems Full time

    The RoleAre you passionate about working as part of a software engineering team with the talent, energy, and financial backing to deliver innovative, industry-changing cloud-based applications built on a content platform? Do you live for the challenges of a dynamic, rapidly growing startup that cranks out major releases every four months?We are looking for...

  • Databricks ETL Developer Position

    4 weeks ago

    Toronto, Ontario, Canada Paralucent Full time

    Paralucent Databricks ETL Developer Job DescriptionWe are seeking a skilled Databricks ETL Developer to support our data warehousing, data lakes, and analytics initiatives. In this role, you will be responsible for developing, maintaining, and optimizing ETL processes within Databricks to efficiently transform and move data.Key Responsibilities:• Design,...

  • Senior Data Engineer

    2 weeks ago

    Toronto, Ontario, Canada Rubicon Path Full time

    As a Senior Data Engineer at Rubicon Path, you will be responsible for designing, developing, and maintaining large-scale data pipelines using Databricks and Python. Your expertise in ETL tools, such as Microsoft SSIS, and strong knowledge of Delta Lake for data management and optimization, will be crucial in ensuring the efficient transformation and...

  • Senior Data Platform Engineer

    3 weeks ago

    Toronto, Ontario, Canada OMERS Full time

    Accelerate Your CareerAt OMERS, we're seeking a highly skilled Senior Data Engineer to join our Data Platform team. We're a purpose-driven, dynamic, and sustainable pension plan, with a global presence and a commitment to innovation. Our ideal candidate will have over 8 years of experience working with data warehouses and modern data platforms, with a strong...

  • Data Engineer

    4 weeks ago

    Toronto, Ontario, Canada Foilcon Full time

    Job DescriptionFoIalcon is seeking a highly skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, developing, and implementing data ingestion frameworks from Oracle sources to Azure Data Lake, including initial load and incremental ETL. You will work with various tools such as Oracle Golden Gate, Azure Data...

  • Data Scientist with Azure and Databricks Specialization

    3 weeks ago

    Toronto, Ontario, Canada Purple Drive Full time

    Data Engineer RoleData Engineer with Pyspark Databricks skillset required.RequirementsStrong background in Azure data services including Databricks Synapse Analytics Informatica Pyspark and SQL.Ability to extract and transform data especially unstructured data across various data processing layers using Databricks Python.Coordinate independently with...

  • Azure Databricks Solutions Architect

    2 weeks ago

    Toronto, Ontario, Canada Astra North Infoteck Inc. Full time

    Azure Databricks Role OverviewAstra North Infoteck Inc. is seeking an experienced Azure Databricks Architect to help us design and implement data processing pipelines. The successful candidate will have extensive experience with Azure Data Factory, Databricks, and Pyspark based data processing.Key ResponsibilitiesDesign and implement data processing...