Senior Data Engineer

1 day ago

Toronto, Ontario, Canada Rubicon Path Full time

**Job Summary:**

We are seeking a highly skilled Senior Data Engineer with expertise in designing, developing, and implementing large-scale data pipelines using Databricks and related tools. As an ETL Specialist at Rubicon Path, you will play a critical role in ingesting, transforming, and storing large-scale datasets for our business.

Key Responsibilities:

  • Design and Develop ETL Pipelines: Design, develop, and implement ETL pipelines using Databricks and related tools to ingest, transform, and store large-scale datasets.
  • Data Ingestion and Transformation: Develop high-quality ETL mappings/scripts/notebooks to process structured and unstructured data using Azure Databricks, Delta Lake, and Spark.
  • Data Governance and Security: Implement security policies, access control, and auditing using Unity Catalog to ensure compliance and data governance best practices.
  • Cluster Management and Monitoring: Manage clusters, jobs, autoscaling, monitoring, and performance optimization in Databricks environments to ensure efficient data processing.
  • CDC Tools and Streaming Data: Work with CDC tools like GoldenGate or Debezium for processing incremental updates and managing real-time data ingestion using Structured Streaming and readStream.

Requirements:

  • 7+ Years of Experience: 7+ years of experience working with SQL Server, T-SQL, Oracle, PL/SQL development or similar relational databases.
  • Databricks Expertise: Strong knowledge of Databricks, Delta Lake, and PySpark for designing, developing, and implementing ETL pipelines.
  • Python and PySpark: 2+ years of experience with Python and PySpark for data manipulation and transformation.
  • Medallion Architecture: Solid understanding of the Medallion Architecture (Bronze, Silver, Gold) and experience implementing it in production environments.
  • CDC Tools: Hands-on experience with CDC tools like GoldenGate for managing real-time data.
  • SQL Server and Oracle: Experience working with SQL Server, Oracle, and related tools.

Preferred Qualifications:

  • Databricks Certification: Certified in one or more of the following certifications: Databricks Certified Data Engineer Associate, Databricks Certified Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate.
  • Azure Data Factory: Experience integrating Databricks with cloud storage solutions like Azure Blob Storage.
  • Data Governance Best Practices: Knowledge of implementing security policies, access control, and auditing using Unity Catalog.

Salary Range: $120,000 - $180,000 per year.

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Cititec Talent Full time

    Cititec Talent is a leading talent solutions provider in the financial services sector, with a strong focus on delivering exceptional candidates to our clients.We are currently seeking a highly skilled Senior Data Engineer to join our team and help us drive innovation in data pipeline development.The ideal candidate will have a proven track record of...

  • Senior Data Engineer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Finance Professionals Inc. Full time

    Senior Data Engineer Job Description Location: Hybrid, 3 days onsite – Downtown, Toronto Duration: 1 year (Extension - Yes depending on performance (looking for a long-term person)What you will do:• Work with business stakeholders and cross-functional teams to understand data requirements and deliver scalable data solutions. • Design, develop, and...

  • Senior Data Engineering Specialist

    3 weeks ago

    Toronto, Ontario, Canada Jarvis Consulting Group Full time

    Job DescriptionAbout This Role:We are seeking a highly skilled Senior Data Engineering Specialist to join our team at Jarvis Consulting Group. As a key member of our data engineering team, you will play a critical role in developing and maintaining complex data pipelines to drive business growth.The ideal candidate will have a strong background in data...

  • Senior Cloud Data Engineering Expert

    3 weeks ago

    Toronto, Ontario, Canada Q1 Technologies, Inc. Full time

    Job Summary: We are seeking a skilled Data Engineer to join our team at Q1 Technologies, Inc. This is an exciting opportunity to work on cutting-edge data engineering projects using AWS technologies. As a Senior Cloud Data Engineering Expert, you will be responsible for designing and implementing scalable data architectures, developing efficient data...

  • Senior Data Engineer for Cloud Migration and Data Fabric

    3 weeks ago

    Toronto, Ontario, Canada S.i. Systèmes Full time

    Key Responsibilities:- Design and implement data solutions for Our Banking's digital transformation.Must-Have Qualifications:- 5+ years of experience as a Data Engineer in the Financial/Banking sector with expertise in Azure, DataBricks, and Data Fabric technologies.- Proven skills in SQL development, including T-SQL and SSIS, with experience in data...

  • Senior Data Engineer for Financial Services

    3 weeks ago

    Toronto, Ontario, Canada Cititec Talent Full time

    Cititec Talent is seeking a skilled Senior Data Engineer to join their financial services team. This role offers the opportunity to work on impactful data infrastructure projects in a collaborative, front-office environment.Job DescriptionWe are looking for an experienced Data Engineer to design, develop, and maintain ETL pipelines that support various...

  • Senior Data Engineer Opportunity in Toronto

    2 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Unlock your potential as a Senior Data Engineer at Royal Bank of Canada (RBC) in our dynamic TECHNOLOGY AND OPERATIONS platform. We are seeking a skilled professional to lead data transformations, modernize legacy code using Large Language Model tools, and drive business-sponsored programs like Compliance and Regulatory.About the RoleWe thrive on challenges,...

  • Senior Cloud Data Engineering Lead

    4 weeks ago

    Toronto, Ontario, Canada Scotiabank Full time

    Job OverviewWe are seeking an experienced Senior Cloud Data Engineering Lead to join our team at Scotiabank in Toronto, Canada.Salary: $175,000 - $225,000 per yearAbout the RoleThis is a leadership position that requires strong technical expertise and business acumen. As a Senior Cloud Data Engineering Lead, you will be responsible for designing, building,...

  • Senior Data Engineering Specialist

    3 weeks ago

    Toronto, Ontario, Canada Myticas Consulting Full time

    Job Description:We are seeking a highly skilled Senior Data Engineering Specialist to join our team at Myticas Consulting. In this role, you will play a key part in developing and implementing data integration strategies, building data pipelines, performing data modeling, ensuring data governance, and planning scalable solutions.About the Role:You will...

  • Data Engineering Senior Manager

    1 week ago

    Toronto, Ontario, C6A, Ontario, Canada OANDA Full time

    Everyone at OANDA is focused on our vision to transform how our customers can meet all their currency needs. We are revolutionising the world of currency trading by providing innovative trading experiences, currency data and analytics solutions. Dare to be open, bold, focused - own it and apply! The future is now!Join us and:Be the team lead for a group of...

  • Senior Data Software Engineer

    4 weeks ago

    Toronto, Ontario, Ontario, Canada Delpath Full time

    Senior Data software EngineerLocation Address: Hybrid at Toronto (1/week)*Can be a remote role with strong candidates are not available in GTA but has to be in Canada and available in EST time zone*Contract Duration: 6 monthsExtension: Yes - subject to work demand.• Business group: Markets & enterprise technology - We are part of the Cross-Asset...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    About the OpportunityRoyal Bank of Canada is seeking an experienced Senior Data Engineer to join our Financial Crime Technologies team in Toronto. This is a full-time position with a salary of approximately $145,000 per year.Job DescriptionWe are looking for a skilled data engineer to lead the development of high-performing applications built on cloud...

  • Senior Data Center Engineer

    3 weeks ago

    Toronto, Ontario, Canada Amazon Full time

    We are seeking a highly skilled and experienced Senior Data Center Engineer to join our team at Amazon Web Services (AWS). As a key member of our cloud infrastructure team, you will be responsible for designing, engineering, and operating high-performance data centers that support our customers' growing demands for cloud computing and networking services.The...

  • Senior Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada DML Capital Group Incorporated Full time

    Job DescriptionWe are seeking a highly motivated and skilled Senior Data Engineer to join our team at DML Capital Group Incorporated. As a key member of our engineering department, you will be responsible for designing, developing, and maintaining ETL systems using Python.

  • Data Engineer with Cloud Expertise

    2 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    About the RoleWe are seeking a highly skilled Senior Data Platform Engineer to join our dynamic Data & Analytics team at Royal Bank of Canada. As a key member of our data engineering team, you will play a crucial role in designing, implementing, and maintaining robust data infrastructure to support our organization's data needs and advance our capabilities...

  • Senior Data Engineer, Cloud Solutions Expert

    2 weeks ago

    Toronto, Ontario, Canada Royal Bank of Canada Full time

    Job OverviewRoyal Bank of Canada is seeking an experienced Senior Data Engineer to join our team. As a key member of our technology division, you will play a crucial role in developing and implementing cutting-edge data solutions.

  • Senior Cloud Data Engineer

    3 weeks ago

    Toronto, Ontario, Canada CorGTA Full time

    About the RoleCorGTA is seeking a highly skilled Senior Cloud Data Engineer to work on a 6-month contract basis, with potential extension options. The ideal candidate will have extensive experience in cloud data engineering and be proficient in working with Python, DBT, Big Query, and GCP.

  • Senior Data Science Engineer

    3 weeks ago

    Toronto, Ontario, Canada Randstad Digital Full time

    Job Title: Senior Data Science Engineer - Portfolio Risk About the Role:We are seeking a highly skilled Senior Data Science Engineer - Portfolio Risk to join our team at Randstad Digital. In this role, you will be responsible for designing and developing high-performance analytical solutions using Python to drive business growth. Key...

  • Senior Data Engineer

    3 weeks ago

    Greater Toronto Area, Canada, Ontario Altis Labs Full time

    About the jobAbout Altis LabsAltis Labs is the computational imaging company accelerating clinical trials with AI. We are on a mission to help get the most effective novel treatments to patients sooner. Simplistic imaging interpretation methods like RECIST 1.1 are known to often over- and underestimate efficacy in clinical trials, resulting in failure-prone...

  • Data Engineering Leader

    1 week ago

    Toronto, Ontario, Canada Wirehead Full time

    Job SummaryWe are seeking a highly skilled Senior Data Engineer to join our team at Wirehead. This is a contract position with a salary of $100.00 per hour and a duration of 6 months, with an option for extension.