Sr. Data Engineer

3 weeks ago


Toronto Ontario CA, Ontario GalaxE.Solutions Full time

What you will do:

  • Implement methods to improve data reliability and quality.
  • Deploy programmable, easily customizable infrastructure that embraces change and automates the deployment process to reduce risk
  • Analyze all platform level changes, monitor application impact, and provide appropriate technical solutions to resolve all issues quickly and efficiently
  • Actively manages and escalates risk and customer-impacting issues within the day-to-day role to management
  • Achieve product commitments (and influences others to do the same) by using informal leadership & highly developed communication skills and contributes to or led technology communities
  • Uses automation, system tools, open-source solutions, observability and 'security first' principles in daily work
  • Contribute to team agile ceremonies, leads demos and presentations, helps new engineers learn established norms
  • Initiate high level solution design approaches, and guides team to achieve desired key software delivery capabilities using automated, coded enterprise and observability
  • Participate in internal speaking and advocacy events
  • Support research activities to adopt new technology solutions in ways of developing new capabilities
  • to oversee and work independently on a variety of complex initiatives end-to-end (primarily on short- to medium- term issues (6-12 months) requiring specialist knowledge and/or the integration of cross-functional processes (within your own area of expertise).
  • Provide thought leadership and/or industry knowledge specific (but not limited to) your own area of expertise.
  • Provide guidance and influencing multiple teams across a broad spectrum of initiatives and functional domains.

Required:

  • 5+ years relevant experience. (HDFS/SPARK/YARN/DREMIO/KAFKA/Azure PaaS)
  • Knowledge of at least one programming language (e.g. Java, Python, R)
  • Knowledge of Databricks (Spark with Scala or Pyspark)
  • Hands-on experience with ETL/ELT processes and SQL database design
  • Proven ability to design, develop and secure data pipelines
  • Great numerical and analytical skills.
  • Experience with DevOps and CI/CD pipelines
  • Experience in IaaS Data Platform and capability enablement.
  • Compute via Spark, storage via HDFS, ADLS, orchestration via Airflow, Dremio, etc.
  • Experience in streaming data ingestion and processing using Kafka
  • Experience in PaaS offerings from Azure / GCP (ADF/Databricks, etc.)
  • Familiarity with data catalog and metadata management tools (e.g.: Unity Catalog, Collibra)
  • Knowledge of data modeling, data quality and governance practices
  • Must be able to lead complex projects and competing priorities with a high level of technical acumen and strong communication skills
  • Familiar with data management Access Control (Rbac / Abac).

Education

  • Undergraduate Degree or Technical Certificate.


  • Sr GCP Data Engineer

    3 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada E-Solutions Full time

    Role: Sr GCP Data EngineerLocation: Toronto Canada (Fully onsite)Ideal Candidate:• An undergraduate or Master’s degree in Computer Science or equivalent engineering experience• 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications• 3+ years...

  • Sr. Cloud Engineer

    4 months ago


    Toronto, Ontario, C6A, Ontario, Canada Thermo Fisher Scientific Inc. Full time

    Work ScheduleStandard (Mon-Fri)Environmental ConditionsOfficeJob DescriptionJob Title: Sr. Cloud Engineer (IT/OT/IIoT)Are you a Cloud Engineering expert ready to take on an ambitious challenge? Thermo Fisher Scientific Inc. is looking for a Sr. Cloud Engineer to join our remote global innovative Innovation & IIoT / AI Hub team. This is a unique opportunity...

  • Data Engineer

    2 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada Personal Branding Full time

    Job Title: Sr. Data Engineer - JavaJob Location: Toronto, ON (Hybrid - 2 days/week onsite)# Positions: 2Employment Type: FTE Key Technology: Java, Big Data Job Responsibilities:Create and maintain optimal data pipeline architectureImplement data products curated by our Chief Data Office, as well as custom data models for fit for use.Ensure data quality and...

  • Sr Tech Ops Engineer

    4 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada EQ Bank | Equitable Bank Full time

    Purpose of JobOne of our goals is to fail small and learn fast. The Sr Tech Ops Engineer will focus on minimizing the impacts of production incidents while ensuring the organization learns quickly to become more resilient.The Sr. Tech Ops Engineer is accountable for tracking and managing the restoration and communication of incidents with pace. The role is...

  • Data Engineer

    2 months ago


    Toronto, Ontario, Ontario, Canada Compunnel Inc. Full time

    Hi,Good MorningHope you are doing well.Please let me know if you are interested in this position.Title: Sr. Data Engineer LeadLocation: Toronto, Ontario – Day 1 Onsite Job Description :8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any...


  • Toronto, Ontario, C6A, Ontario, Canada GalaxE.Solutions Full time

    What you will do:Create and maintain optimal data pipeline architectureImplement data products curated by our Chief Data Office, as well as custom data models for fit for use.Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability.Optimize data pipelines for performance and...

  • Lead Data Engineer

    1 month ago


    Toronto, Ontario, Ontario, Canada Cygnus Professionals Inc. Full time

    Title: Sr. Data Engineer LeadLocation: Toronto, OntarioJob Description :8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming from various...

  • Senior Data Engineer

    2 months ago


    Toronto, Ontario, Ontario, Canada Compunnel Inc. Full time

    Title: Sr. Data Engineer LeadLocation: Toronto, Ontario – Day 1 Onsite Job Description:8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any of the cloud providers (AWS is preferred). Must be able to work with large volumes of data coming...

  • Sr. Platform Engineer

    1 month ago


    Toronto, Ontario, Ontario, Canada Tata Consultancy Services Full time

    Inclusion without ExceptionTCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...


  • Toronto, Ontario, Canada GalaxEons Full time

    Company Overview:GalaxEons is a forward-thinking organization that excels in data engineering.Job Summary:We are seeking an accomplished Sr. Data Engineer to join our team and play a pivotal role in developing and implementing cutting-edge data pipelines, ensuring seamless data integration and reliability across the organization.Key Responsibilities:Design,...

  • Data Engineer

    1 day ago


    Toronto, Ontario, C6A, Ontario, Canada Finance Professionals Inc. Full time

    Location - Doowntown, TorontoHybrid - 1 day/weekDuration - 4 months (possibility of extension)Typical Day in Role:• Collaborate with stakeholders to deliver data models to address operational needs• Combine multiple data sources across all contact center platforms and applications to support advanced analytics products• Ingest massive volumes of...

  • Data Engineer

    2 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada Patch Tech Staffing Full time

    We are seeking a highly motivated and skilled Data Engineer to join our growing data team. In this role, you will play a crucial part in designing, building, and maintaining our data infrastructure and pipelines. You will be responsible for ingesting, transforming, and loading data from various sources into our data warehouse, ensuring its quality,...

  • Data Engineer

    2 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada Insight Global Full time

    6 month contract + possible extensions Hybrid 2x per week in Toronto Pay: $50-60/hr incorporated Must haves:3-5 years of experience as a Data Engineer.Strong experience with ETL development, including creating new ETLs to move information.3-5 years of Python experience Strong experience with large data sets Proven expertise in building out data pipelines...

  • Data Engineer

    3 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada Strategic Solutions Technology Staffing Inc. Full time

    Our client is a multi-strategy alternative asset manager with global expertise in private equity, venture capital, credit, and more. They are committed to delivering innovative solutions that drive value for investors and stakeholders. As part of their team, you’ll work in a dynamic and collaborative environment that emphasizes data-driven decision-making...

  • GCP Data Engineer

    3 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada Quantum World Technologies Inc. Full time

    GCP Data Engineer :Toronto,ONThe focus is on GCP Data Engineer, who has hand-on experience on data pipelines, data proc,composer, hive,bigquery,sql,python, airflow.10+ years of experience with Data Warehouse / Data Platforms5+ years of experience creating ELT data pipelines from scratch, working with structured, semi-structured, and unstructured data and...


  • Toronto, Ontario, C6A, Ontario, Canada NEXUS CONSULTING SOLUTIONS Full time

    Job Title: Data Engineering Lead - Data QualityLocation: Toronto, ON (Onsite)Position Type: Contract RoleKey ResponsibilitiesDesign and Implement Data Quality Frameworks: Adopt a proactive (and reactive), scalable data quality framework to ensure that all critical capital markets data flows meet high standards of accuracy, completeness, and...


  • Toronto, Ontario, C6A, Ontario, Canada S.i. Systems Full time

    Sr Cloud Operations Engineering Specialist to support high-transaction, globally distributed cloud infrastructure and developing infrastructure for deploying and managing SaaS solutions for our large fleet management clientLocation- Oakville (2x a week)Must Haves-Bash Scripting expertiseGCP Experience is a MUST5-8 years of experience in IT/Cloud Operations,...

  • Senior Data Engineer

    3 weeks ago


    Toronto, Ontario, C6A, Ontario, Canada Xoriant Full time

    Ideal Candidate:An undergraduate or Master’s degree in Computer Science or equivalent engineering experience6+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications3+ years of architecture and design (patterns, reliability, scalability, quality) of...

  • Data Engineer GCP

    6 days ago


    Toronto, Ontario, C6A, Ontario, Canada Finance Professionals Inc. Full time

    Description:Location Address: Toronto - hybrid – 3 days/per week in the office (Monday, Wednesday and Thursday)Contract Duration: ASAP to October 31st, 2025.Possibility of extension: Depending on performance and funding – This is a long project that will require multiple extension.Project: Wealth Data Hub. The Google Lead Data Engineer will play a key...


  • Toronto, Ontario, C6A, Ontario, Canada First Derivative Full time

    Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether...