Sr. Data Engineer

2 days ago

Toronto ON, Canada GalaxE.Solutions Full time

What you will do:

  • Implement methods to improve data reliability and quality.
  • Deploy programmable, easily customizable infrastructure that embraces change and automates the deployment process to reduce risk
  • Analyze all platform level changes, monitor application impact, and provide appropriate technical solutions to resolve all issues quickly and efficiently
  • Actively manages and escalates risk and customer-impacting issues within the day-to-day role to management
  • Achieve product commitments (and influences others to do the same) by using informal leadership & highly developed communication skills and contributes to or led technology communities
  • Uses automation, system tools, open-source solutions, observability and 'security first' principles in daily work
  • Contribute to team agile ceremonies, leads demos and presentations, helps new engineers learn established norms
  • Initiate high level solution design approaches, and guides team to achieve desired key software delivery capabilities using automated, coded enterprise and observability
  • Participate in internal speaking and advocacy events
  • Support research activities to adopt new technology solutions in ways of developing new capabilities
  • to oversee and work independently on a variety of complex initiatives end-to-end (primarily on short- to medium- term issues (6-12 months) requiring specialist knowledge and/or the integration of cross-functional processes (within your own area of expertise).
  • Provide thought leadership and/or industry knowledge specific (but not limited to) your own area of expertise.
  • Provide guidance and influencing multiple teams across a broad spectrum of initiatives and functional domains.

Required:

  • 5+ years relevant experience. (HDFS/SPARK/YARN/DREMIO/KAFKA/Azure PaaS)
  • Knowledge of at least one programming language (e.G. Java, Python, R)
  • Knowledge of Databricks (Spark with Scala or Pyspark)
  • Hands-on experience with ETL/ELT processes and SQL database design
  • Proven ability to design, develop and secure data pipelines
  • Great numerical and analytical skills.
  • Experience with DevOps and CI/CD pipelines
  • Experience in IaaS Data Platform and capability enablement.
  • Compute via Spark, storage via HDFS, ADLS, orchestration via Airflow, Dremio, etc.
  • Experience in streaming data ingestion and processing using Kafka
  • Experience in PaaS offerings from Azure / GCP (ADF/Databricks, etc.)
  • Familiarity with data catalog and metadata management tools (e.G.:
    Unity Catalog, Collibra)
  • Knowledge of data modeling, data quality and governance practices
  • Must be able to lead complex projects and competing priorities with a high level of technical acumen and strong communication skills
  • Familiar with data management Access Control (Rbac / Abac).

Education

  • Undergraduate Degree or Technical Certificate.

  • Sr Gcp Data Engineer

    3 days ago

    Toronto, ON, Canada E-Solutions Full time

    Role: Sr GCP Data Engineer Location: Toronto Canada (Fully onsite) Ideal Candidate: - An undergraduate or Master’s degree in Computer Science or equivalent engineering experience - 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications - 3+...

  • Sr Gcp Data Engineer

    2 days ago

    Toronto, ON, Canada E-Solutions Full time

    Role: Sr GCP Data Engineer Location: Toronto Canada (Fully onsite) Ideal Candidate: - An undergraduate or Master’s degree in Computer Science or equivalent engineering experience - 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications - 3+...

  • Sr. Platform Engineer

    2 days ago

    Toronto, ON, Canada Tata Consultancy Services Full time

    Inclusion without Exception TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • Sr. Platform Engineer

    3 days ago

    Toronto, ON, Canada Tata Consultancy Services Full time

    Inclusion without Exception TCS is an equal opportunity employer, and embraces diversity in race, nationality, ethnicity, gender, age, physical ability, neurodiversity, and sexual orientation, to create a workforce that reflects the societies we operate in. Our continued commitment to Culture and Diversity and is reflected in our people stories across our...

  • Sr GCP Data Engineer

    4 days ago

    Toronto, Canada E-Solutions Full time

    Role: Sr GCP Data EngineerLocation: Toronto Canada (Fully onsite)Ideal Candidate:• An undergraduate or Master’s degree in Computer Science or equivalent engineering experience• 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications• 3+ years...

  • Sr GCP Data Engineer

    3 days ago

    Toronto, Canada E-Solutions Full time

    Role: Sr GCP Data EngineerLocation: Toronto Canada (Fully onsite)Ideal Candidate:• An undergraduate or Master’s degree in Computer Science or equivalent engineering experience• 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications• 3+ years...

  • Sr GCP Data Engineer

    4 days ago

    Toronto, Canada E-Solutions Full time

    Role: Sr GCP Data EngineerLocation: Toronto Canada (Fully onsite)Ideal Candidate:• An undergraduate or Master’s degree in Computer Science or equivalent engineering experience• 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications• 3+ years...

  • Sr GCP Data Engineer

    3 days ago

    Toronto, Canada E-Solutions Full time

    Role: Sr GCP Data Engineer Location: Toronto Canada (Fully onsite) Ideal Candidate: • An undergraduate or Master’s degree in Computer Science or equivalent engineering experience • 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications • 3+...

  • Data Engineer

    3 days ago

    Toronto, ON, Canada Themesoft Inc. Full time

    Role: Sr. Data Engineer Location; Toronto, ON(Hybrid) Responsibilities: Lead the design and implementation of geospatial data solutions using Azure Synapse, ensuring optimal performance and scalability. Oversee the development and maintenance of ETL processes using Azure Data Factory to ensure efficient data integration and transformation. Provide...

  • Sr GCP Data Engineer

    5 days ago

    Toronto, Ontario, C6A, Ontario, Canada E-Solutions Full time

    Role: Sr GCP Data EngineerLocation: Toronto Canada (Fully onsite)Ideal Candidate:• An undergraduate or Master’s degree in Computer Science or equivalent engineering experience• 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications• 3+ years...

  • Sr. Data Engineer

    3 days ago

    Toronto, ON, Canada GalaxE.Solutions Full time

    What you will do: Implement methods to improve data reliability and quality. Deploy programmable, easily customizable infrastructure that embraces change and automates the deployment process to reduce risk Analyze all platform level changes, monitor application impact, and provide appropriate technical solutions to resolve all issues quickly and...

  • Sr Tech Ops Engineer

    2 days ago

    Toronto, ON, Canada EQ Bank | Equitable Bank Full time

    Purpose of Job One of our goals is to fail small and learn fast. The Sr Tech Ops Engineer will focus on minimizing the impacts of production incidents while ensuring the organization learns quickly to become more resilient. The Sr. Tech Ops Engineer is accountable for tracking and managing the restoration and communication of incidents with pace. The role...

  • Sr Tech Ops Engineer

    3 days ago

    Toronto, ON, Canada EQ Bank | Equitable Bank Full time

    Purpose of Job One of our goals is to fail small and learn fast. The Sr Tech Ops Engineer will focus on minimizing the impacts of production incidents while ensuring the organization learns quickly to become more resilient. The Sr. Tech Ops Engineer is accountable for tracking and managing the restoration and communication of incidents with pace. The role...

  • Data Engineer

    4 weeks ago

    Toronto, Canada Compunnel Inc. Full time

    Hi,Good MorningHope you are doing well.Please let me know if you are interested in this position.Title: Sr. Data Engineer LeadLocation: Toronto, Ontario – Day 1 Onsite Job Description :8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any...

  • Sr. Data Engineer- Java

    3 days ago

    Toronto, ON, Canada GalaxE.Solutions Full time

    What you will do: Create and maintain optimal data pipeline architecture Implement data products curated by our Chief Data Office, as well as custom data models for fit for use. Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability. Optimize data pipelines for performance and...

  • Sr. Data Engineer- Java

    2 days ago

    Toronto, ON, Canada GalaxE.Solutions Full time

    What you will do: Create and maintain optimal data pipeline architecture Implement data products curated by our Chief Data Office, as well as custom data models for fit for use. Ensure data quality and integrity across various data sources and systems to ensure data accuracy, completeness, and reliability. Optimize data pipelines for performance and...

  • Sr. Software Engineer

    5 days ago

    Toronto, ON, Canada Apptad Inc. Full time

    Hello Connections, We are hiring for one of our Government Ministry client for the position of Sr. Software developer If you would be interested kindly share your updated resume at afjal@apptadinc.com Role : Sr. Software Developer Location : Toronto, Ontario (3 days onsite / 2 days remote ) Deliverables for Sr. Software Developer: Must haves: ...

  • Data Engineer

    1 month ago

    Toronto, Ontario, Ontario, Canada Compunnel Inc. Full time

    Hi,Good MorningHope you are doing well.Please let me know if you are interested in this position.Title: Sr. Data Engineer LeadLocation: Toronto, Ontario – Day 1 Onsite Job Description :8+ years of experience in Data Engineer with AWS, Glue, Lambda, SQL, Python, Dovps, Redshift.Must have working knowledge in designing and implementing data pipelines on any...

  • Data Architect Data Analytics

    2 days ago

    Toronto, ON, Canada Themesoft Inc. Full time

    Role: Sr. Data Engineer Location; Toronto, ON(Hybrid) Responsibilities: Lead the design and implementation of geospatial data solutions using Azure Synapse, ensuring optimal performance and scalability. Oversee the development and maintenance of ETL processes using Azure Data Factory to ensure efficient data integration and transformation. ...

  • GCP Data Engineer F/H

    3 days ago

    Toronto, ON, Canada E-Solutions Full time

    Role: Sr GCP Data Engineer Location: Toronto Canada (Fully onsite) Ideal Candidate: - An undergraduate or Master’s degree in Computer Science or equivalent engineering experience - 10+ years of professional software engineering and programming experience (Java, Python) with a focus on designing and developing complex data-intensive applications...