Senior Data Engineer

2 months ago

Old Toronto, Canada Interac Corp. Full time

The Senior Data Engineer will be responsible for designing, developing, and supporting the implementation of high-quality and sustainable data fulfillment solutions to improve business outcomes. You’ll work with several teams to develop and maintain data pipelines to improve workflows and automate processes wherever possible.

You’ll be responsible for:

  • Designing, developing, implementing, and monitoring highly scalable processes to ingest and process high volume transactions while ensuring high performance and quality.
  • Collaborating with various teams to translate business and analytics requirements into a data fulfillment strategy including building data pipelines, data aggregations, infrastructure and tooling to support business initiatives.
  • Overseeing the design and maintenance of data pipelines and contributing to the continual enhancement of the data engineering architecture.
  • Working with other developers, engineers, data scientists, and business stakeholders to continuously explore new capabilities and technologies to drive innovation.
  • Collaborating with the team to meet performance, scalability, and reliability goals.
  • Developing standards for data processes and automating routine tasks while ensuring the timing of automatic jobs do not conflict with application processes.
  • Writing out tests and thorough documentation for processes and tooling.
  • Supporting data transformation testing and production implementation as required.
  • Adapting to working with new technologies and frameworks, sometimes headlining the investigation into their usefulness to the team.
  • Supporting the team with problem analysis and resolution.
  • Maintaining and expanding existing systems, tooling, and infrastructure.
  • Management and proactive monitoring of data flows ensuring data integrity and performance.
  • Participating in rotating on-call support.
  • Mentoring and coaching a talented team of engineers to maintain best practices in data engineering.

You bring:

  • 5+ years of hands-on experience in data or software engineering. Preferably leading teams.
  • A University degree in Computer Science Engineering or an equivalent combination of education and experience.
  • A solid foundation in data structures, distributed systems, algorithms, data modeling, data pipeline processes, data integration patterns and software design.
  • Eligibility to work for Interac Corp. in Canada in a full-time capacity.
  • Hands-on experience with implementing dimensional models in SQL as well as experience with RDBMS (Oracle), BigData (Hive, Impala) environments, Apache Spark framework (PySpark preferred).
  • A demonstration of the Agile mindset, and strong experience in problem-solving within Agile environments.
  • Excellent interpersonal and communication skills with the ability to articulate complex technical concepts to a varied audience.
  • Experience building out a scalable infrastructure to fit the needs of a growing company.
  • Experience with data warehousing, operational data stores, large-scale implementations and ETL/ELT/data streaming processing.
  • Knowledge of and proven experience with:
    • Cloud tools and services (AWS preferred)
    • Cloud-based Data Warehousing tools (AWS Redshift preferred)
    • ETL or Data Integration tools (Talend preferred)
    • Oracle PL/SQL, SQL, Python and Java
  • Exposure to Big Data technologies including development, performance tuning, and standard operational activities involved.
  • Awareness that security is one of the most critical parts in any data-related projects.
  • Experience in data ingestion and processing including Third-Party APIs
  • Experience with Github and CI/CD practices is an asset
  • Experience with testing frameworks such as Jest, pytest or equivalent.
  • Strong organization, collaboration and relationship building skills.
#J-18808-Ljbffr

  • Senior Data Engineer

    19 hours ago

    Toronto, Ontario, Canada Sage Lake Senior Living Full time $276

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Sage Lake Senior Living. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable data solutions that meet the needs of our business.Key ResponsibilitiesDesign and develop data pipelines and integrations using...

  • Senior Data Engineer

    1 day ago

    Toronto, Ontario, Canada Sage Lake Senior Living Full time $276

    About the RoleWe are seeking a highly skilled Senior Data Engineer to join our team at Sage Lake Senior Living. As a key member of our data engineering team, you will be responsible for designing, developing, and deploying scalable data solutions that meet the needs of our business.Key ResponsibilitiesDesign and develop data pipelines and integrations using...

  • Senior Blockchain Engineer

    4 days ago

    Toronto, Ontario, Canada Lawton Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Blockchain Engineer to join our team at Lawton Senior Living. As a Senior Blockchain Engineer, you will play a critical role in designing, building, and developing large-scale data systems that provide the foundational data on which all our products and services are built.Key ResponsibilitiesGain a solid...

  • Senior Blockchain Engineer

    4 days ago

    Toronto, Ontario, Canada Lawton Senior Living Full time

    About the RoleWe are seeking a highly skilled Senior Blockchain Engineer to join our team at Lawton Senior Living. As a Senior Blockchain Engineer, you will play a critical role in designing, building, and developing large-scale data systems that provide the foundational data on which all our products and services are built.Key ResponsibilitiesGain a solid...

  • Senior Data Engineer

    2 months ago

    Old Toronto, Canada Huntel Global Inc. Full time

    Title: Senior Data EngineerLocation: Toronto, ON, Canada (Hybrid)Type: Full-Time, PermanentIntroduction:Join a rock-solid organization as our client’s next Senior Data Engineer and sit at the center of projects that drives decisions. You’ll help one of Canada's most trusted organizations work on the latest project, and be rewarded with great...

  • Senior Data Engineer

    3 weeks ago

    Old Toronto, Canada Huntel Global Inc. Full time

    Title: Senior Data EngineerLocation: Toronto, ON, Canada (Hybrid)Type: Full-Time, PermanentIntroduction:Join a rock-solid organization as our client’s next Senior Data Engineer and sit at the center of projects that drive decisions. You’ll help one of Canada's most trusted organizations work on the latest project, and be rewarded with great...

  • Senior Data Engineer

    3 weeks ago

    Old Toronto, Canada Huntel Global Inc. Full time

    Title: Senior Data EngineerLocation: Toronto, ON, Canada (Hybrid)Type: Full-Time, PermanentIntroduction:Join a rock-solid organization as our client’s next Senior Data Engineer and sit at the center of projects that drive decisions. You’ll help one of Canada's most trusted organizations work on the latest project, and be rewarded with great...

  • Senior Data Engineer

    2 months ago

    Old Toronto, Canada Huntel Global Inc. Full time

    Title: Senior Data EngineerLocation: Toronto, ON, Canada (Hybrid)Type: Full-Time, PermanentIntroduction:Join a rock-solid organization as our client’s next Senior Data Engineer and sit at the center of projects that drives decisions. You’ll help one of Canada's most trusted organizations work on the latest project, and be rewarded with great...

  • Data Engineer

    2 days ago

    Toronto, Canada Pacific Data Integrators Full time

    The Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Role and Responsibilities: Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...

  • Data Engineer

    1 day ago

    Toronto, Canada Pacific Data Integrators Full time

    The Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer.Role and Responsibilities:Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...

  • Data Engineer

    3 days ago

    Toronto, Canada Pacific Data Integrators Full time

    The Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer.Role and Responsibilities:Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...

  • Senior Data Developer

    2 weeks ago

    Old Toronto, Canada Sage Lake Senior Living Full time

    Do you want to help design new ways of processing Enterprise scale data at speed, learn leading edge technologies, work on complex big-data algorithms, shape processes into a growing engineering organisation, all while helping to scale a Series D rocket ship to the next level? Then welcome to Enable What is Enable: Enable is the SaaS rebate management...

  • Senior Data Developer

    2 weeks ago

    Old Toronto, Canada Sage Lake Senior Living Full time

    Do you want to help design new ways of processing Enterprise scale data at speed, learn leading edge technologies, work on complex big-data algorithms, shape processes into a growing engineering organisation, all while helping to scale a Series D rocket ship to the next level? Then welcome to Enable What is Enable: Enable is the SaaS rebate management...

  • Data Engineer Data Analytics

    2 hours ago

    Toronto, ON, Canada Pacific Data Integrators Full time

    The Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business demands Deploying ETL/ELT...

  • Data Engineer

    22 hours ago

    Toronto, ON, Canada Pacific Data Integrators Full time

    The Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Role and Responsibilities: Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting...

  • Data Engineer

    2 hours ago

    Toronto, ON, Canada Pacific Data Integrators Full time

    The Data Engineer will support the client's OCM Self-serve platform. They will be a part of a team with Tech Lead, Business Analyst and a Data Engineer. Role and Responsibilities: Technical Operationalizing and maintaining data pipelines deployed to the Client's investment entities and cultivate a business relationship that assists in meeting business...

  • Senior Data Developer

    1 day ago

    Toronto, Ontario, Canada Sage Lake Senior Living Full time $276

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team at Sage Lake Senior Living. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data platforms and systems.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using cloud-based technologies such as...

  • Senior Data Developer

    18 hours ago

    Toronto, Ontario, Canada Sage Lake Senior Living Full time $276

    About the RoleWe are seeking a highly skilled and experienced Data Engineer to join our team at Sage Lake Senior Living. As a Data Engineer, you will play a critical role in designing, developing, and maintaining our data platforms and systems.Key ResponsibilitiesDesign and develop scalable and efficient data pipelines using cloud-based technologies such as...

  • Senior Data Engineer

    2 days ago

    Old Toronto, Ontario, Canada ProViso Staffing Full time

    Job Description**Job Title:** Senior Data Engineer**Job Summary:** We are seeking a highly skilled Senior Data Engineer to join our team at ProViso Staffing. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop data processing systems using Scala,...

  • Senior Data Engineer

    2 days ago

    Old Toronto, Ontario, Canada ProViso Staffing Full time

    Job Description**Job Title:** Senior Data Engineer**Job Summary:** We are seeking a highly skilled Senior Data Engineer to join our team at ProViso Staffing. The successful candidate will be responsible for designing, developing, and maintaining large-scale data processing systems.Key Responsibilities:Design and develop data processing systems using Scala,...