Senior Data Engineer

1 month ago


Canada, CA Kainos Group plc Full time
Main Purpose of the Role & Responsibilities in the Business:

As a Senior Data Engineer (Senior Associate) at Kainos, you will be responsible for designing and developing data processing and data persistence software components for solutions that handle data at scale. Working in agile teams, Senior Data Engineers provide strong development leadership and take responsibility for significant technical components of data systems. You will work within a multi-skilled agile team to design and develop large-scale data processing software to meet user needs in demanding production environments.

Your responsibilities will include:

  1. Working to develop data processing software primarily for deployment in Big Data technologies. The role encompasses the full software lifecycle including design, code, test, and defect resolution.
  2. Working with Architects and Lead Engineers to ensure the software supports non-functional needs.
  3. Collaborating with colleagues to resolve implementation challenges and ensure code quality and maintainability remains high. Leads by example in code quality.
  4. Working with operations teams to ensure operational readiness.
  5. Advising customers and managers on the estimated effort and technical implications of user stories and user journeys.
  6. Coaching and mentoring team members.
Minimum (Essential) Requirements:
  • Strong software development experience in one of Java, Scala, or Python.
  • Software development experience with data-processing platforms from vendors such as AWS, Azure, GCP, Databricks.
  • Experience of developing substantial components for large-scale data processing solutions and deploying into a production environment.
  • Proficient in SQL and SQL extensions for analytical queries.
  • Solid understanding of ETL/ELT data processing pipelines and design patterns.
  • Aware of key features and pitfalls of distributed data processing frameworks, data stores, and data serialization formats.
  • Able to write quality, testable code and has experience of automated testing.
  • Experience with Continuous Integration and Continuous Deployment techniques.
Desirable Requirements:
  • Experience of performance tuning.
  • Experience of data visualization and complex data transformations.
  • Experience with streaming and event-processing architectures including technologies such as Kafka and change-data-capture (CDC) products.
  • Expertise in continuous improvement and sharing input on data best practice.

So what are you waiting for? Let’s write the next incredible chapter of our story together.

At Kainos, we believe in the power of diversity, equity, and inclusion. We are committed to building a team that is as diverse as the world we live in, where everyone is valued, respected, and given an equal chance to thrive. We actively seek out talented people from all backgrounds, regardless of age, race, ethnicity, gender, sexual orientation, religion, disability, or any other characteristic that makes them who they are. We also believe every candidate deserves a level playing field. Our friendly talent acquisition team is here to support you every step of the way, so if you require any accommodations or adjustments, we encourage you to reach out. We understand that everyone's journey is different, and by having a private conversation we can ensure that our recruitment process is tailored to your needs.

About Us

At Kainos we use technology to solve real problems for our customers, overcome big challenges for businesses, and make people’s lives easier. We build strong relationships with our customers and go beyond to change the way they work today and the impact they have tomorrow.

Our two specialist practices, Digital Services and Workday, work globally for clients across healthcare, commercial and the public sector to make the world a little bit better, day by day.

Our people love the exciting work, the cutting-edge technologies, and the benefits we offer. That’s why we’ve been ranked in the Sunday Times Top 100 Best Companies on numerous occasions.

#J-18808-Ljbffr

  • Canada, CA Wavicle Data Solutions Full time

    About the Role We are looking for a highly skilled Data Engineering Architect with strong Talend implementation experience to serve as the lead Solution/Technical Architect and Subject Matter Expert for customer experience data solutions across multiple data sources. The ideal candidate will collaborate with the Enterprise Architect and the client IT team to...

  • Senior Data Engineer

    1 month ago


    Canada, CA Collage HR Full time

    Product & Technology Full Time Montreal, QC Our platform is designed to capture the real-world performance of go-to-market teams, offering a clear picture of their success and challenges. That's why we're seeking an exceptional Senior Data Engineer to join our team and contribute to this vital mission.***Welcome to Vasco, a science-driven revenue...

  • Senior Data Engineer

    2 weeks ago


    Canada, CA GemTek Full time

    Senior Data Engineer/ArchitectOur marquee client seeks a highly skilled Senior Data Engineer/Architect for a permanent, full-time role.As a Senior Data Engineer/Architect you will lead the charge in building our client's next-generation data platform. This role is perfect for someone who thrives in a hands-on environment but also possesses a strong...

  • Data Engineer

    1 month ago


    Canada, CA Data Spree GmbH Full time

    The role at KUBRA is focused on designing, building, and maintaining data infrastructure and ETL processes to support data analytics within the organization. The Data Engineer will work on AWS and Databricks to optimize data pipelines and frameworks using Python/Pyspark, manage SQL Server and AWS data infrastructure, and assist in migrating on-premise data...

  • Senior Data Engineer

    1 month ago


    Canada, CA Nomadgao Full time

    May 15, 2024 - Coconut Software is hiring a remote Senior Data Engineer. Salary: competitive salaries - we pay fairly based on experience and expertise, not your ability to negotiate!. Location: Canada.The Senior Data Engineer at Coconut Software will act as a technical lead for projects by designing, developing, and maintaining infrastructure that delivers...

  • Senior Data Engineer

    1 month ago


    Canada, CA Scotiabank Full time

    Requisition ID: #Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture.As Senior Data Engineer, you will be a key member of our Fraud Business Intelligence team that provides fact based operational insights to Tangerine Fraud Operations. Leveraging your expertise in data modeling, data engineering, data...

  • Senior Data Engineer

    1 month ago


    Canada, CA Konnectway Full time

    KonnectWay, a rapidly expanding software development company with its heart in Ireland, is seeking highly experienced and innovative Senior Data Engineer located in Canada. We offer an exciting opportunity to engage in data engineering with a focus on data exploration within the Google Cloud Platform (GCP).If you're passionate about data engineering and...

  • Senior Data Engineer

    1 month ago


    Canada, CA Mattamy Homes Full time

    Location:Mississauga, Ontario – Hybrid (2 days/week in office)Company:Mattamy Asset ManagementDepartment:IT Enterprise Services Department, GTA Lowrise DivisionEmployment Type:Full-TimeReports to:Director, Platform EngineeringAt Mattamy Asset Management (MAM), everyone has an important role to play in our shared success. Developing thoughtfully planned...

  • Data Engineer

    4 weeks ago


    Canada, CA Epsilon Solutions Ltd. Full time

    Join to apply for the Data Engineer role at Epsilon Solutions Ltd.Data Engineer Remote (need to work in Pacific time)Role: Data EngineerPrimary: Strong in Spark core, Spark Batch, Yarn, Ambari cluster configuration, Data modelling, Hadoop, SQL, Scala.Secondary: Azure security, Azure authentication, Azure data stack, Redis, Service Bus.Seniority levelEntry...

  • Senior Data Engineer

    3 weeks ago


    Canada, CA Mattamy Homes Full time

    Location: Mississauga, Ontario – Hybrid (2 days/week in office)Company: Mattamy Asset ManagementDepartment: IT Enterprise Services Department, GTA Lowrise DivisionEmployment Type: Full-TimeReports to: Director, Platform EngineeringAt Mattamy Asset Management (MAM), everyone has an important role to play in our shared success. Developing thoughtfully...

  • Data Engineer

    1 month ago


    Canada, CA Elastify Full time

    Data Engineer at QuantumBricksWe are seeking a Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and maintaining ELT pipelines, as well as creating and managing data solutions in an AWS environment.ResponsibilitiesDesign, develop, and maintain ELT pipelines using Python, Airflow, and SQL in an AWS...

  • Azure Data Engineer

    3 weeks ago


    Canada, CA HCLTech Full time

    Location: Remote (Anywhere in Canada, needs to work in Pacific time zone)Qualification:Bachelor's degree in computer science, Engineering, or a related field.Proven experience as a Data Engineer or similar role.Strong proficiency in Azure Data Factory and other Azure services such as Azure SQL Database, Azure Databricks, and Azure Synapse...

  • Senior Data Engineer

    1 month ago


    Canada, CA Replicant, Inc Full time

    Replicant was founded on the belief that machines are ready to have useful, complex conversations that will transform the way they interact with the world, starting with customer service. As the leader in Contact Center Automation, Replicant helps companies automate their most common customer service calls while empowering agents to focus on more complex and...

  • Azure Data Engineer

    1 month ago


    Canada, CA Avanade Spain SL Full time

    Cities: Calgary, Halifax, Ottawa, TorontoIntroduction:Join our Data Engineering team and create cutting-edge solutions within Avanade’s Business Intelligence practice. We’re seeking ambitious technologists passionate about Microsoft cloud technology. Early access to the newest Microsoft technologies ensures you stay ahead of the curve.As a member of the...

  • Data Associate

    4 weeks ago


    Canada, CA DATA MART Consulting GmbH Full time

    The Data Associate role at Nomic involves operating and improving data pipelines and infrastructure for analyzing nELISA data at scale. The role requires strong fundamentals in data science, data engineering, and software development, with a focus on extracting insights from proteomic data. Familiarity with biotechnology tools such as sequencing,...

  • Senior Data Engineer

    1 month ago


    Canada, CA LifeHouse Full time

    Our Company Life House is a venture-backed, vertically integrated hotel brand, operator and technology company. We develop, design, and operate boutique lifestyle hotels with a mission to make travel more meaningful and reliable for travelers, and to make hotels more seamless and more profitable for owners. We recently raised our Series C and we are looking...


  • Canada, CA Crypto Directories Full time

    The engineering team at Chainalysis is inspired by solving the hardest technical challenges and creating products that build trust in cryptocurrencies. We’re a global organization with teams in Denmark, UK, Canada, and the USA who thrive on the challenging work we do and doing it with other exceptionally talented teammates. Our industry changes every day...


  • Canada, CA Goodhue Senior Living Full time

    About the company:Consensys is a leading company in the blockchain technology industry, with a strong focus on making Web3 accessible to all. They are committed to creating a more just and equitable society through the power of blockchain.About the role:As a Senior Full Stack Engineer at Consensys, you will be responsible for managing development tasks and...

  • Senior Data Scientist

    4 weeks ago


    Canada, CA Ayata Full time

    We are looking for proven talent to build scalable and actionable AI for two of the largest industries on this planet.Senior Data ScientistJob Title:Senior Data ScientistReports to:VP of Engineering DeliveryLocation:US/Canada/Australia/IndiaSalary Range:Based on exp. and knowledgeClient/Project:In-houseOpenings:1Travel Required:10%+Position...

  • Senior Data Scientist

    4 weeks ago


    Canada, CA Ayata Full time

    We are looking for proven talent to build scalable and actionable AI for two of the largest industries on this planet.Senior Data ScientistJob Title:Senior Data ScientistReports to:VP of Engineering DeliveryLocation:US/Canada/Australia/IndiaSalary Range:Based on exp. and knowledgeClient/Project:In-houseOpenings:1Travel Required:10%+Position...