Senior Data Engineer

Our client is seeking a highly skilled Senior Data Engineer to join their team in a fully remote capacity, playing a pivotal role in advancing their data and analytics platform. In this role, you will lead the design and delivery of modern, cloud-native data engineering solutions, building both batch and real-time data pipelines that align with enterprise governance standards. You will collaborate closely with business stakeholders, IT teams, and data scientists to refine requirements and implement scalable solutions that drive faster onboarding of data, enable greater data consumption, and enhance pipeline quality through DevSecOps practices. The ideal candidate will bring deep expertise in Spark with Python or Scala, and hands-on experience with modern architectures such as Azure Data Lake Storage, Azure Databricks, Azure Synapse, and Delta Lakes. Strong knowledge of integration technologies, database modeling techniques, and streaming data platforms such as Kafka or Spark Streaming will be key to success. This is an excellent opportunity for a proven leader in Data Engineering who thrives on innovation and collaboration while modernizing enterprise data platforms.*** 12 month position ****** Fully Remote ****** Candidates must be eligible for Government of Canada Security Clearance ***Advantages•Fully remote role with excellent work-life balance.•Opportunity to lead projects using modern cloud-native data technologies.ResponsibilitiesPrimary Responsibilities•Proven design, build and implementation of batch and real-time data pipelines. Driven by automated repeatable delivery of data that aligns to enterprise data governance standards. •Experience in developing and proposing design patterns that conform to requirements. Responsible to ensure the proposed design, optimally addresses access and query patterns; data consumption and adheres to internal architecture standards. •Experienced collaboration working with various stakeholders across the business, data scientists and IT. Working closely building relationships, refining data requirements to meet various data and analytics initiatives and data consumption requirementsSpecific Project Requirements•Increase the overall speed in which data is onboarded to the Data and Analytics platform.•Building robust data pipelines to enable larger data consumption on the Data and Analytics Platform•Increase the overall quality of data pipeline development through DevSecOpsQualificationsTop Skills Required:•Programming experience in Spark using modern languages such as Python, Scala•Experience working with modern data architectures like Azure Data Lake Storage, Azure Databricks, Azure Synapse (formerly SQL Data Warehouse) and Delta Lakes•Experience leading Data Engineering principles within an organization/team.Other Skills Required:•Experience working with Integration patterns and technologies such as Azure Event Hub, Function App and C#•Knowledge and expertise of database modeling techniques: Data Vaults, Star, Snowflake, 3NF, etc.•Experience working with streaming data architecture and technologies for real-time: Spark Streaming, Kafka, Flink, Storm•Experience working with relational and non-relational database technologies: SQL Server, Oracle, Cassandra, MongoDB, CosmosDB, HBase •Experience working with source code and configuration management environments such as Azure DevOps, Git, Maven, NexusAssets:•Experience within Azure environment•Strong Python, Scala and Spark experience•Experience modernizing data platforms.•Experience with Azure Functions and C#•2 to 3 projects developing Data VaultSummaryIf you're interested in learning more please submit your résumé and one of our senior Recruiters would be happy to give you a call to discuss further.Randstad Canada is committed to fostering a workforce reflective of all peoples of Canada. As a result, we are committed to developing and implementing strategies to increase the equity, diversity and inclusion within the workplace by examining our internal policies, practices, and systems throughout the entire lifecycle of our workforce, including its recruitment, retention and advancement for all employees. In addition to our deep commitment to respecting human rights, we are dedicated to positive actions to affect change to ensure everyone has full participation in the workforce free from any barriers, systemic or otherwise, especially equity-seeking groups who are usually underrepresented in Canada's workforce, including those who identify as women or non-binary/gender non-conforming; Indigenous or Aboriginal Peoples; persons with disabilities (visible or invisible) and; members of visible minorities, racialized groups and the LGBTQ2+ community.Randstad Canada is committed to creating and maintaining an inclusive and accessible workplace for all its candidates and employees by supporting their accessibility and accommodation needs throughout the employment lifecycle. We ask that all job applications please identify any accommodation requirements by sending an email to accessibility@randstad.ca to ensure their ability to fully participate in the interview process.