Data Engineer

OverviewJOB DESCRIPTION Since the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.About Citco Since the 1940s, Citco has provided specialist financial services to alternative investment funds, investors, multinationals, and private clients worldwide. Our data engineering initiatives represent one of our most critical technical focus areas, driving innovation across our global operations.ResponsibilitiesAbout the Role: As a Data Engineer, you will work on Citco's enterprise‑wide Centralized Data Platform (CDP) built on Databricks, contributing to our data infrastructure, API integrations, and future AI initiatives, while collaborating with data scientists, analysts, and business stakeholders to transform raw financial data into actionable insights; you will build and maintain data pipelines on the Databricks Lakehouse Platform using agile methodologies, develop scalable ETL/ELT processes, implement data quality controls, and ensure data governance standards are met, all within our AWS cloud environment to power critical business operations with the highest standards of data security and compliance.This role offers the opportunity to work with cutting-edge technologies while solving complex data challenges in a global financial services environment. You'll be part of a team driving technical excellence and innovation within Citco's data engineering practice.Key ResponsibilitiesDesign and develop Databricks solutions leveraging Lakehouse architecture for enterprise data processing and analyticsDevelop and optimize ETL/ELT pipelinesCreate and manage structured streaming pipelines for real-time data processingConfigure and optimize Databricks clusters and Spark jobs for optimal performanceUtilize Delta Live Tables for data ingestion and transformationsApply Unity Catalog features and IAM best practices for security governance and access controlSupport infrastructure and resource management using TerraformParticipate in Agile/Scrum development process and collaborate with team membersImplement monitoring solutions for pipeline performance and data qualityContribute to code reviews and knowledge-sharing sessions QualificationsAbout You:Required Qualifications4+ years of experience in data engineering1+ years of hands-on experience with Databricks platformStrong expertise in Python and Spark programmingDemonstrable experience in using AI in developmentProven experience with AWS or other similar cloud servicesDeep understanding of data modeling and SQLExperience with Delta Lake and Lakehouse architectureStrong knowledge of ETL/ELT principles and patternsExperience with version control systems (Git)Demonstrated ability to optimize data pipelinesStrong problem-solving and analytical skillsExcellent communication and collaboration abilitiesNice To HaveFinancial services industry experienceExperience with multiple cloud providersKnowledge of AI/ML implementation patternsAPI development experienceExperience with real-time data processingData governance framework experience What Sets You ApartActive interest in emerging technologies and industry trendsExperience implementing complex data solutionsTrack record of continuous learning and skill developmentStrong technical documentation abilitiesExperience using AI tools to enhance productivityAbility to mentor junior team members Technical EnvironmentPrimary Platform: DatabricksCloud Platform: AWS (S3, Glue, Lambda)Languages: Python, SQLTools: Delta Lake, Unity Catalog, GitAdditional: Real-time processing, API integrations Salary Range: CAD $105,000 - CAD $135,000This position is not for an existing vacancy; we are building a candidate pool for future opportunities Our BenefitsYour well-being is of paramount importance to us, and central to our success. We provide a range of benefits, training and education support, and flexible working arrangements to help you achieve success in your career while balancing personal needs. Ask us about specific benefits in your location.We embrace diversity, prioritizing the hiring of people from diverse backgrounds. Our inclusive culture is a source of pride and strength, fostering innovation and mutual respect.Citco welcomes and encourages applications from people with disabilities. Accommodation is available upon request for candidates taking part in all aspects of the selection. #J-18808-Ljbffr