Senior ETL Developer

Typical Day in Role:• Involved in end-to-end ETL/ELT architectures using Talend (Studio, TAC, Data Integration, Real-Time Big Data, Data Quality).• Select integration patterns (batch, micro-batch, streaming) aligned to business SLAs and system constraints.• Establish standards for metadata management, lineage, error handling, and reusability.Hands-on Development• Build robust Talend jobs, components, mappings, and data pipelines for ingestion, transformation, cleansing, and delivery.• Develop custom Talend components and routines using Java 8/11 for advanced transformations and framework extensions.• Work with SQL for validation, transformation logic, and performance tuning.Data Quality & Validation• Implement data quality rules, profiling, exception handling, and reconciliation frameworks.• Design automated validation suites and sampling strategies for high-stakes data consumption.Performance & Reliability• Tune jobs and SQL for scale (partitioning, parallelization, pushdown optimization, caching).• Optimize schedules, dependencies, and resource utilization within TAC.• Establish SLIs/SLOs and monitor pipeline health via logs, metrics, and alerts.DevOps & Automation• Integrate Talend with Git and CI/CD tools (e.g., Jenkins, Azure DevOps) for versioning, build, test, and deployment automation.• Promote repeatable deployments across dev/test/prod with environment configs and secrets management.Migration & Modernization• Lead conversion of legacy ETL platforms to Talend, including mapping old jobs, rationalizing logic, and decommissioning.• Support cloud integration initiatives and real-time processing adoption.Collaboration & Leadership• Partner with data architects, DBAs, application teams, and business stakeholders.• Mentor developers, review code/designs, and contribute to best practices and documentation.Tools & Technologies:Talend: Studio, TAC, DI, Real-Time Big Data Platform, Data QualityDatabases: SQL Server, DB2Languages: Java 8/11, SQLStreaming/Integration: REST, Kafka; monitoring via SplunkDevOps: Git, Jenkins, Azure DevOps (pipelines, artifacts), environment configsCloud (preferred): Azure/GCP services for storage, compute, integrationCandidate Value Proposition:The successful candidate will have the opportunity to work on a key migration project and enhance their ETL development skills for a top 5 Canadian Bank.Candidate Requirements/Must Have Skills:1) 10+ years of relevant working experience in ETL development, architecture, and data integration2) 8+ years of hands-on Talend development experience: Talend Studio, Talend Administration Center (TAC), Talend Data Integration, Talend Real-Time Big Data Platform and Talend Data Quality3) 5+ years of Java (Java 8/11) for Talend customizations and job-level logic4) Strong expertise across ETL concepts, data warehousing, and integration patterns5) Hands on experience building Talend ETL/ELT jobs, components, mapping and data pipelines6) Advanced SQL for data validation transformation and performance tuning (Oracle, SQL, Server, DB2, Teradata)Nice-To-Have Skills:1) Proven ETL Migration experience, including conversion of legacy ETL platforms into Talend2) API and streaming data integration experience, including REST APIs, Kafka, Splunk3) CI/CD integration for Talend jobs (GIT, Jenkins, Azure, DevOps, etc.)4) Experience with cloud platforms and cloud integration5) Big data and real time processing6) Financial industry experienceSoft Skills Required:• Good communication skillsEducation:Bachelor’s degree in Computer Science, Engineering, or related field; equivalent experience considered.