Senior ETL Developer

Typical Day in Role: • Involved in end-to-end ETL/ELT architectures using Talend (Studio, TAC, Data Integration, Real-Time Big Data, Data Quality). • Select integration patterns (batch, micro-batch, streaming) aligned to business SLAs and system constraints. • Establish standards for metadata management, lineage, error handling, and reusability. Hands-on Development • Build robust Talend jobs, components, mappings, and data pipelines for ingestion, transformation, cleansing, and delivery. • Develop custom Talend components and routines using Java 8/11 for advanced transformations and framework extensions. • Work with SQL for validation, transformation logic, and performance tuning. Data Quality & Validation • Implement data quality rules, profiling, exception handling, and reconciliation frameworks. • Design automated validation suites and sampling strategies for high-stakes data consumption. Performance & Reliability • Tune jobs and SQL for scale (partitioning, parallelization, pushdown optimization, caching). • Optimize schedules, dependencies, and resource utilization within TAC. • Establish SLIs/SLOs and monitor pipeline health via logs, metrics, and alerts. DevOps & Automation • Integrate Talend with Git and CI/CD tools (e.g., Jenkins, Azure DevOps) for versioning, build, test, and deployment automation. • Promote repeatable deployments across dev/test/prod with environment configs and secrets management. Migration & Modernization • Lead conversion of legacy ETL platforms to Talend, including mapping old jobs, rationalizing logic, and decommissioning. • Support cloud integration initiatives and real-time processing adoption. Collaboration & Leadership • Partner with data architects, DBAs, application teams, and business stakeholders. • Mentor developers, review code/designs, and contribute to best practices and documentation. Tools & Technologies: Talend: Studio, TAC, DI, Real-Time Big Data Platform, Data Quality Databases: SQL Server, DB2 Languages: Java 8/11, SQL Streaming/Integration: REST, Kafka; monitoring via Splunk DevOps: Git, Jenkins, Azure DevOps (pipelines, artifacts), environment configs Cloud (preferred): Azure/GCP services for storage, compute, integration Candidate Value Proposition: The successful candidate will have the opportunity to work on a key migration project and enhance their ETL development skills for a top 5 Canadian Bank. Candidate Requirements/Must Have Skills: 1) 10+ years of relevant working experience in ETL development, architecture, and data integration 2) 8+ years of hands-on Talend development experience: Talend Studio, Talend Administration Center (TAC), Talend Data Integration, Talend Real-Time Big Data Platform and Talend Data Quality 3) 5+ years of Java (Java 8/11) for Talend customizations and job-level logic 4) Strong expertise across ETL concepts, data warehousing, and integration patterns 5) Hands on experience building Talend ETL/ELT jobs, components, mapping and data pipelines 6) Advanced SQL for data validation transformation and performance tuning (Oracle, SQL, Server, DB2, Teradata) Nice-To-Have Skills: 1) Proven ETL Migration experience, including conversion of legacy ETL platforms into Talend 2) API and streaming data integration experience, including REST APIs, Kafka, Splunk 3) CI/CD integration for Talend jobs (GIT, Jenkins, Azure, DevOps, etc.)4) Experience with cloud platforms and cloud integration 5) Big data and real time processing 6) Financial industry experience Soft Skills Required: • Good communication skills Education: Bachelor’s degree in Computer Science, Engineering, or related field; equivalent experience considered.