Senior Data Engineering Lead

Senior Data Engineering Lead 

Our client is seeking a Senior Data Engineering Lead to take ownership of designing, maintaining, and delivering highly scalable, high-performance data solutions. Reporting to the Data Engineering Manager, this role is critical for empowering faster, simpler, and better decision-making across the organization. The successful candidate will ensure data reliability, accessibility, and optimization for advanced analytics while acting as a key driver of innovation within the data infrastructure. As a technical leader, you will be responsible for mentoring team members, leading complex deployments, and collaborating across departments to deliver impactful results aligned with strategic business goals.

Key Responsibilities
Data Solution Architecture & Pipelines

Lead the entire lifecycle of data pipeline development, optimization, and maintenance from diverse source systems.

• Build and enhance complex database business logic, including stored procedures, triggers, and functions, to support highly efficient ETL/ELT processes for both analytical and operational requirements.

Infrastructure Management & Cloud Engineering

• Manage and optimize modern data warehouse environments across leading cloud platforms, including AWS, Azure, and Snowflake.

• Maintain and enhance AWS serverless pipelines, leveraging tools such as Step Functions, Fargate, Lambda, SAM, and various API integrations, with a strong emphasis on troubleshooting and debugging expertise.

DevOps & Automation Ownership

• Take full ownership of the Continuous Integration/Continuous Deployment (CI/CD) processes for data workloads, including Databricks jobs, serverless pipelines, and database scripts.

• Drive continuous automation and efficiency improvements using tools like Docker and Jenkins.

Advanced Analytics Enablement

• Develop and optimize robust data pipelines specifically designed to support Machine Learning (ML) models, complex simulations, and predictive analytics initiatives.

Data Governance & Documentation

• Implement and enforce data governance best practices to maintain the highest levels of data quality, security, and compliance.

• Produce comprehensive technical and business documentation to support both development teams and end-users.

Technical Leadership & Cross-Functional Collaboration

• Act as a mentor to junior and mid-level data engineers, actively working to strengthen their technical skills and promote a culture of collaboration.

• Partner closely with analytics, IT, and business teams to ensure data solutions are aligned with core strategic objectives.

Experience & Qualifications
Education & Professional Experience

• Bachelor's degree in Computer Science, Software Engineering, Data Science, or a related technical field.

• 6–8 years of progressive data engineering experience, with a proven track record of technical leadership in delivering scalable solutions.

Technical Skills (Must-Have Expertise)

• Advanced SQL Expertise: Deep proficiency in writing and optimizing complex stored procedures, triggers, functions, and business logic within environments such as Snowflake, AWS RDS, or Azure SQL.

• ETL Tools: Strong experience with industry-leading ETL platforms such as Alteryx, Databricks, or equivalent technologies.

• Programming: High proficiency in Python or MySQL.

• Cloud & Serverless: Extensive experience with AWS, Azure, Snowflake, and serverless components including Step Functions, Fargate, Lambda, SAM, and API integration patterns.

• DevOps: Proven ability to own and implement CI/CD for data workloads, with practical experience using Docker and Jenkins.

• Data Visualization: Experience creating and interpreting dashboards using tools like Tableau or Power BI.

Additional Skills & Attributes

• Practical experience supporting and optimizing pipelines for ML and predictive analytics.

• Exceptional communication skills and advanced problem-solving capabilities.

• Proactive, self-driven learner, highly adaptable to emerging technologies and industry trends.

• Bilingual Proficiency: The ability to communicate effectively, both written and verbal, in English is required for essential correspondence with clients, partners, and colleagues across our operational network.

Work Setting

• Hybrid Work Model: This role offers the flexibility of a hybrid work setting, combining remote work with in-office collaboration to foster work-life balance and team synergy.

• Health and wellness benefits go beyond the basics, with medical, dental, vision, mental health support, financial advisors, and fitness programs

Please include salary expectations

---