MDM Lead Data Engineer

We are an AI‑led, platform‑driven Digital Engineering and Enterprise Modernization partner, combining deep technical expertise and industry experience to help our clients anticipate what’s next. Our offerings and proven solutions create a unique competitive advantage for our clients by giving them the power to see beyond and rise above. We work with many industry‑leading organizations across the world, including 12 of the 30 most innovative global companies, 60% of the largest banks in the US and India, and numerous innovators across the healthcare ecosystem. Our disruptor’s mindset, commitment to client success, and agility to thrive in the dynamic environment have enabled us to sustain our growth momentum by reporting $360.2M revenue in Q3 FY25, delivering 4.3% Q‑o‑Q and 19.9% Y‑o‑Y growth. Our 23,900+ global team members, located in 19 countries, have been instrumental in helping the market leaders transform their industries. We are also pleased to share that Persistent won in four categories at the prestigious 2024 ISG Star of Excellence™ Awards, including the Overall Award based on the voice of the customer. We were included in the Dow Jones Sustainability World Index, setting high standards in sustainability and corporate responsibility. We were awarded for our state‑of‑the‑art learning and development initiatives at the 16th TISS LeapVault CLO Awards. In addition, we were cited as the fastest‑growing IT services brand in the 2024 Brand Finance India 100 Report. Throughout our market‑leading growth, we’ve maintained a strong employee satisfaction score of 8.2/10. About Position We are seeking a highly skilled Azure Data Engineer with strong expertise in SQL, Python, Datawarehouse, and Cloud ETL tools to join our data team. The ideal candidate will design, implement and optimize large‑scale data pipelines, ensuring scalability, reliability and performance. This role involves working closely with multiple teams and business stakeholders to deliver cutting‑edge data solutions. Role: MDM Lead Data Engineer Location: Remote Experience: 8+ years Key Responsibilities Build and maintain scalable ETL/ELT pipelines using Databricks. Leverage PySpark/Spark and SQL to transform and process large datasets. Integrate data from multiple sources including Azure Blob Storage, ADLS and other relational/non‑relational systems. Work closely with multiple teams to prepare data for dashboards and BI tools. Collaborate with cross‑functional teams to understand business requirements and deliver tailored data solutions. Performance & Optimization: Optimize Databricks workloads for cost efficiency and performance. Monitor and troubleshoot data pipelines to ensure reliability and accuracy. Governance & Security: Implement and manage data security, access controls and governance standards using Unity Catalog. Ensure compliance with organizational and regulatory data policies. Deployment: Leverage Databricks Asset Bundles for seamless deployment of Databricks jobs, notebooks and configurations across environments. Manage version control for Databricks artifacts and collaborate with team to maintain development best practices. Technical Skills Strong expertise in Databricks (Delta Lake, Unity Catalog, Lakehouse Architecture, Table Triggers, Delta Live Pipelines, Databricks Runtime etc.) Proficiency in Azure Cloud Services. Solid understanding of Spark and PySpark for big data processing. Experience in relational databases. Knowledge of Databricks Asset Bundles and GitLab. Preferred Experience Familiarity with Databricks Runtimes and advanced configurations. Knowledge of streaming frameworks like Spark Streaming. Certifications & Benefits Competitive salary and benefits package. Culture focused on talent development with quarterly promotion cycles and company‑sponsored higher education and certifications. Opportunity to work with cutting‑edge technologies. Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards. Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents. Persistent Ltd. is dedicated to fostering diversity and inclusion in the workplace. We invite applications from all qualified individuals, including those with disabilities, and regardless of gender or gender preference. We welcome diverse candidates from all backgrounds. We offer hybrid work options and flexible working hours to accommodate various needs and preferences. Our office is equipped with accessible facilities, including adjustable workstations, ergonomic chairs, and assistive technologies to support employees with physical disabilities. If you are a person with disabilities and have specific requirements, please inform us during the application process or at any time during your employment. We are committed to creating an inclusive environment where all employees can thrive. Our company fosters a values‑driven and people‑centric work environment that enables our employees to: Accelerate growth, both professionally and personally. Impact the world in powerful, positive ways, using the latest technologies. Enjoy collaborative innovation, with diversity and work‑life wellbeing at the core. Unlock global opportunities to work and learn with the industry’s best. Let’s unleash your full potential at Persistent. For more detail, please contact – Puja (Puja_kumari@persistent.com) Persistent is an Equal Opportunity Employer and prohibits discrimination and harassment of any kind. Seniority level Mid‑Senior level Employment type Contract Job function IT Services and IT Consulting and Banking #J-18808-Ljbffr