Lead Data Engineer

Lead Data Engineer The Security Solutions Data Science team is responsible for creating Artificial Intelligence (AI) and Machine Learning (ML) models backing its flagship product. The models generated are production ready and created to back specific products in Mastercard’s authentication and authorization networks. The Data Science team is also responsible for developing automated processes for creating models covering all modeling steps, from data extraction up to delivery. In addition, the processes must be designed to scale, to be repeatable, resilient, and industrialized. As a Lead Data Engineer, You Will Lead collaboration with data scientists to understand the existing modeling pipeline and identify optimization opportunities. Oversee the integration and management of data from various sources and storage systems, establishing processes and pipelines to produce cohesive datasets for analysis and modeling. Design and develop data pipelines to automate repetitive tasks within data science and data engineering. Demonstrated experience leading cross-functional teams or working across different teams to solve complex problems. Partner with software engineering teams to deploy and validate production artifacts. Identify patterns and innovative solutions in existing spaces, consistently seeking opportunities to simplify, automate tasks, and build reusable components for multiple use cases and teams. Create data products that are well-modeled, thoroughly documented, and easy to understand and maintain. Comfortable leading projects in environments with undefined or loose requirements. Mentor junior data engineers. Required Qualifications Good knowledge of Linux / Bash environment Experience in the following platforms: Python, Pyspark, Airflow, CI/CD, JIRA, Hadoop, SQL, Databricks, Atlan Good communication skills Highly skilled problem solver Exhibits a high degree of initiative At least an undergraduate degree in CS, or a STEM related field Nice to Have Graduate degree in CS, Data Science, Machine Learning, AI or a related STEM field Data Engineering Experience Experience with Java Experience with Jenkins Experience in with data engineering on petabyte scale data Understands and implements methods to evaluate own work and others for error Loves working with error-prone, messy, disparate, unstructured data Corporate Security Responsibility Abide by Mastercard’s security policies and practices; Ensure the confidentiality and integrity of the information being accessed; Report any suspected information security violation or breach, and Complete all periodic mandatory security trainings in accordance with Mastercard’s guidelines. Mastercard is a merit-based, inclusive, equal opportunity employer that considers applicants without regard to gender, gender identity, sexual orientation, race, ethnicity, disabled or veteran status, or any other characteristic protected by law. We hire the most qualified candidate for the role. In the US or Canada, if you require accommodations or assistance to complete the online application process or during the recruitment process, please contact reasonable_accommodation@mastercard.com and identify the type of accommodation or assistance you are requesting. Do not include any medical or health information in this email. The Reasonable Accommodations team will respond to your email promptly. Job Details Location: Vancouver, Canada Pay Range: $127,000 - $203,000 CAD Seniority level: Mid-Senior level Employment type: Full-time Job function: Information Technology Industries: Financial Services, IT Services and IT Consulting, and Technology, Information and Internet #J-18808-Ljbffr