Senior Data Infrastructure Engineer

1 day ago


Vancouver, British Columbia, Canada MasterCard Full time
Mastercard Senior Data Infrastructure Engineer

Estimated salary: $170,000 - $250,000 per year.

About Mastercard

We are a leading global payments and technology company that makes payments easy, simple, and secure. We support a wide range of digital payments choices, making transactions secure, simple, smart, and accessible.

Data Engineer Role

We are seeking an experienced Senior Data Infrastructure Engineer to join our Data and Platform team. This pivotal role is responsible for guiding Data Engineer design, supporting multiple Data Analysts and Data Scientists, as well as assisting on various data-driven requests across the company.

Responsibilities
  • Owning complex problems having dependency across services and facilitating cross-functional team interactions to drive resolution, including large-scale data extraction, transformation, and analysis.
  • Writing code to build and enhance applications/services and promoting code-reviews, code scanning, and other standard development practices to deliver high-quality data modeling and artifacts to production.
  • Maintaining the tooling and infrastructure that enables our Analysts and Data Scientists to work efficiently and effectively.
  • Promoting strategies to improve our data modeling, quality, and architecture.
  • Automating and simplifying all aspects of software delivery and development actively evangelizing the need to automate and simplify where needed.
  • Supporting production code to produce comprehensive and accurate data artifacts.
  • Conducting technical interviews for hiring engineering staff and raising the performance bar.
Requirements
  • Ability to write secure code in three or more languages (e.g., Python, Java, JavaScript, PHP) and familiar with secure coding standards (e.g., OWASP).
  • Experience with cloud technologies, especially AWS Redshift, AWS Glue Jobs and Crawler, Lake Formation/CDK Policies, Step Functions, S3, SQS, SNS, and Sparks technology.
  • Experienced with streaming data such as Kafka or AWS Kinesis.
  • Experience with monitoring tools, such as DataDog, Splunk, AWS Cloud watch/Cloud trails.
  • Experience with analysis tools, such as Athena or Tableau.
  • Understanding internals of operating systems (Mac, Linux) to write interoperable and performant code.
  • Experienced with developing and maintaining data pipelines for the extraction, transformation, and/or loading of large-scale data.
  • Experienced with working with large data sets. You've implemented parallel processing and have dealt with the limitations and challenges of working with terabytes of data.
  • Able to perform debugging and troubleshooting to analyze core, memory, heap, thread dumps and remove coding errors.
  • Skills to document and coach team on the development practices and coding guidelines (e.g., branching, peer reviews, library use, logging, scanning rules, test-driven development, error handling).
  • Skills to undertake a technical review of code across applications and their dependencies to look for anti-patterns and promote continuous refactoring.
  • Skills to simplify deployment and eliminate software and infrastructure snowflakes using standardized platforms, ephemeral instances, and automation.
  • Skills to orchestrate release workflows and pipelines to achieve CI and CD using industry-standard tools (e.g., Jenkins, Bamboo, AWS pipelines, others).
  • Able to configure rules and build automation for code with vulnerability scanning and software composition analysis using standard tools (e.g., Codecov).
  • Skills to define, organize, and report on test runs for major, minor, and hotfix releases (including unit, component level, system level, customer journeys, past customer issues, and regulatory controls).
  • Skills to conduct various performance tests (e.g., load testing).


  • Vancouver, British Columbia, Canada Snapcommerce Full time

    About the RoleWe're looking for a seasoned Sr. Analytics Engineer to lead our data infrastructure evolution, primarily supporting our finance department. As a key member of our Data & Analytics team, you'll own the analytics infrastructure for our products, from data ingestion to reporting, ensuring high data quality and availability. You'll collaborate with...


  • Vancouver, British Columbia, Canada Amazon Full time

    Unlock your potential as a Senior Data Engineering Specialist at Amazon.About the RoleWe are seeking an experienced data engineer to join our team in designing, managing, and continuously enhancing our data and analytics infrastructure. This includes process automation/improvements, developing automated reporting solutions/tools, and improving the ability of...


  • Vancouver, British Columbia, Canada EBC Full time

    EBC is a leading provider of infrastructure development services. Our team of experts delivers high-quality projects on time and within budget.We are currently seeking an experienced Senior Infrastructure Development Specialist to join our team in the field of civil engineering.About the RoleConduct site visits and assessments to identify project...


  • Vancouver, British Columbia, Canada Insight Global Full time

    Job DescriptionWe are seeking a Senior Cloud Infrastructure Engineer to join our DSE team at Insight Global. As a key member of this team, you will be responsible for building and maintaining our cloud infrastructure, including CI/CD pipelines and migrating applications to new AWS instances.The ideal candidate will have 5+ years of experience in DevOps...


  • Vancouver, British Columbia, Canada Treasure Data Full time

    At Treasure Data, we're dedicated to making data-driven decision-making a reality. As a key member of our team, you'll play a vital role in driving the success of our Real-Time product.About UsWe're a leader in Customer Data Platforms, as recognized by Gartner Magic Quadrant for 2024. Our cloud-based customer data platform simplifies how companies use data...


  • Vancouver, British Columbia, Canada Electronic Arts Full time

    About the RoleWe are seeking a highly skilled Senior Infrastructure Engineer to join our team at Electronic Arts. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining critical systems that support our gaming server infrastructure.Job SummaryThe ideal candidate will have 2+ years of relevant...


  • Vancouver, British Columbia, Canada Epic Games Full time

    Job SummaryEpic Games is seeking a highly skilled Senior Build Infrastructure Engineer to join our team. As a key member of our infrastructure team, you will be responsible for designing, implementing, and maintaining our build infrastructure to support projects across the company.About UsEpic Games is a global leader in the development of game engines and...


  • Vancouver, British Columbia, British Columbia, Canada Alquemy Search & Consulting Full time

    Senior Data Engineer12 month contract opportunity, high potential to extend"Hybrid" work environment - 2 times per week in downtown Vancouver officeSeeking a Data Engineer who is passionate about big data technology and delivering data solution to handle TB scale data per day and help the business meet the distinct needs of customers.Role & responsibilities:...


  • Vancouver, British Columbia, Canada KPMG-Canada Full time

    About UsKPMG-Canada is a leading professional services firm, providing audit, tax, and advisory services. Our Vancouver team is renowned for its expertise in data engineering, helping clients drive business growth through data-driven insights.Job SummaryWe are seeking an experienced Data Engineer to join our Lighthouse team as a Senior Consultant. This role...


  • Vancouver, British Columbia, Canada Amazon Data Services Canada, Inc. Full time

    About the JobAs a Data Engineer Leader with Amazon Data Services Canada, Inc., you will be responsible for leading a team of engineers in building data systems that simplify bringing new models to customers and enhance visibility into our underlying modeling process. You will mentor and guide your team towards best practices in data engineering, while...


  • Vancouver, British Columbia, Canada DEMONWARE LTD. Full time

    Job Overview: We are seeking an experienced Senior Data Engineering Leader to join our team at Demonware Ltd. As a key member of our data management strategy, you will lead the development and implementation of data pipelines, ensuring compliance with data governance standards. About Us Demonware Ltd. is a leading provider of online and data services for...


  • Vancouver, British Columbia, Canada Ausenco Full time

    Ausenco is redefining what's possible in some of the world's most complex projects and toughest environments.We deliver innovative, value-add consulting, project delivery, asset operations and maintenance solutions. With a presence in 15 countries and projects in over 80 locations worldwide, we create sustainable outcomes for our people, clients, and...


  • Vancouver, British Columbia, Canada Moving2Canada Full time

    Moving2Canada is seeking an experienced Land Surveyor to lead complex infrastructure projects in Vancouver. With a competitive salary range of $90,000 - $130,000, this full-time permanent role offers opportunities for professional growth and development.About the RoleServe as senior project manager for various infrastructure projects, including mixed-use air...


  • Vancouver, British Columbia, Canada Mastercard Full time

    Job SummaryMastercard is seeking a seasoned Senior Java Performance Engineer to join its team of experts in building and maintaining high-performance digital infrastructure. This role will be responsible for designing, developing, and operating mission-critical services that power the company's global payments ecosystem.About the RoleThis position requires a...


  • Vancouver, British Columbia, Canada Demonware Full time

    Job OverviewDemonware, a leading developer of online and data services for the gaming industry, is seeking an experienced Senior Data Engineering Specialist. As a key member of our talented data engineering team, you will play a crucial role in managing our large-scale data footprint.


  • Vancouver, British Columbia, Canada Ausenco Full time

    Ausenco is seeking a Senior Civil Infrastructure Engineer to join our Minerals & Metals Business line in Vancouver.About the Role:Design innovative solutions for industrial and mining projects under supervision of civil lead engineers.Develop cost-effective civil and site utility designs from conceptual design through to detail design, tender, and...

  • Senior Data Engineer

    1 month ago


    Vancouver, British Columbia, Canada GeoComply Full time

    About GeoComplyWe are a global leader in geolocation compliance solutions, trusted by leading brands and regulators. Our mission is to empower businesses to make informed decisions with actionable insights.The RoleAs a Senior Data Engineer at GeoComply, you will construct data pipelines that transform raw data into business-critical insights. You will work...


  • Vancouver, British Columbia, Canada WSP Full time

    Job SummaryWe are seeking a highly skilled Senior Mechanical Engineer to join our team in Vancouver, Canada. As a key member of our water and wastewater infrastructure group, you will be responsible for leading the design and contract management of pump stations and reservoirs.About the OpportunityThis is an excellent opportunity to work on high-profile...


  • Vancouver, British Columbia, Canada Electronic Arts Full time

    About the RoleWe are seeking a Senior Business Analyst to join our Cost Management team within the Production Infrastructure & Engineering organization at Electronic Arts. As a key member of our team, you will work closely with multiple stakeholders to provide insights and drive strategic initiatives related to infrastructure cost management.Key...


  • Vancouver, British Columbia, Canada Instacart Full time

    About the RoleAt Instacart, we're revolutionizing the grocery industry by providing a convenient and secure way for customers to shop online. As a Senior Software Engineer in our Privacy team, you will play a crucial role in building and sustaining the comprehensive access controls and governance systems that protect our customers' data.We're looking for a...