Senior Big Data Engineer

The Big Data Engineer is a senior level position responsible for establishing andimplementing new or revised application systems and programs in coordination with theTechnology team. The overall objective of this role is to lead applications systems analysisand programming activities.Responsibilities:Partner with multiple management teams to ensure appropriate integration offunctions to meet goals as well as identify and define necessary systemenhancements to deploy new products and process improvementsResolve variety of high impact problems/projects through in-depth evaluation ofcomplex business processes, system processes, and industry standardsProvide expertise in area and advanced knowledge of applicationsprogramming and ensure application design adheres to the overall architectureblueprintUtilize advanced knowledge of system flow and develop standards for coding,testing, debugging, and implementationDevelop comprehensive knowledge of how areas of business, such asarchitecture and infrastructure, integrate to accomplish business goalsProvide in-depth analysis with interpretive thinking to define issues anddevelop innovative solutionsServe as advisor or coach to mid-level developers and analysts, allocating work as necessaryAppropriately assess risk when business decisions are made, demonstratingconsideration for the firm's reputation and safeguarding Citigroup, its clientsand assets, by driving compliance with applicable laws, rules and regulations,adhering to Policy, applying sound ethical judgment regarding personalbehavior, conduct and business practices, and escalating, managing andreporting control issues with transparency.Qualifications:5+Years of Experience in Big Data Engineering (PySpark)Data Pipeline Development: Design, build, and maintain scalable ETL/ELTpipelines to ingest, transform, and load data from multiple sources.Big Data Infrastructure: Develop and manage large-scale data processingsystems using frameworks like Apache Spark, Hadoop, and Kafka.Proficiency in programming languages like Python, or Scala.Strong expertise in data processing frameworks such as Apache Spark,Hadoop.Expertise in Data Lakehouse technologies (Apache Iceberg, Apache Hudi,Trino)Experience with cloud data platforms like AWS (Glue, EMR, Redshift), Azure(Synapse), or GCP (BigQuery).Expertise in SQL and database technologies (, Oracle, PostgreSQL, etc.).Experience with data orchestration tools like Apache Airflow or Prefect.Familiarity with containerization (Docker, Kubernetes) is a plusGood to Have Skills:Distributed caching solutions (Hazelcast or Redis)Prior experience with building distributed, multi-tier applications is highly desirable.Experience with building apps which are highly performant and scalable will be greatEducation:• Bachelor’s degree/University degree or equivalent experience• Master’s degree preferred------------------------------------------------------Job Family Group: Technology------------------------------------------------------Job Family:Applications Development------------------------------------------------------Time Type:Full time------------------------------------------------------Primary Location Full Time Salary Range:$94, - $141,------------------------------------------------------Most Relevant Skills Please see the requirements listed above.------------------------------------------------------Other Relevant Skills For complementary skills, please see above and/or contact the recruiter.------------------------------------------------------Automated Processing and AIWe use automated processing, including artificial intelligence, for our legitimate business interests (or our reasonable and appropriate business purposes) to identify and align the candidate's skills and abilities with a specific job opening. Additionally, if you so choose, or consent, we can match your skills and abilities to other suitable roles at Citi.Importantly, all our hiring processes and decisions, including determining your suitability for a role, are conducted, checked, and decided by individuals. Our automated processing and AI do not involve relying on automatic or autonomous decision-making. Please refer to any Jurisdictional Considerations, with specific provisions for your country (where relevant) for further details.------------------------------------------------------