Senior Data Engineer

The Sr Data Engineer in the Data & AI Platform team is responsible for building and optimizing data pipelines and infrastructure to enable secure, scalable, and high-performance access to FX market data—particularly from platforms such as FX Spectrum . This role is instrumental in delivering high-quality, trusted data assets and analytics capabilities within Client’s modern Data & AI Platform to support data-driven and AI-enabled decision-making across the enterprise. About the Role Role : Senior Data Engineer Skills : Apache Spark, Databricks, or Azure Data Factory, FX Trading Platform, Databricks, Azure Synapse, or Snowflake Experience: 10+ years Location : Remote. Key Accountabilities Build robust data pipelines: Design, develop, and maintain batch and real-time data pipelines for ingesting, transforming, and storing FX data. Enable data-driven insights: Collaborate with analysts, data scientists, and business teams to ensure timely, reliable, and well-structured data is available to support analytics and AI use cases. Integrate market data platforms: Work with internal and external systems to ensure smooth integration of FX Spectrum data feeds using industry protocols such as FIX and REST APIs. Support platform scalability: Contribute to the development of reusable data models, ETL frameworks, and metadata-driven pipelines across the enterprise data ecosystem (e.g., Databricks, Azure Data Factory, Power BI). Ensure data quality and governance: Apply rigorous data validation and quality assurance techniques, ensuring compliance with regulatory requirements and internal data governance standards. Optimize data performance: Identify and implement performance improvements in data workflows, including indexing, partitioning, and data format optimization for large-scale FX data. Qualifications Education & Experience Bachelor’s degree in Computer Science, Data Engineering, or related technical field. 3–5 years of experience in data engineering or data platform development, preferably within capital markets or financial services. Direct experience with FX Spectrum or similar FX trading platforms. Technical Skills Advanced proficiency in SQL and data pipeline development using tools such as Apache Spark, Databricks , or Azure Data Factory . Experience with visualization tools such as Power BI or Tableau. Familiarity with cloud data platforms (e.g., Databricks, Azure Synapse, or Snowflake). Solid understanding of FX market data structures , FIX protocol, and integration of streaming or batch feeds. Understanding of data governance concepts and tools (e.g., Microsoft Purview, Unity Catalog). Core Competencies Strong problem-solving and system design skills with the ability to build scalable, maintainable data solutions. Effective communicator with the ability to collaborate across technical and business teams, translating data architecture into practical use cases. Solid business acumen and understanding of financial or credit union operations, particularly FX trading workflows and post-trade processing. Demonstrated ability to thrive in a fast-paced, regulated, data-driven environment. Ability to collaborate in cross-functional teams and thrive in a data-driven culture. Outcomes Faster insight generation and decision-making across business units. Improved adoption of governed, self-serve analytics capabilities. Scalable and governed data pipelines that enable real-time and historical FX analysis. Accelerated delivery of AI and analytics use cases through high-quality data infrastructure. Increased adoption of trusted, self-serve FX data assets across trading, risk, and finance teams. If you're someone who thrives in fast-paced environments, takes initiative, and enjoys solving complex problems, we’d love to connect Apply now or reach out directly at narendra.bellam@coforge.com to learn more