Java Spark Developer

One of our direct client(financial domain) is looking to hire Java Developer, This is long term contractual opportunity. Duration: Long term contract Responsibilities Develop and maintain robust Java applications that integrate with Apache Spark for processing vast amounts of data efficiently and in real-time. Design, implement, and optimize Spark jobs and workflows to process structured and unstructured data from various sources. Collaborate with data engineers, data scientists, and other cross-functional teams to understand data requirements and translate them into scalable solutions using Spark. Identify performance bottlenecks and optimize Spark jobs for improved speed, scalability, and resource utilization. Troubleshoot and debug issues related to Spark applications and provide timely resolutions to ensure smooth data processing. Stay up-to-date with the latest developments in the Spark ecosystem and apply best practices to improve the overall data processing infrastructure. Work on data ingestion, transformation, and aggregation processes, ensuring data quality and integrity throughout the pipeline. Develop and maintain unit tests and integration tests to ensure the reliability and quality of the Spark applications. Collaborate in code reviews and contribute to a culture of code quality, continuous integration, and continuous delivery. Participate in the evaluation and selection of relevant technologies and tools to enhance the data processing capabilities of the organization. Requirements Bachelor's or Master's degree in Computer Science, Software Engineering, or a related field. Proven experience as a Java Developer with a solid understanding of Java programming concepts and best practices. Hands-on experience in designing, developing, and deploying applications using Apache Spark. Proficiency in Scala or Python is a plus, as it can help in some Spark-related tasks. Familiarity with distributed computing concepts and big data processing frameworks. Strong knowledge of data structures, algorithms, and data processing techniques. Experience with Spark's core components like Spark Core, Spark SQL, Spark Streaming, and Spark MLlib. Working knowledge of Hadoop ecosystem technologies such as HDFS, Hive, and HBase is desirable. Experience with cloud-based services and platforms like AWS, Azure, or GCP is a bonus. Good understanding of data serialization formats like Avro, Parquet, or JSON. Excellent problem-solving skills and the ability to think critically in a fast-paced environment. Strong communication and collaboration skills to work effectively within a team and across departments. A passion for staying updated with emerging technologies and a commitment to continuous learning. About Iris Software Inc. With 4,000+ associates and offices in India, U.S.A. and Canada, Iris Software delivers technology services and solutions that help clients complete fast, far-reaching digital transformations and achieve their business goals. A strategic partner to Fortune 500 and other top companies in financial services and many other industries, Iris provides a value-driven approach - a unique blend of highly-skilled specialists, software engineering expertise, cutting-edge technology, and flexible engagement models. High customer satisfaction has translated into long-standing relationships and preferred-partner status with many of our clients, who rely on our 30+ years of technical and domain expertise to future-proof their enterprises. Associates of Iris work on mission-critical applications supported by a workplace culture that has won numerous awards in the last few years, including Certified Great Place to Work in India; Top 25 GPW in IT & IT-BPM; Ambition Box Best Place to Work, #3 in IT/ITES; and Top Workplace NJ-USA. #J-18808-Ljbffr