Big Data Lead

**Position Title: Big Data Lead**

**Location: Montreal (Onsite)**

Who are we looking for?

Looking for a tech-savvy professional with at least 10 years of industry experience. At least 8 years of experience working as a Lead in Big Data technologies. Should be methodical and have excellent time management skills. As a Lead, should also use your communication skills to collaborate effectively with various teams.

Technical Skills:
BIG DATA LEAD (Spark Structured Streaming + Spark SQL + Kafka)

**Qualifications**:

- 8+ Yrs exp (Internal/external) - Spark with Scala, Kafka,Sql, Azure/AWS databricks
- Experience in Spark with Scala, spark streaming, structured streaming with Kafka, Spark performance optimization,Sql, Azure databricks.

Experience on Databricks, Azure Data Factory, Azure Datalake service is added advantage ,
- Experience in building real time data streaming pipelines from Kafka (or any message broker) using Spark Structured Streaming
- Hands on experience in Spark with functional programming language like Scala development and unit testing is must.
- Experience in designing and leading Big Data projects, designing data models on Hive and HBase for high-performance and storage.
- Executed at least one end to end Bigdata projects (streaming real time data) and led the developers’ team.
- Experience in Agile methodology is a must.
- Knowledge of standard methodologies, concepts, best practices, and procedures within Big Data environment
- Self-starter and able to independently implement the solution.
- Good problem-solving techniques and communication
- Hands on Big Data Lead role (Spark Structured streaming)
- Actively participate in scrum calls, story points, estimates and own the development piece.
- Provide technical assistance to team and involve in efficient design
- Analyze the user stories, understand the requirements and develop the code as per the design
- Develop test cases, perform unit testing and integrating testing
- Support QA Testing, UAT and production deployment
- Develop batch and real-time data load jobs from a broad variety of data sources into Hadoop. And design ETL jobs to read data from Hadoop and pass to variety of consumers / destinations.
- Perform analysis of vast data stores and uncover insights.
- Analyze the long running queries and jobs, performance tune them by using query optimization techniques and Spark code optimization.

Process Skills:

- Hands on experience with project management software, like MS Project

Behavioral Skills:

- Excellent verbal and written communication
- Excellent organization and time management skills

Qualification:

- BE (Computer Science)

What’s in for you?
- At Mphasis, we promise you the perfect opportunity of building technical excellence, understand business performance and nuances, be abreast with the latest happenings in technology world and enjoy a satisfying work life balance.
- With the current opportunity, you will get to work with the team that has consistently been setting benchmarks for other deliveries in terms of delivery high CSATs, project completion on time and being one of the best teams to work for in the organization.
- You get an open and transparent culture along with freedom to experimentation and innovation

About the practice/ Project:

- Enterprise/Integration Architect in the project will play pivot role in providing architectural support in framing the business requirements.

Who are we?

Mphasis is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain and process expertise. Over the years we have left an indelible impression in the IT solutions domain with an impressive clientele and an extensive global presence. The accolades we have been garnering can be attributed to our undeterred focus in delivering quality solutions across verticals that meet the challenging requirements of our esteemed customers. Our integrated solutions offering is aimed at creating value for our customers, helping them in improving their business processes with minimum hassles and capital outlays.

**Benefits**:

- Dental care
- Paid time off
- Vision care

Schedule:

- 8 hour shift

Work Location: In person