Big Data Lead

3 days ago

Montréal, Canada Mphasis Full time

**Position Title: Big Data Lead**

**Location: Montreal (Onsite)**

Who are we looking for?

Looking for a tech-savvy professional with at least 10 years of industry experience. At least 8 years of experience working as a Lead in Big Data technologies. Should be methodical and have excellent time management skills. As a Lead, should also use your communication skills to collaborate effectively with various teams.

Technical Skills:
BIG DATA LEAD (Spark Structured Streaming + Spark SQL + Kafka)

**Qualifications**:

- 8+ Yrs exp (Internal/external) - Spark with Scala, Kafka,Sql, Azure/AWS databricks
- Experience in Spark with Scala, spark streaming, structured streaming with Kafka, Spark performance optimization,Sql, Azure databricks.

Experience on Databricks, Azure Data Factory, Azure Datalake service is added advantage ,
- Experience in building real time data streaming pipelines from Kafka (or any message broker) using Spark Structured Streaming
- Hands on experience in Spark with functional programming language like Scala development and unit testing is must.
- Experience in designing and leading Big Data projects, designing data models on Hive and HBase for high-performance and storage.
- Executed at least one end to end Bigdata projects (streaming real time data) and led the developers’ team.
- Experience in Agile methodology is a must.
- Knowledge of standard methodologies, concepts, best practices, and procedures within Big Data environment
- Self-starter and able to independently implement the solution.
- Good problem-solving techniques and communication
- Hands on Big Data Lead role (Spark Structured streaming)
- Actively participate in scrum calls, story points, estimates and own the development piece.
- Provide technical assistance to team and involve in efficient design
- Analyze the user stories, understand the requirements and develop the code as per the design
- Develop test cases, perform unit testing and integrating testing
- Support QA Testing, UAT and production deployment
- Develop batch and real-time data load jobs from a broad variety of data sources into Hadoop. And design ETL jobs to read data from Hadoop and pass to variety of consumers / destinations.
- Perform analysis of vast data stores and uncover insights.
- Analyze the long running queries and jobs, performance tune them by using query optimization techniques and Spark code optimization.

Process Skills:

- Hands on experience with project management software, like MS Project

Behavioral Skills:

- Excellent verbal and written communication
- Excellent organization and time management skills

Qualification:

- BE (Computer Science)

What’s in for you?
- At Mphasis, we promise you the perfect opportunity of building technical excellence, understand business performance and nuances, be abreast with the latest happenings in technology world and enjoy a satisfying work life balance.
- With the current opportunity, you will get to work with the team that has consistently been setting benchmarks for other deliveries in terms of delivery high CSATs, project completion on time and being one of the best teams to work for in the organization.
- You get an open and transparent culture along with freedom to experimentation and innovation

About the practice/ Project:

- Enterprise/Integration Architect in the project will play pivot role in providing architectural support in framing the business requirements.

Who are we?

Mphasis is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain and process expertise. Over the years we have left an indelible impression in the IT solutions domain with an impressive clientele and an extensive global presence. The accolades we have been garnering can be attributed to our undeterred focus in delivering quality solutions across verticals that meet the challenging requirements of our esteemed customers. Our integrated solutions offering is aimed at creating value for our customers, helping them in improving their business processes with minimum hassles and capital outlays.

**Benefits**:

- Dental care
- Paid time off
- Vision care

Schedule:

- 8 hour shift

Work Location: In person

  • Administrateur Big Data

    4 weeks ago

    Montréal, Canada Talan Full time

    Company Description Depuis plus de 20 ans, Talan conseille les entreprises et les administrations, les accompagne et met en œuvre leurs projets de transformation et d’innovation en France et à l’international. Le Groupe met l’innovation au cœur de son développement et intervient dans les domaines liés aux mutations technologiques des grands...

  • Administrateur Big Data

    4 weeks ago

    Montréal, Canada Talan Full time

    **A propos de Talan** Depuis plus de 20 ans, Talan conseille les entreprises et les administrations, les accompagne et met en œuvre leurs projets de transformation et d’innovation en France et à l’international. Le Groupe met l’innovation au cœur de son développement et intervient dans les domaines liés aux mutations technologiques des grands...

  • Big Data Cloud Developer

    4 weeks ago

    Montréal, Canada C.G.I. Full time

    Your role encompasses contributions to platform design, implementation, and ongoing production support. Additionally, you'll lend your expertise to projects integrating with the platform. In this context, your proficiency in both Big Data and Azure technologies, coupled with a strong grasp of performance and security principles, are pivotal.TECHNICAL...

  • Data Conversion Lead

    4 weeks ago

    Montréal, Canada LifeWorks Full time

    TELUS Health and LifeWorks have recently come together to leverage the power of technology and our caring cultures to further progress our shared goal of building a healthier and friendlier future for all. As a global-leading health and well-being provider - encompassing physical, mental and financial health - TELUS Health is improving health outcomes for...

  • Architecte de Solution Microsoft Bi/big Data Et

    2 weeks ago

    Montréal, Canada agileDSS Full time

    **agileDSS** est une société spécialisée en Business et Data Intelligence. Nous accompagnons depuis près de 20 ans les grandes entreprises québécoises dans la mise en place d'écosystème analytique unique et adapté. Notre expertise est reconnue, tant pour notre excellence que pour notre approche humaine et innovante. Rejoindre agileDSS, c'est...

  • MONTREAL [HYBRIDE] - Big-Data Cloud Developer (Senior)

    3 weeks ago

    Montréal, QC, Canada QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    Big-Data Cloud Developer (Senior)WHO WE ARE Quanteam is an independent Financial Markets consulting company based in France, the UK, the USA, Canada, and Morocco. Our team of 800 employees supports Corporate and Investment Banks, Asset Management Companies, Insurance, and corporations for their projects in SI transformation, technology innovation, financial...

  • MONTREAL [HYBRIDE] - Big-Data Cloud Developer (Senior)

    3 weeks ago

    Montréal, QC, Canada QUANTEAM - North America (RAINBOW PARTNERS Group) Full time

    Big-Data Cloud Developer (Senior)WHO WE ARE Quanteam is an independent Financial Markets consulting company based in France, the UK, the USA, Canada, and Morocco. Our team of 800 employees supports Corporate and Investment Banks, Asset Management Companies, Insurance, and corporations for their projects in SI transformation, technology innovation, financial...

  • Technical Manager, Ohdio, Big Data and Machine

    3 months ago

    Montréal, Canada CBCRadio-Canada Full time

    Job Family Media Production Primary Location Montreal Position Language Requirement French Only Language Skill Level (Reading) - Language Skill Level (Writing) - Language Skill Level (Speaking) Status of Employment Contract Work schedule(s) Full-time **Working at CBC/Radio-Canada** At CBC/Radio-Canada, we all have a story to tell. What’s yours? If...

  • Technical Product Owner

    4 weeks ago

    Montréal, Canada NTT DATA Full time

    **Req ID**:228247 We are currently seeking a **Technical Product Owner - Data Solutions Analyst - Remote Canada Position** to join our team in Toronto, Ontario (CA-ON), Canada (CA). **How You'll Help Us**: As a Product Owner, you hold a key role on our Scrum teams by representing the interests of the business. Through working with stakeholders, you ensure...

  • Lead Data Scientist

    4 weeks ago

    Montréal, QC, Canada StevenDouglas Full time

    The Alternative Data and AI team is looking to hire a well-balanced individual that is both technically proficient and a strong communicator to lead advanced analytics initiatives that focus on client opportunity identification across various Capital Markets product groups.What will you do?Oversee the design and development of AI ML models for deriving...

  • Lead Data Scientist

    4 weeks ago

    Montréal, QC, Canada StevenDouglas Full time

    The Alternative Data and AI team is looking to hire a well-balanced individual that is both technically proficient and a strong communicator to lead advanced analytics initiatives that focus on client opportunity identification across various Capital Markets product groups.What will you do?Oversee the design and development of AI ML models for deriving...

  • Lead Data Scientist

    4 weeks ago

    Montréal, QC, Canada StevenDouglas Full time

    The Alternative Data and AI team is looking to hire a well-balanced individual that is both technically proficient and a strong communicator to lead advanced analytics initiatives that focus on client opportunity identification across various Capital Markets product groups.What will you do?Oversee the design and development of AI ML models for deriving...

  • Lead Data Scientist

    1 month ago

    Montréal, QC, Canada StevenDouglas Full time

    The Alternative Data and AI team is looking to hire a well-balanced individual that is both technically proficient and a strong communicator to lead advanced analytics initiatives that focus on client opportunity identification across various Capital Markets product groups.What will you do?Oversee the design and development of AI ML models for deriving...

  • Lead Data Scientist

    1 month ago

    Montréal, QC, Canada StevenDouglas Full time

    The Alternative Data and AI team is looking to hire a well-balanced individual that is both technically proficient and a strong communicator to lead advanced analytics initiatives that focus on client opportunity identification across various Capital Markets product groups.What will you do?Oversee the design and development of AI ML models for deriving...

  • Lead Data Scientist

    4 weeks ago

    Montréal, QC, Canada StevenDouglas Full time

    The Alternative Data and AI team is looking to hire a well-balanced individual that is both technically proficient and a strong communicator to lead advanced analytics initiatives that focus on client opportunity identification across various Capital Markets product groups.What will you do?Oversee the design and development of AI ML models for deriving...

  • Team Lead

    4 weeks ago

    Montréal, Canada Cirque du Soleil Full time

    **Team Lead - Data Analyst** - Permanent position**We were born from an eclectic troop of performers. Come live the experience of being yourself every day to create the extraordinary.** **OUR MISSION** Since 1984, Cirque du Soleil Entertainment Group has been focusing on ever more creative and magical work in order to constantly push the limits of the...

  • Game Producer

    3 weeks ago

    Montréal, Canada Big Fish Games Full time

    **Job Posting Title**: Game Producer **Why Big Fish Games?**: Big Fish Games is the home of some of the biggest hit mobile casual games including EverMerge, Gummy Drop!, Cooking Craze, Fairway Solitaire, and many more. - We are curious and constantly seek improvement in all we do because that’s what our business demands - We operate with good intentions,...

  • Data Analyst

    4 weeks ago

    Montréal, Canada Big Fish Games, Inc. Full time

    **Job Posting Title**: Data Analyst **Summary**: Are you looking for an entrepreneurial opportunity to lead a large globally distributed organization that powers the revenue of a $1bn social casino business? Do you want to support experienced and passionate game development studios in scaling up engaging mobile games for millions of players? Do you want to...

  • Australian English

    2 months ago

    Montréal, Canada Think Big Solutions Full time

    **HIRING IMMEDIATELY** **About Think Big Services** We recruit talents for some world-class clients across the globe & industries for IT, Supply chain & more portfolios. We currently have various exciting roles open, especially in the USA & Canada for professionals who are looking to grow with us **About this role**: Our client is an emerging leader in AI...

  • Australian English

    2 days ago

    Montréal, Canada Think Big Solutions Full time

    **HIRING IMMEDIATELY** **About Think Big Services** We recruit talents for some world-class clients across the globe & industries for IT, Supply chain & more portfolios. We currently have various exciting roles open, especially in the USA & Canada for professionals who are looking to grow with us **About this role**: Our client is an emerging leader in AI...