Big Data Lead

1 week ago

Montreal, Quebec, Canada Mphasis Full time

Position Title:
Big Data Lead

Location:
Montreal (Onsite)
Who are we looking for?

Looking for a tech-savvy professional with at least 10 years of industry experience. At least 8 years of experience working as a Lead in Big Data technologies. Should be methodical and have excellent time management skills. As a Lead, should also use your communication skills to collaborate effectively with various teams.

Technical Skills:
BIG DATA LEAD (Spark Structured Streaming + Spark SQL + Kafka)

Qualifications:

  • 8+ Yrs exp (Internal/external) Spark with Scala, Kafka,Sql, Azure/AWS databricks
  • Experience in Spark with Scala, spark streaming, structured streaming with Kafka, Spark performance optimization,Sql, Azure databricks.
Experience on Databricks, Azure Data Factory, Azure Datalake service is added advantage ,

  • Experience in building real time data streaming pipelines from Kafka (or any message broker) using Spark Structured Streaming
  • Hands on experience in Spark with functional programming language like Scala development and unit testing is must.
  • Experience in designing and leading Big Data projects, designing data models on Hive and HBase for highperformance and storage.
  • Executed at least one end to end Bigdata projects (streaming real time data) and led the developers' team.
  • Experience in Agile methodology is a must.
  • Knowledge of standard methodologies, concepts, best practices, and procedures within Big Data environment
  • Selfstarter and able to independently implement the solution.
  • Good problemsolving techniques and communication
  • Hands on Big Data Lead role (Spark Structured streaming)
  • Actively participate in scrum calls, story points, estimates and own the development piece.
  • Provide technical assistance to team and involve in efficient design
  • Analyze the user stories, understand the requirements and develop the code as per the design
  • Develop test cases, perform unit testing and integrating testing
  • Support QA Testing, UAT and production deployment
  • Develop batch and realtime data load jobs from a broad variety of data sources into Hadoop. And design ETL jobs to read data from Hadoop and pass to variety of consumers / destinations.
  • Perform analysis of vast data stores and uncover insights.
  • Analyze the long running queries and jobs, performance tune them by using query optimization techniques and Spark code optimization.

Process Skills:

  • Hands on experience with project management software, like MS Project

Behavioral Skills:

  • Excellent verbal and written communication
  • Excellent organization and time management skills

Qualification:

  • BE (Computer Science)
What's in for you?

  • At Mphasis, we promise you the perfect opportunity of building technical excellence, understand business performance and nuances, be abreast with the latest happenings in technology world and enjoy a satisfying work life balance.
  • With the current opportunity, you will get to work with the team that has consistently been setting benchmarks for other deliveries in terms of delivery high CSATs, project completion on time and being one of the best teams to work for in the organization.
  • You get an open and transparent culture along with freedom to experimentation and innovation

About the practice/ Project:

  • Enterprise/Integration Architect in the project will play pivot role in providing architectural support in framing the business requirements.
Who are we?


Mphasis is a leading IT solutions provider, offering Applications, Business Process Outsourcing (BPO) and Infrastructure services globally through a combination of technology knowhow, domain and process expertise.

Over the years we have left an indelible impression in the IT solutions domain with an impressive clientele and an extensive global presence.

The accolades we have been garnering can be attributed to our undeterred focus in delivering quality solutions across verticals that meet the challenging requirements of our esteemed customers.

Our integrated solutions offering is aimed at creating value for our customers, helping them in improving their business processes with minimum hassles and capital outlays.


Benefits:

  • Dental care
  • Paid time off
  • Vision care

Schedule:

  • 8 hour shift

Work Location:
In person

  • Big Data Engineering Lead

    1 week ago

    Montreal, Quebec, Canada Alexa Translations Full time

    Alexa Translations provides translation services in the legal, financial, and securities sectors by leveraging proprietary A.I. technology and a team of highly specialized linguistic experts. We are seeking a talented and experienced Data Team Lead to oversee our data team's operations. The ideal candidate will have a strong background in data collection,...

  • Senior Big Data Engineer

    1 week ago

    Montreal, Quebec, Canada Olameter Full time

    Titre du poste : Ingénieur Senior en Big Data Description du poste : Nous recherchons un Ingénieur Senior en Big Data hautement qualifié pour assumer la responsabilité critique de construire et mettre en œuvre des solutions de big data. Ce rôle implique une collaboration étroite avec le PDG et le VP du développement de solutions pour...

  • big data developer

    1 week ago

    Montreal, Quebec, Canada Diamondpick Full time

    Job Title: Hadoop/Scala/Spark Developer Location: Montreal QC (Hybrid)Job Description:~5+ years of experience in software development, with a focus on Scala and Spark. ~ Strong proficiency in Scala programming language. ~ Extensive experience with Apache Spark, including Spark SQL, DataFrame/Dataset APIs, and Spark Streaming. ~ Solid understanding of...

  • Administrateur Big Data

    1 week ago

    Montreal, Quebec, Canada Talan Full time

    **A propos de Talan**Depuis plus de 20 ans, Talan conseille les entreprises et les administrations, les accompagne et met en œuvre leurs projets de transformation et d'innovation en France et à l'international. Le Groupe met l'innovation au cœur de son développement et intervient dans les domaines liés aux mutations technologiques des grands groupes,...

  • Administrateur Big Data

    1 week ago

    Montreal, Quebec, Canada Talan Full time

    Company DescriptionDepuis plus de 20 ans, Talan conseille les entreprises et les administrations, les accompagne et met en œuvre leurs projets de transformation et d'innovation en France et à l'international. Le Groupe met l'innovation au cœur de son développement et intervient dans les domaines liés aux mutations technologiques des grands groupes,...

  • Big Data Engineer

    1 week ago

    Montreal, Quebec, Canada Flare Full time

    We are a team of mission-driven people who want to enable companies to protect themselves against cyber crimes and we're damn passionate about it. We thrive on trust, operate with integrity and above all support our people so they can do their best work and be their best selves. A growing and innovative startup where we recognize your impact and will empower...

  • Big Data Cloud Developer

    1 week ago

    Montreal, Quebec, Canada Groupe SII Full time

    ABOUT THE JOB:As a Big Data Cloud Expert, you'll join a global central team spanning Montréal and Paris, responsible for our Data Lake platform on Microsoft Azure. Within this team, you'll serve as the primary contact for the AMER region, supporting teams across various business lines.Our Data Lake platform harnesses a blend of Open-Source technologies like...

  • Big Data Cloud Developer

    1 week ago

    Montreal, Quebec, Canada Talan Full time

    Company Description Talan est un cabinet de conseil en innovation et transformation par la technologie. Depuis plus de 20 ans, Talan conseille les entreprises et les administrations, les accompagne et met en œuvre leurs projets de transformation et d'innovation en France et à l'international. Présent sur cinq continents, le groupe prévoit de...

  • Big Data Administrator

    1 week ago

    Montreal, Quebec, Canada Talan Full time

    Company DescriptionFor 20 years, Talan has advised major companies and administrations, supported them, and implemented their transformation and innovation projects in France and abroad. The Group places innovation at the heart of its development and operates in areas related to technological changes, such as Big Data, IoT, Blockchain and Artificial...

  • Data & Analytics Engineering Lead

    1 week ago

    Montreal, Quebec, Canada Alexa Translations Full time

    Alexa Translations provides translation services in the legal, financial, and securities sectors by leveraging proprietary A.I. technology and a team of highly specialized linguistic experts. We are seeking a talented and experienced Data Team Lead to oversee our data team's operations. The ideal candidate will have a strong background in data collection,...

  • Lead Technique

    1 week ago

    Montreal, Quebec, Canada Northstar Data Full time

    Prefer reading this in English? Scroll down. À propos de NorthStar NorthStar Ciel & Terre utilise les données des télescopes optiques comme éléments de base pour créer des services d'information adaptés aux besoins et aux exigences des clients du gouvernement et de l'industrie. Le vaste portefeuille de développement de NorthStar comprend la...

  • Solutions Architect, Advanced analytics, Big Data

    1 week ago

    Montreal, Quebec, Canada Desjardins Full time

    As a Solutions Architect, Advanced analytics, Big DataYou actively monitor opportunities offered by new technologies and business approaches for the organization as a whole. You design solutions to meet the business needs of large-scale projects or programs based on architecture targets and supporting foundation. You ensure consistency with the...

  • Un (e) Developpeur (se) Big Data Cloud

    1 week ago

    Montreal, Quebec, Canada Talan Full time

    Description de l'entreprise Talan est un cabinet de conseil en innovation et transformation par la technologie. Depuis plus de 20 ans, Talan conseille les entreprises et les administrations, les accompagne et met en œuvre leurs projets de transformation et d'innovation en France et à l'international. Présent sur cinq continents, le groupe prévoit de...

  • Big Data Engineer

    1 week ago

    Montreal, Quebec, Canada The Aldo Group Inc. Full time

    The ALDO Group is committed to diversity and inclusion, not only now, but for the long term. We strongly encourage people who are Aboriginal, racialized, have disabilities, come from gender and sexually diverse communities and/or have intersectional identities to apply for employment with us. Summer Fridays (because Summer is for fun) Flex schedules and...

  • Lead Ingénieur Data/Cloud Azure

    1 week ago

    Montreal, Quebec, Canada Akkodis Full time

    Akkodis recherche pour son client, firme du domaine financier reconnue au Canada et à l'international, un(e) Lead Ingénieur Data/Cloud Azure (Solutions Designer) :Poste permanent directement chez le client finalEnvironnement majoritairement francophone, avec quelques meetings en anglaisPoste en hybride, bureau au centre-ville de MontréalÀ PROPOS DE...

  • Data Center Operator

    1 week ago

    Montreal, Quebec, Canada Estruxture Data Centers Full time

    La version française suit la version anglaise **_We host the data. We provide the connections. We protect the information.eStruxture is more than a data center: it's THE largest Canadian data center platform. It's 15 locations across the country, over 760,000 square feet of space, over 130MW of power and access to over 1,400 network and cloud service...

  • Senior Database Administrator

    1 week ago

    Montreal, Quebec, Canada Big Fish Games Full time

    Why Big Fish Games? Big Fish Games is the home of some of the biggest hit mobile casual games including EverMerge, Gummy Drop, Cooking Craze, Fairway Solitaire, and many more. We are curious and constantly seek improvement in all we do because that's what our business demands We operate with good intentions, confidence, and humility We welcome...

  • Data Center Infrastructure Manager

    1 week ago

    Montreal, Quebec, Canada Estruxture Data Centers Full time

    La version française suit la version anglaise **_We host the data. We provide the connections. We protect the information.eStruxture is more than a data center: it's THE largest Canadian data center platform. It's 15 locations across the country, over 760,000 square feet of space, over 130MV of power and access to over 1,400 network and cloud service...

  • Illustration Lead

    1 week ago

    Montreal, Quebec, Canada Big Fish Games, Inc. Full time

    Company SummaryProduct Madness is a Global Powerhouse where the greatest mobile games and experiences are crafted by world-class talent. A top-grossing leader in free to play mobile games, we have more than 800 team members working across seven global talent hubs including London (headquarters), USA, Canada, Spain, Poland and Ukraine. With remarkable hit...

  • Technical Lead Data

    1 week ago

    Montreal, Quebec, Canada QUANTEAM (Groupe RAINBOW PARTNERS) Full time

    QUANTEAM is a consulting firm specializing in the field of Finance.Guided by our core values of closeness, teamwork, diversity, and excellence, our team of 740 expert consultants, representing 35 different nationalities, collaborates across 10 international offices: We are currently seeking an ETL Technical Lead for an Investment Bank in MontréalA...