Aws Big Data Technical Leader

2 weeks ago


Montréal, Canada Air Liquide Full time

**Company presentation**
- A world leader in gases, technologies and services for Industry and Health, Air Liquide is present in 78 countries with approximately 64,500 employees and serves more than 3.8 million customers and patients. Oxygen, nitrogen and hydrogen are essential small molecules for life, matter and energy. They embody Air Liquide’s scientific territory and have been at the core of the company’s activities since its creation in 1902.

**Entity and activity description**
Air Liquide’s ambition is to be a leader in its industry, deliver long term performance and contribute to sustainability - with a strong commitment to climate change and energy transition at the heart of its strategy. The company’s customer-centric transformation strategy aims at profitable, regular and responsible growth over the long term. It relies on operational excellence, selective investments, open innovation and a network organization implemented by the Group worldwide. Through the commitment and inventiveness of its people, Air Liquide leverages energy and environment transition, changes in healthcare and digitization, and delivers greater value to all its stakeholders.

Air Liquide’s revenue amounted to more than 20 billion euros in 2020. Air Liquide is listed on the Euronext Paris stock exchange (compartment A) and belongs to the CAC 40, EURO STOXX 50 and FTSE4Good indexes

**Missions and Responsibilities**
Within Americas Hub Data & BI Team, and reporting to the Data & BI Product Manager, the AWS Big Data Technical Leader designs, develops and industrializes “Big Data” Cloud-based solutions, highly distributed which fuels strategic business decisions across the organisation. They act as design authority for Big Data developments on the data lake, and play an active role in engineering data pipelines, integrations, transformation workflows and managing data lake infrastructure and related toolings. They define technological roadmap, and fosters Agile and DevOps methodologies. They contribute in successful delivery of ongoing and future projects, contribute in scale, run and maintenance of existing and future products, continuous improvement and automation of the Americas Data Platform.

**Responsibilities**:

- Work with product manager in defining the strategy and implementation of the data lake, ETL, ingestion tools and big data solutions that fuels strategic business decisions across the organization
- Assists in the execution of the Digital and IT roadmap
- Creates and implements a technical strategy to enable the infrastructure to scale to larger projects and teams
- Contributes to architecting complex big data solutions. Own the execution of the data lake engineering team, oversee process and delivery timelines to keep projects on schedule. Provide support for the data processing.
- Establish best practices for naming, governing, managing, modeling, cleansing, transforming,
- moving, storing, and searching all data. Define local norms for local purposes according to group recommendations
- Participates in selection of Big Data Engineers, trains and lead their developments on project, run and maintenance of products
- Leads a team of Big Data engineers who build data pipelines, integrations, transformation workflows and manage data lake/warehouse infrastructure and related tooling
- Ensure high levels of data quality across the related business areas. Establish SLAs for all data and processes. Develop data quality checks for source and target data sets.
- Establish SLAs for all data and processes.
- Foster an agile / devops methodology
- Work Closely with Air Liquide Data & BI teams around the globe: for centralized support ( security, etc...), and alignment in terms of architecture and product orientation, to propose new features for the core product
- Design and implement visualization and analysis tools, and automations, to facilitate the work of data developers, data scientists and data analysts
- Works with his/her team as well as with cross-functional teams to continuously improve work processes. Continuously analyses the functioning of the activity, identifies causes of dysfunctions and proposes corrective measures accordingly.

**Competencies and Profile**

**Required Qualifications**:

- Bachelors in Computer Sciences or Information Technology
- 4+ years of experience in Hadoop, Spark (PySpark, Scala), Python for data engineering and SQL
- 4 years of experience in Git development workflow, DevOps/CI-CD tools: JIRA, GitLab, GitLab CI, NEXUS, SonarQube
- 4+ years of experience in CloudFormation, IAM, Lambda, SQS, Athena, Airflow, EMR,
- Glue, S3, Unix
- 4+ years of experience in AWS DevOps
- 3+ years of experience with Docker and REST APIs

Required Certifications
- AWS Certified Big Data - Specialty
- AWS Certified Solutions Architect - Associate
- AWS Certified Developer - Associate
- _Agreeing to disclose your COVID-19 vaccination status, as a condition of employment._
- _Agreeing to be



  • Montréal, Canada CTConsultants Full time

    **CTC007190 - Big Data Advanced Visualization, Network Big Data CoE**: **Secteur industriel: Telecommunications**: **Type d'emploi: Contract**: **Durée: Eight months**: **Mode de travail: Mixed**: **Description**: IMPORTANT - What locations you would consider? Creekbank - If bilingual required, will interviews be held in French? NO, only English is enough -...


  • Montréal, Canada Kyndryl Full time

    **Who We Are** At Kyndryl, we design, build, manage and modernize the mission-critical technology systems that the world depends on every day. So why work at Kyndryl? We are always moving forward - always pushing ourselves to go further in our efforts to build a more equitable, inclusive world for our employees, our customers and our communities. **The...


  • Montréal, Canada CBCRadio-Canada Full time

    Job Family Media Production Primary Location Montreal Position Language Requirement French Only Language Skill Level (Reading) - Language Skill Level (Writing) - Language Skill Level (Speaking) Status of Employment Contract Work schedule(s) Full-time **Working at CBC/Radio-Canada** At CBC/Radio-Canada, we all have a story to tell. What’s yours? If...


  • Montréal, Canada NOVIPRO Full time

    Novipro is looking for a **Big Data Administrator**. This is a **12 month** renewable mandate for one of our well-known clients in the **banking** industry. This mandate is in **hybrid mode, a minimum of 2 days in the office** in downtown Montreal. Are you interested? **About this organization**: Our client is one of the leading European financial services...


  • Montréal, Canada It Unlock Full time

    **Job description**: **Required**: - Big Data Administrator (junior to intermediate for support) - Linux - Core HADOOP services **Some of those skills**: - HDFS - YARN - Kafka - Hbase - Hive - Spark - Ranger - SOLR - HUE - Knox - Kerberos - SSL - Shell programming - Ready to support shifts: one week out of three from 11 : 00 AM to 7:00 PM -...

  • Data Scientist Iii

    5 days ago


    Montréal, Canada Big Fish Games, Inc. Full time

    **Company Summary** Product Madness is a Global Powerhouse where the greatest mobile games and experiences are crafted by world-class talent. A top-grossing leader in free to play mobile games, we have more than 800 team members working across seven global talent hubs including London (headquarters), USA, Canada, Spain, Poland and Ukraine. With remarkable...


  • Montréal, Canada Amazon Web Services Canada, Inc. Full time

    Baccalauréat en informatique, en mathématiques ou dans une discipline connexe, ou 1+ année d'expérience professionnelle équivalente - 1+ année d'expérience en ingénierie technique - Maîtrise du français et de l'anglais - Puisque ce rôle nécessite que l’employé interagisse avec d’autres entités d’Amazon à l’échelle mondiale ainsi...


  • Montréal, Canada Google Full time

    **Minimum qualifications**: - Bachelor's degree in Computer Science or equivalent practical experience. - 6 years of experience in virtualization or cloud native architectures in a customer-facing or support role. - Experience with traditional Big Data technologies, Analytic Warehousing technologies, and data processing technologies, performance, and...


  • Montréal, Canada NOVIPRO Full time

    Novipro est à la recherche d'un **administrateur Big Data**. Il s'agit d'un mandat de **12 mois renouvelable **pour un de nos clients reconnus dans le domaine **bancaire.** Ce mandat est en **mode hybride, un minimum de 2 jours au bureau** au centre-ville de Montréal. Êtes-vous intéressé(e) ? **A propos de cette organisation**: Notre client est l'un...

  • Data Engineer

    2 weeks ago


    Montréal, QC HC S, Canada NTT DATA Full time

    At NTT DATA, we know that with the right people on board, anything is possible. The quality, integrity, and commitment of our employees have been key factors in our company's growth and market presence. By hiring the best people and helping them grow both professionally and personally, we ensure a bright future for NTT DATA and for the people who work here. ...