Big Data Administrator

3 weeks ago


Canada IT Unlock Inc. Full time

**Roles and Responsibilities**:

- In a multi-cultural team installing, upgrading, configuring, maintaining and on a daily basis supervising/monitoring Hadoop clusters.
- The team also provides support to developers and integrators.
- Because security is key for us: setup security (Kerberos, AD, IDMP,SSL)
- As you don’t like to repeat the same task over and over: automate operations, installation and monitoring of the Hadoop Framework.
- Participate to the continuous evaluation of Hadoop infrastructure requirements and design/deploy solutions (high availability, big data clusters, hadoop in public cloud, etc)
- Because you always question yourself for the better: cluster Monitoring, Troubleshooting and Configuration
- As you know that evidences and traces are important in case of incident: manage and review Hadoop log files
- Part of a BigData feature team, key element of a Follow the Sun support it means you will work with Paris and Bangalore, deliver tasks of Agile Sprints and act upon incidents to ensure a 7/7 - 24/24 production.

**Minimum Requirements**:

- 4+ years of relevant professional experience in Unix and Linux Systems, server hardware, virtualization, RedHat
- At least 3 years of experience of Hadoop (HortonWorks or Cloudera)
- Proven experience with automation
- Knowledge of Ansible
- Excellent troubleshooting techniques
- Core HADOOP services ,HDFS, YARN, Kafka, Hbase, Hive, Spark, Ranger, SOLR, HUE, Knox, Kerberos, SSL, Linux, Shell programming.

**Job Types**: Full-time, Permanent

**Salary**: $50,000.00-$100,000.00 per year

**Benefits**:

- Dental care
- Employee assistance program
- Life insurance
- Paid time off
- Vision care

Schedule:

- 8 hour shift
- Day shift
- Monday to Friday
- No weekends

Supplemental pay types:

- Bonus pay

Ability to commute/relocate:

- Montréal, QC H3A 3M8: reliably commute or plan to relocate before starting work (required)

**Experience**:

- Hadoop: 3 years (preferred)
- Shell Scripting: 3 years (preferred)
- Linux: 3 years (preferred)
- Kafka: 3 years (preferred)
- HDFS: 3 years (preferred)
- Apache Hive: 3 years (preferred)
- HBase: 3 years (preferred)
- SSL: 3 years (preferred)
- Spark: 3 years (preferred)
- HUE: 3 years (preferred)

**Language**:

- French (required)


  • Big Data Expert

    1 day ago


    Canada Luxoft Full time

    Luxoft is a leading provider of software development and consulting services, leveraging expertise in modern technologies to deliver complex solutions. We are currently seeking a talented Big Data Developer to join our team in Pune.Job DescriptionThe successful candidate will work closely with other teams globally to develop new functionality for our...

  • Big Data Developer

    6 days ago


    Canada Luxoft Full time

    Project Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...

  • Big Data Developer

    1 day ago


    Canada Luxoft Full time

    Project Description: During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals. We are looking for a number of talented developers, who would like to...

  • Big Data Developer

    4 days ago


    Canada Luxoft Full time

    Project Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...


  • Canada OptiSource Ltd Full time

    Company Overview">OptiSource Ltd is a professional and agile organization with a strong focus on innovation.">Job Description">We are seeking an experienced Data Engineer to join our team and contribute to the design, development, and maintenance of data pipelines, data stores, and infrastructure.">Responsibilities include:">">Building entity extraction...


  • Canada Luxoft Full time

    Project Description:During the 2008 financial crisis, many big banks failed or faced issues due to liquidity issues. Lack of liquidity can kill any financial institution over the night. That's why it's so critical to constantly monitor liquidity risks and properly maintain collaterals.We are looking for a number of talented developers, who would like to join...

  • Big Data Engineer

    6 days ago


    Canada Sage Recruiting Full time

    Why Join Our TeamWe're on a mission to empower individuals to take control of their financial lives. As a Senior Data Engineer, you'll play a critical role in designing, implementing, and optimizing our data infrastructure and pipelines.Your Key ResponsibilitiesDesign and develop complex Python and SQL queries.Build and maintain ETL processes and data...

  • Big Data Developer

    2 weeks ago


    Canada Luxoft Full time

    Responsibilities:Building new components that will integrate with existing infrastructureBuilding components for data analysis and toolingLiaise with Bank internal development teams based in Canada and Poland to drive towards a world class applicationDeliver on time regulatory commitmentsBe proactive and ensure the software developed by the Team remains...


  • Canada Sage Recruiting Full time

    About the Role:We are seeking a highly skilled Senior Data Engineer to join our dynamic team.The ideal candidate will have 5-7 years of experience in data engineering, working with very large data sets, and a strong background in AWS, Python, and SQL.Responsibilities:Design and implement complex data infrastructure and pipelines.Develop and optimize Python...


  • Canada Smart Apartment Data Full time

    About the RoleWe are seeking an experienced Executive Administrative Assistant to join our team at Smart Apartment Data. The ideal candidate will be responsible for providing high-level administrative support to the CEO and the Founder, leading and coordinating key projects, and maintaining an efficient flow of information between all levels.The successful...


  • Canada TMF Group Full time

    About the JobTMF Group is looking for a skilled Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, implementing, and maintaining enterprise data solutions.Key ResponsibilitiesWork closely with cross-functional teams to design, implement, and maintain enterprise data solutionsDevelop and execute data ingestion pipelines...


  • Canada hireVouch Full time

    Develop and maintain scalable data pipelines using Python and SQL.Design and implement ETL processes for efficient data ingestion, transformation, and storage.Work extensively with AWS SageMaker to develop, train, and deploy machine learning models.Optimize data storage, retrieval, and performance in AWS Redshift.Collaborate with data scientists, analysts,...

  • Data Architect

    2 weeks ago


    Canada Tredence Inc. Full time

    Databricks ArchitectJob SummaryWe are seeking a highly skilled Databricks Architect to design, implement, and optimize data solutions on the Databricks platform. The ideal candidate will have deep expertise in cloud-based data engineering, big data processing, and analytics, and a strong understanding of data architecture principles. You will play a pivotal...


  • Canada Luxoft Full time

    We are looking for a skilled Big Data Developer to join our team in Pune and contribute to the development of our Liquidity Risk platform. The platform is designed to help investment banks manage liquidity risks and maintain collaterals efficiently.About the RoleIn this role, you will work on developing new functionality for the Liquidity Risk platform,...

  • Big Data Developer

    1 day ago


    canada | ca Luxoft Full time

    Responsibilities:Building new components that will integrate with existing infrastructureBuilding components for data analysis and toolingLiaise with Bank internal development teams based in Canada and Poland to drive towards a world class applicationDeliver on time regulatory commitmentsBe proactive and ensure the software developed by the Team remains...


  • Canada Quantiphi Full time

    About Us: Quantiphi is an award-winning Applied AI and Big Data software company, driven by a deep desire to solve transformational business problems. Our signature approach combines groundbreaking machine-learning research with disciplined cloud and data-engineering practices to create breakthrough impact at unprecedented speed.Job Overview: We are seeking...


  • Canada Luxoft Full time

    About Us:Luxoft is a leading provider of software development services and innovative digital solutions.Job Description:We are seeking an experienced Data Engineering Specialist to join our team. The ideal candidate will have a strong background in big data technologies and be able to design, develop, and deploy scalable data systems.Responsibilities:Design,...


  • Canada Zortech Solutions Full time

    **Our Vision**We aim to transform the Gen-AI industry by harnessing the power of data and Generative AI technology.

  • Data Engineer

    2 weeks ago


    Canada Summer Full time

    Title: Data EngineerLocation: Remote CanadaAbout this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the success...

  • Data Engineer

    1 week ago


    Canada Summer Full time

    Title: Data Engineer Location: Remote Canada About this Role: As a Data Engineer, you will play a crucial role in designing, building, and optimizing our data infrastructure. You'll be responsible for developing scalable data pipelines, implementing ETL processes, and ensuring the quality and integrity of our data. Your expertise will contribute to the...