Bigdata Admin

4 months ago


Toronto, Canada Themesoft Inc. Full time

Role: Big Data Admin

Location: Toronto, ON


Responsibilities:

  • Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, Airflow
  • A strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data management
  • Good knowledge with Azure Databricks, Azure Data Factory, ADLS.
  • Working knowledge of data migration from HDFS to ADLS using ADF.
  • Experience with configuration management tools such as Salt, Ansible.
  • Strong scripting skills with experience of platform automation using python/bash with version control system Git/Bitbucket
  • Must have (Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud),
  • Good to have (Dynatrace, Splunk, DB/unix),
  • Nice to have (Dremio else equivalent experience of working in Databricks will also work)



Regards

Praveen Kumar

Talent Acquisition Group – Strategic Recruitment Manager