Bigdata Admin
4 months ago
Toronto, Canada
Themesoft Inc.
Full time
Role: Big Data Admin
Location: Toronto, ON
Responsibilities:
- Proficient operating Cloudera/Hortonworks Hadoop, HDFS/HBase/Yarn/Ranger/Spark/ZK, Ambari, Dremio, Druid, Airflow
- A strong grasp of fundamental concepts of Linux (Redhat), data engineering, network, warehouses, operational databases, messaging, and data management
- Good knowledge with Azure Databricks, Azure Data Factory, ADLS.
- Working knowledge of data migration from HDFS to ADLS using ADF.
- Experience with configuration management tools such as Salt, Ansible.
- Strong scripting skills with experience of platform automation using python/bash with version control system Git/Bitbucket
- Must have (Spark, Hadoop, Hbase, Kafka, Yarn, Airflow, Cloud),
- Good to have (Dynatrace, Splunk, DB/unix),
- Nice to have (Dremio else equivalent experience of working in Databricks will also work)
Regards
Praveen Kumar
Talent Acquisition Group – Strategic Recruitment Manager