Hadoop Administrator
1 month ago
Job Title**:Hadoop Administrator**
**Location**: Toronto, Canada (2 Days Onsite Per Week)
**Job Type**: Contract
**Salary**: Competitive (Depending on experience)
As a **Hadoop Admin**, you will work closely with data engineers, data scientists, and other IT teams to ensure the optimal performance of our big data infrastructure. This position is hybrid, with 2 days required onsite per week in Toronto, with the remaining work being done remotely.
**Responsibilities**:
- **Hadoop Cluster Management**:
- Install, configure, and maintain Hadoop clusters (HDFS, YARN, MapReduce).
- Troubleshoot and resolve issues in the Hadoop environment.
- Monitor and optimize Hadoop cluster performance to ensure high availability and fault tolerance.
- **System Administration**:
- Manage and monitor Hadoop ecosystem components (e.g., Hive, HBase, Spark, Pig, Zookeeper).
- Manage security and access controls for Hadoop (Kerberos, Ranger, etc.).
- Perform backups and disaster recovery planning.
- **Performance Tuning**:
- Tune Hadoop clusters for optimal performance and scalability.
- Work with developers and engineers to optimize big data workloads.
- **Automation and Scripting**:
- Write and maintain scripts (e.g., Bash, Python) for automation and job scheduling.
- Automate Hadoop maintenance tasks, including cluster health checks and data backups.
- **Collaboration & Support**:
- Work closely with data engineers, DevOps, and other teams to support data pipelines and analytics platforms.
- Provide support for data ingest, ETL processes, and batch processing jobs.
- Document procedures and best practices.
- **Upgrade and Patching**:
- Plan and execute Hadoop upgrades and patches without causing system downtime.
- Maintain software versioning and ensure compatibility with different components.
- **Capacity Planning and Monitoring**:
- Plan for future hardware and software requirements based on anticipated data growth.
- Implement monitoring tools and dashboards for real-time cluster performance monitoring.
**Qualifications**:
- **Education**:
- Bachelor's degree in Computer Science, Information Technology, or a related field. Equivalent work experience will also be considered.
- **Experience**:
- 3+ years of hands-on experience as a Hadoop Administrator in large-scale environments.
- Strong knowledge of **Hadoop ecosystem** (HDFS, YARN, MapReduce, Hive, HBase, Pig, etc.).
- Experience with **Apache Spark** for data processing is highly preferred.
- Familiarity with **Big Data frameworks** such as **Kafka**, **Flink**, **Cassandra** is a plus.
- Experience with **Hadoop cluster management tools** (e.g., Cloudera, Hortonworks, or MapR).
- Experience with **containerization** and **orchestration** tools like **Docker** and **Kubernetes** is a plus.
- **Skills**:
- Strong understanding of **Linux/Unix-based systems** and shell scripting.
- Experience with **cloud platforms** (AWS, Azure, GCP) for managing Hadoop clusters.
- Proficiency in **Java** or **Python** for writing scripts or tools.
- Familiarity with **monitoring and alerting tools** like **Nagios**, **Ganglia**, or **Ambari**.
- Ability to troubleshoot system issues and perform root cause analysis.
- Strong communication skills and ability to collaborate with cross-functional teams.
- **Certifications**:
- Certifications in **Hadoop**, **Cloudera**, or related Big Data technologies are a plus.
Pay: $75.00-$80.00 per hour
**Benefits**:
- Dental care
Schedule:
- 8 hour shift
-
Hadoop Administrator
2 weeks ago
Toronto, Canada Atlantis IT group Full time**Role: Hadoop Administrator** **Location: Toronto, ON** **Duration - Long Term** Must have previous and current working experience with HDP platform/Hadoop along with Linux OS, since HDP tool is deployment in Linux environment. Experience working with Hadoop stack. Preferably with **Responsibilities**: Thanks & Regards, Harshaja Apptoza...
-
Hadoop Administrator
5 days ago
Toronto, Canada Atlantis IT group Full time**Role: Hadoop Administrator** **Location: Toronto, ON** **Duration - Long Term** **Must have previous and current working experience with HDP platform/Hadoop along with Linux OS, since HDP tool is deployment in Linux environment.*** Experience working with Hadoop stack. Preferably with **Responsibilities**: **Good collaboration & communication skills,...
-
Hadoop Administrator
6 days ago
Toronto, Canada Atlantis IT group Full time**Role: Hadoop Administrator** **Location: Toronto, ON** **Duration - Long Term** **Must have** previous and current working experience with **HDP platform/Hadoop along with Linux OS, since HDP tool is deployment in Linux environment.** Experience working with Hadoop stack. Preferably with **Responsibilities**: **Good collaboration & communication...
-
Hadoop Administrator
3 months ago
Toronto, Canada LTIMindtree Full time**Hadoop Admin** **Full Time** **Toronto, ON - Hybrid** **Below is the Job description for this role**: Require Sr. Hadoop Admin who has strong experience to install, configure, and set up Hadoop Stack end-to-end on Azure Cloud and good to have other cloud experience. - **Expert in E2E installation, configuration, tuning, and troubleshooting** Hadoop...
-
Hadoop Administrator
2 months ago
Toronto, Canada TekisHub Consulting Services Full time**Below is the Job description for this role**: Require Sr. Hadoop Admin who has strong experience to install, configure and setup Hadoop Stack end to end on Azure Cloud and good to have experience in JENKINS & DevOps CI/CD. - Expert in E2E installation, configuration, tuning, and troubleshooting Hadoop stack, including HDFS, YARN, MapReduce, Hive, HBASE,...
-
Hadoop Administrator
2 weeks ago
Toronto, Canada ELITS Full timeELITS Canada Inc. is a subsidiary to ELITS Consulting AB. ELITS is a culture-driven, IT company founded in 2006, with a major focus on the operation of IT environments. ELITS provides a global delivery model, with 24/7 commitments of managed services, packaged IT services and consulting. Through good industry knowledge, innovation, commitment and...
-
Hadoop Administrator
7 months ago
Toronto, Canada AstraNorth Full time**Key Skills**: - **Building Hadoop Clusters, upgrading HDP/CDP Clusters.**: - Implementation of DR Solution for Production Hadoop /CDP - Commissioning /Decomissioning Data nodes and Production cluster replication to DR Cluster - Supporting PostgreSQL, MYsql, Maria DB. **Job Types**: Full-time, Permanent, Fixed term contract Schedule: - 8 hour shift -...
-
Hadoop Admin
7 months ago
Toronto, Canada Zortech Solutions Full timeJob Overview: We are seeking a skilled Hadoop Admin to join our team. As a Hadoop Admin, you will be responsible for managing and maintaining our Hadoop infrastructure, ensuring its smooth operation and optimal performance. You will work closely with our development and data analytics teams to support their needs and ensure the efficient processing of big...
-
Cloudera Hadoop Admin
7 months ago
Toronto, Canada AlphaForce Technology Solutions Full timeRole: Cloudera Hadoop Admin Location: Ontario, Canada (Hybrid) Cloudera Hadoop Admin JD: - 10+ years in Hadoop administration - Strong experience in administration of large & complex Cloudera Hadoop environments - Certification in Cloudera Hadoop administration - Strong performance optimization skills with large Hadoop clusters - Experience in On-call...
-
Hadoop Administrator
5 days ago
Toronto, Canada Scotiabank Full timeRequisition ID: 170071 Join a purpose driven winning team, committed to results, in an inclusive and high-performing culture. **Looking for a hybrid role? We have the job for you! Our employees in hybrid roles can alternate between work from home & onsite in the office with the details to be determined, based on business needs.** **The team**: **The...
-
Highly Skilled Hadoop Cluster Engineer
4 weeks ago
Toronto, Canada Avanciers Full timeAbout AvanciersWe are a leading provider of innovative data solutions, and we're looking for a highly skilled Hadoop cluster engineer to join our team.Job SummaryThis is a full-time role that requires strong expertise in managing and optimizing disk space, backup and recovery procedures, performance observation and fine-tuning, software installation and...
-
Hadoop Admin @ Toronto,on
7 months ago
Toronto, Canada Atlantis IT group Full time**Role : Hadoop Admin** **Location: Toronto, ON** **Duration : Long Term** Skills and Responsibilities: Netezza appliance administration. Monitoring hardware of the appliance and networks connected to the appliance. Platform and firmware upgrade with assistance from IBM Support. Work with IBM Support to fix any hardware issues such as Disk failures, SPU...
-
Talend Etl Administrator
4 days ago
Toronto, Canada Arthur Grand Technologies Full timeExperience in Talend Studio, Talend Administration Center, Talend Big Data - Experience in template and code reuse practice. - Experience in Java programming - Experience in Hadoop/Big data implementation using talend - Experience in analyzing AMC tables and generating automated performance reports - Experience in developing code scanning utilities for...
-
Contract Administrator
2 weeks ago
Toronto, ON, Canada Avanciers Full timeHi, Role : Senior Hadoop Admin Location: Toronto, ON (Hybrid) Full time Role Below is the Job description for this role: Managing and optimizing disk space for data handling Backup and recovery procedure of database Performance observation and fine-tuning on the data pattern changes Software installation and configuration Data...
-
Netezza Admin
7 months ago
Toronto, Canada Zortech Solutions Full timeBuilding Hadoop Clusters, upgrading HDP/CDP Clusters. - Implementation of DR Solution for Production Hadoop /CDP - Commissioning /Decomissioning Data nodes and Production cluster replication to DR Cluster - Supporting PostgreSQL, MYsql, Maria DB. **Salary**: $140,000.00 per year **Benefits**: - Dental care - Extended health care - Paid time...
-
Lead Administrator
1 month ago
Toronto, Canada Wipro Limited Full timeToronto, Canada - Tech Hiring - 3122535 **About Wipro** - Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. - We leverage our holistic portfolio of capabilities in consulting, design,...
-
Lead Administrator
1 month ago
Toronto, Canada Wipro Limited Full timeOverview: **About Wipro** Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients’ most complex digital transformation needs. We leverage our holistic portfolio of capabilities in consulting, design, engineering, operations, and emerging...
-
Big Data Administrator
5 days ago
Toronto, Ontario, Canada Epsilon Solutions Ltd. Full timeEpsilon Solutions Ltd. is looking for a highly skilled Big Data Administrator to join our team.The estimated salary for this role is $120,000 - $180,000 per year, depending on experience and qualifications.About the Job:Manage and optimize disk space for efficient data handlingDevelop and implement backup and recovery procedures for databasesOversight of...
-
Data Administrator
2 weeks ago
Toronto, Canada Badal.io Inc Full time**Management Systems (erp or db)**: - XBase - Siebel - SAP (FI/CO / HR / MM / OT SD) - Paradox - MySQL - MS Access - MS SQL Server - MS Visual FoxPro - Informix - JD Edwards - Sybase - PeopleSoft - Data Warehouse - Dbase Plus **Hardware Development**: - JVM (Java Virtual Machine) **Work Setting**: - Research and development institution - Server farm -...
-
Platform Support
16 hours ago
Toronto, Canada Atlantis IT group Full time**Role: Platform Support** - **Advanced Analytics** **Location: Toronto, ON** **Duration - Long Term** Role and Responsibilities Production Support of ETL, ML/AI jobs Installing and configuring Open source Python/R libraries Working with business on enabling new workflows (new data sources, models, new api) Building platform monitoring scripts...