Friday, July 28, 2017

Hadoop administration job in Mumbai for capgemini

Experience : 6-9 Years
Location : Mumbai
Mode : C2H (Contract based position)
Skill : Hadoop Admin
Account : Metlife

Job Description:

1. Responsible for implementation and ongoing administration of Hadoop

2. Aligning with the engineering team to propose and deploy new hardware and
software environments required for Hadoop and to expand existing

3. Working with AD teams to setup and monitor Hadoop users. This job
includes setting adding approved Active Directory Groups and testing HDFS,
Hive, Pig and MapReduce access..

4. Cluster maintenance as well as creation and removal of nodes using tools
using Ambari.

5. Performance tuning of Hadoop clusters and Hadoop MapReduce routines.

6. Screen Hadoop cluster job performances and capacity planning

7. Monitor Hadoop cluster connectivity and security

8. Manage and review Hadoop log files.

9. File system management and monitoring.

10. HDFS support and maintenance.

11. Diligently teaming with the infrastructure, network, database,
application and business intelligence teams to guarantee high data quality
and availability.

12. Collaborating with application teams to install operating system and
Hadoop updates, patches, version upgrades when required.

13. Database backup and recovery.

14. Database connectivity and security.

15. Performance monitoring and tuning.

Hadoop Administrator Skills:
1. General operational expertise such as good troubleshooting skills,
understanding of system?s capacity, bottlenecks, basics of memory, CPU, OS,
storage, and networks.

2. Hadoop skills like HDFS, YARN + MapReduce2, Hive, HBase, Pig, Sqoop,
Oozie, ZooKeeper, Flume, Ambari, Kafka, Knox, Slider, Solr, Spark etc.

3. The most essential requirements are: They should be able to deploy Hadoop
cluster, add and remove nodes, keep track of jobs, monitor critical parts of
the cluster,

4. configure name-node high availability, schedule and configure it and take

5. Good knowledge of Linux as Hadoop runs on Linux.

6. Familiarity with open source configuration management and deployment
tools such as Ambari and Linux scripting.

7. Knowledge of Troubleshooting Core Java Applications is a plus.