Hadoop Administrator

Full-time Other-General

Hadoop Admin • Primary skills:Technology->Big Data - Hadoop->Hadoop Administration Experience with cloud-based Hadoop (AWS EMR, Azure HDInsight, GCP Dataproc) Knowledge of DevOps practices (CI/CD, Docker, Kubernetes) Experience in high availability (HA) and disaster recovery (DR) setups Cluster Management Install, configure, and maintain Hadoop clusters (Cloudera, Hortonworks, or Apache Hadoop) Manage core components including HDFS, YARN, MapReduce Perform cluster scaling, upgrades, and patching Administration & Monitoring Monitor cluster performance, health, and usage Troubleshoot and resolve cluster issues, failures, and bottlenecks Implement alerting and monitoring tools (Ambari, Cloudera Manager, Grafana) Security & Governance Configure and manage Kerberos authentication Implement data security policies using Ranger / Sentry Handle user access controls and permissions Data Management Manage data storage, replication, and backup strategies Optimize HDFS performance and storage utili...