Hadoop Adminintrator

Capgemini • Atlanta, GA

1d • Onsite

About The Position

We are looking for an experienced Hadoop Administrator MapR to manage and support our production-grade MapR Hadoop clusters. The ideal candidate will have hands-on experience running mission-critical, multi-tenant Hadoop environments, ensuring high availability, performance, and security across diverse workloads.

Requirements

• 4 years of hands-on experience as a Hadoop/MapR Administrator.
• Strong knowledge of MapR FS, MapRDB, MapR Streams, YARN, Hive, Spark, and Kafka.
• Experience managing production clusters with high availability requirements.
• Proficiency in Linux administration (RHEL/CentOS/Ubuntu).
• Expertise with multi-tenant Hadoop environments, resource governance, and user management.
• Strong skills in shell scripting, automation, and performance tuning.
• Experience with monitoring tools (Grafana, Nagios, Prometheus, MapR MCS).
• Understanding of Hadoop security (Kerberos, SSL, ACLs, AD integration).

Nice To Haves

• Experience migrating from MapR to other Hadoop distributions (Cloudera, Hortonworks) a plus.
• Knowledge of Cloud (AWS/Azure/GCP) big data services.
• Experience with CI/CD pipelines, DevOps tools, or containerized big data workloads.

Responsibilities

• Manage, monitor, and optimize MapR-based Hadoop clusters in a production environment.
• Oversee daily operations including cluster health checks, performance tuning, capacity planning, and system upgrades.
• Perform installation, configuration, patching, and version upgrades for MapR distributions and ecosystem tools.
• Configure, support, and optimize multi-tenant setups, ensuring isolation, resource fairness, and performance SLAs.
• Manage YARN queues, ACLs, quotas, and security policies per tenant requirements.
• Collaborate with data engineering and analytics teams to onboard new tenants and align resource needs.
• Diagnose and resolve cluster performance issues, bottlenecks, and failures across MapR FS, YARN, Spark, Hive, Kafka, and related services.
• Manage node failures, job failures, and cluster rebalancing while maintaining uptime.
• Automate alerting, monitoring, and reporting using tools like MapR Control System (MCS), Grafana, Nagios, Prometheus, or similar.
• Implement and manage security features such as Kerberos, Ranger/Sentry policies, SSL encryption, and user/role management.
• Ensure compliance with internal and external standards for data governance and security.
• Maintain reliable backup and DR strategies using MapR snapshots, mirrors, and failover configurations.
• Ensure 24/7 availability of production environments and participate in on-call rotation.
• Develop automation for operational tasks using Python, Shell scripting, or Ansible.
• Streamline cluster provisioning, monitoring, and deployment pipelines.

Benefits

• Paid time off based on employee grade (A-F), defined by policy: Vacation: 12-25 days, depending on grade, Company paid holidays, Personal Days, Sick Leave
• Medical, dental, and vision coverage (or provincial healthcare coordination in Canada)
• Retirement savings plans (e.g., 401(k) in the U.S., RRSP in Canada)
• Life and disability insurance
• Employee assistance programs
• Other benefits as provided by local policy and eligibility

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed