Ace Hardware-posted 2 months ago
$100,900 - $126,100/Yr
Full-time
Oak Brook, IL
5,001-10,000 employees
Building Material and Garden Equipment and Supplies Dealers

We are seeking a highly skilled Cloudera Hadoop Administrator (DBA) with hands-on experience managing and administering Databricks environments. This role requires deep expertise in maintaining enterprise-grade Hadoop clusters (Cloudera distribution), including performing backup and restore operations and supporting development, test, and production systems.

  • Manage and support Cloudera Hadoop clusters and services (HDFS, YARN, Hive, Impala, Spark, Oozie, etc.).
  • Perform cluster upgrades, patching, performance tuning, capacity planning, and health monitoring.
  • Secure the Hadoop platform using Kerberos, Ranger, or Sentry.
  • Develop and maintain automation and monitoring scripts.
  • Ingest data using tools such as Sqoop, NiFi, DEI Informatica, Qlik.
  • Support release and deployment activities, including deployment of new across Dev/Test and Production environments.
  • Integration of CI/CD pipelines (Git, or custom tooling) for automated code deployment.
  • Ensuring minimal downtime, rollback capability, and alignment with change management policies.
  • Maintain detailed release documentation, track changes in version control systems, and collaborate with development and operations teams to streamline deployment workflows.
  • Administer and maintain Databricks workspaces in cloud environments (Azure, or GCP).
  • Configure clusters, manage libraries, job scheduling, and workspace settings.
  • Enforce role-based access control (RBAC), integrate with SSO, and manage workspace security.
  • Monitor and optimize performance and cost across the Databricks platform.
  • Collaborate with teams to support data pipelines, ML workflows, and analytics use cases.
  • Integrate Databricks with cloud storage solutions (S3, ADLS) and Delta Lake.
  • Troubleshoot issues related to jobs, performance, or user access.
  • Maintain platform documentation and conduct user training.
  • Stay current with Databricks updates, new features, and best practices.
  • Support hybrid workflows between Hadoop and Databricks environments.
  • 4+ years of hands-on experience administering Cloudera Hadoop clusters.
  • 2-3+ years of Databricks experience in production environments.
  • 2+ years of Databricks administration experience on Azure (preferred).
  • Strong knowledge of Spark and Delta Lake architecture.
  • Experience with IAM, Active Directory, and SSO integration.
  • Familiarity with DevOps and CI/CD for data platforms.
  • Deep understanding of Hadoop ecosystem: Hive, Impala, Spark, HDFS, YARN.
  • Experience integrating data from DB2 to Hadoop/Databricks using tools like Sqoop or custom connectors.
  • Scripting skills in Shell and/or Python for automation and system administration.
  • Solid foundation in Linux/Unix system administration.
  • Experience with cloud technologies (Azure or GCP preferred).
  • Exposure to modern data lake and hybrid cloud architectures.
  • Cloudera and/or Databricks certifications.
  • Familiarity with infrastructure-as-code and automation tools (e.g., Terraform).
  • Experience supporting Oracle database administration (e.g., backups, user management, SQL tuning).
  • General DBA experience with other RDBMS (e.g., SQL Server, PostgreSQL, MySQL).
  • Incentive opportunities, based on role/grade level.
  • Generous 401(k) retirement savings plan with a fully vested matching contribution.
  • Comprehensive health coverage (medical, dental, vision and disability).
  • 21 days of vacation immediately available and up to 6 paid holidays.
  • Annual Ace Cares Week, 20 hours off work per year to volunteer.
  • On-site classes, facilitator-led courses, and a generous tuition assistance program.
  • Frequent campus events like Employee Appreciation Week.
  • Services such as mobile spas, auto maintenance, car wash and detailing.
  • Employee discounts on Ace merchandise and other services.
  • Birth/Adoption bonding paid time off.
  • Adoption cost reimbursement.
  • Employee Assistance Program (EAP).
  • Identity theft protection.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service