Databricks Administrator

San R&D Business Solutions LLC • Austin, TX

4d • Hybrid

About The Position

We are seeking a Databricks Administrator to manage, configure, and support the Databricks platform in a cloud environment (AWS). This role focuses on ensuring platform reliability, security, governance, and cost optimization while enabling scalable data engineering, analytics, and AI/ML workloads.

This role is ideal for experienced Databricks administrators with strong AWS, Spark, and governance expertise, looking to support large-scale data and analytics platforms in a regulated environment.

Requirements

• 8+ years of experience administering Databricks in AWS environments
• Strong expertise in: Cluster configuration and workspace management Job scheduling and orchestration
• 8+ years of hands-on experience with: IAM, SCIM, RBAC Apache Spark (performance tuning & troubleshooting)
• Experience integrating with AWS S3 and cloud storage
• Strong knowledge of: Platform monitoring and performance optimization Data security, encryption, and compliance
• Experience with DevOps/automation tools (Terraform, CI/CD, scripting)
• Familiarity with Databricks SQL, notebooks, and workflows

Nice To Haves

• Experience in enterprise or government environments
• Hands-on with Unity Catalog (data governance)
• Knowledge of cost optimization strategies for Databricks
• Experience supporting AI/ML workloads (Databricks ML, MLflow)
• Understanding of data lake / lakehouse architectures
• Knowledge of Python, SQL, or Scala

Responsibilities

• Administer and manage Databricks workspaces in AWS cloud environments
• Configure and manage clusters, job scheduling, and workspace settings
• Implement and maintain RBAC, IAM, and SCIM-based access controls
• Enforce cluster policies and governance standards
• Monitor platform performance, health, and availability
• Integrate Databricks with cloud storage services (e.g., S3)
• Optimize Spark workloads and performance tuning
• Support data engineers, analysts, and data scientists
• Ensure data security, encryption, and compliance requirements
• Automate processes using Terraform, CI/CD pipelines, and scripting
• Support notebooks, Databricks SQL, and job orchestration workflows

What This Job Offers

• Career Level: Mid Level
• Education Level: No Education Listed