Databricks Platform Administrator

SiloSmashers • Arlington, VA

7d • Onsite

About The Position

SiloSmashers is hiring a Databricks Platform Administrator to support digital transformation efforts for a government customer. The selected candidate will be part of a team responsible for architecting, developing, optimizing, and maintaining high-performance data ingestion, transformation, streaming, and analytical pipelines within Databricks-enabled Lakehouse environments. The role collaborates closely with federal technical teams and personnel across platform, SRE, governance, privacy, and development functions. Regular physical attendance at customer sites is required.

Requirements

• Databricks Certified Platform Administration accreditation.
• At least five years of recent experience administering cloud-based data platforms, including workspace configuration, identity and access management, and compute governance in Databricks, AWS, Azure, or equivalent environments.
• Bachelor's degree in computer science, information systems, engineering, or a related field, or at least five years of equivalent experience in lieu of a degree.
• Ability to obtain and maintain a Public Trust clearance.
• Regular physical attendance at customer sites is required.
• Hands-on experience configuring and implementing cluster/job, pipeline, and SQL warehouse policies.
• Experience working with secret scopes.
• Experience implementing SCIM/REST for identity and access management.
• Working knowledge of platform monitoring and observability tools, such as Unity Catalog system tables, platform usage and DBU consumption, auditing user/group/service principal access and activity, and Lakehouse Monitoring.
• Experience conducting access and sharing policy audits and validating permissions against data-owner- or steward-defined policies.
• Experience applying and enforcing tags for data and resources, including compute, jobs, pipelines, and Databricks Apps.
• Experience managing Databricks workspaces, clusters/pools, jobs, Unity Catalog objects, secret scopes, cluster policies, user accounts, service principals, and groups.

Responsibilities

• Configure and implement cluster, job, pipeline, and SQL warehouse policies.
• Work with secret scopes and implement SCIM/REST for identity and access management.
• Use platform monitoring and observability tools, including Unity Catalog system tables, platform usage and DBU consumption information, access and activity auditing, and Lakehouse Monitoring.
• Conduct access and sharing policy audits, validate user, group, and data-asset permissions against data-owner- and steward-defined policies, and ensure consistent enforcement across enterprise platforms.
• Apply and enforce tags for data and resources, including compute, jobs, pipelines, and Databricks Apps.
• Manage workspaces, clusters and pools, jobs, Unity Catalog objects, secret scopes, and cluster policies.
• Manage user accounts, service principals, and groups.
• Support the architecture, development, optimization, and maintenance of data ingestion, transformation, streaming, and analytical pipelines in Databricks-enabled Lakehouse environments.
• Collaborate with federal technical teams and platform, SRE, governance, privacy, and development personnel.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level