Databricks Platform Administrator

SiloSmashers • Arlington, VA

9d • Onsite

About The Position

SiloSmashers, Inc. is hiring a Databricks Platform Administrator to support digital transformation efforts for a government customer. The selected candidate will be part of a team responsible for architecting, developing, optimizing, and maintaining high-performance data ingestion, transformation, streaming, and analytical pipelines within Databricks-enabled Lakehouse environments. The role collaborates closely with federal technical teams and cross-task platform, SRE, governance, privacy, and development personnel. Regular physical attendance at customer sites is required.

Requirements

• Ability to obtain and maintain a Public Trust clearance.
• Databricks Certified Platform Administration accreditation.
• Five or more years of recent experience administering cloud-based data platforms, including workspace configuration, identity/access management, and compute governance in Databricks, AWS, Azure, or equivalent environments.
• Bachelor’s degree in computer science, information systems, engineering, or a related field, or five or more years of equivalent experience in lieu of a degree.
• Regular, physical attendance at customer sites is required.
• Hands-on experience configuring and implementing cluster/job, pipeline, and SQL warehouse policies; experience working with secret scopes.
• Experience implementing SCIM/REST for identity and access management.
• Working knowledge of platform monitoring and observability tools, including Unity Catalog system tables, platform usage/DBU consumption, auditing user/group/service principal access and activity, and Lakehouse Monitoring.
• Experience conducting access and sharing policy audits and validating permissions against data-owner/steward-defined policies.
• Experience applying and enforcing tags for data and resources such as compute, jobs, pipelines, and Databricks Apps.
• Experience managing workspaces, clusters/pools, jobs, Unity Catalog objects, secret scopes, and cluster policies.
• Experience managing user accounts, service principals, and groups.

Responsibilities

• Configure and implement cluster/job, pipeline, and SQL warehouse policies, and work with secret scopes.
• Implement SCIM/REST for identity and access management.
• Use platform monitoring and observability tools, including Unity Catalog system tables, platform usage and DBU consumption data, access and activity auditing, and Lakehouse Monitoring.
• Conduct access and sharing policy audits; validate user, group, and data-asset permissions against data-owner/steward-defined policies and ensure consistent enforcement within and among enterprise platforms.
• Apply and enforce tags for data and resources, including compute, jobs, pipelines, and Databricks Apps.
• Manage workspaces, clusters/pools, jobs, Unity Catalog objects, secret scopes, and cluster policies.
• Manage user accounts, service principals, and groups.
• Support the architecture, development, optimization, and maintenance of data ingestion, transformation, streaming, and analytical pipelines in Databricks-enabled Lakehouse environments.
• Collaborate with federal technical teams and platform, SRE, governance, privacy, and development personnel.

What This Job Offers

• Job Type: Full-time