Databricks Platform Administrator, Sr SME

SiloSmashers • Arlington, VA

5d • $150 - $169 • Onsite

About The Position

SiloSmashers is hiring a Databricks Platform Administrator to support digital transformation efforts for a government customer. The selected candidate will be part of a team responsible for architecting, developing, optimizing, and maintaining high-performance data ingestion, transformation, streaming, and analytical pipelines within Databricks-enabled Lakehouse environments. The role involves close collaboration with federal technical teams and cross-task platform, SRE, governance, privacy, and development personnel.

The position requires regular, physical attendance at customer sites. The candidate must be able to obtain and maintain a Public Trust clearance and hold Databricks Certified Platform Administration accreditation.

Requirements

• Ability to obtain and maintain a Public Trust clearance.
• Databricks Certified Platform Administration accreditation.
• At least 8 years of experience administering cloud-based data platforms, including workspace configuration, identity and access management, and compute governance in Databricks, AWS, Azure, or equivalent environments; at least 5 years must be within the last 8 years.
• Bachelor's degree in computer science, information systems, engineering, or a related field, or at least 5 years of equivalent experience in lieu of a degree.
• Hands-on experience configuring and implementing cluster/job, pipeline, and SQL warehouse policies; experience working with secret scopes.
• Experience implementing SCIM/REST for identity and access management.
• Working knowledge of platform monitoring and observability tools, including Unity Catalog system tables, platform usage and DBU consumption, auditing user/group/service principal access and activity, and Lakehouse Monitoring.
• Experience conducting access and sharing policy audits and validating permissions against data-owner- or steward-defined policies.
• Experience applying and enforcing tags for data and resources such as compute, jobs, pipelines, and Databricks Apps.
• Experience managing workspaces, clusters/pools, jobs, Unity Catalog objects, secret scopes, cluster policies, user accounts, service principals, and groups.
• Regular, physical attendance at customer sites is required.

Responsibilities

• Configure and implement cluster/job, pipeline, and SQL warehouse policies, and work with secret scopes.
• Implement SCIM/REST for identity and access management.
• Use platform monitoring and observability tools, including Unity Catalog system tables, platform usage and DBU consumption information, access and activity auditing, and Lakehouse Monitoring.
• Conduct access and sharing policy audits and validate user, group, and data-asset permissions against data-owner- or steward-defined policies; ensure policies are consistently enforced within and among enterprise platforms.
• Apply and enforce tags for data and resources, including SQL warehouses, classic and serverless compute, jobs, pipelines, and Databricks Apps.
• Manage workspaces, clusters and pools, jobs, Unity Catalog objects, secret scopes, and cluster policies.
• Manage user accounts, service principals, and groups.
• Collaborate with federal technical teams and cross-task platform, SRE, governance, privacy, and development personnel.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior