About the position
CLA is a top 10 national professional services firm where our purpose is to create opportunities every day, for our clients, our people, and our communities through industry-focused wealth advisory, digital, audit, tax, consulting, and outsourcing services. Even with more than 8,500 people, 130 U.S. locations, and a global reach, we promise to know you and help you. CLA is dedicated to building a culture that invites different beliefs and perspectives to the table, so we can truly know and help our clients, communities, and each other. CLA is growing and seeking to hire an experienced Lead Azure Databricks Platform Administrator to join our talented Information Technology team. The position offers growth, flexibility and a collaborative work environment.
Responsibilities
- Oversee the design, implementation, and maintenance of Databricks clusters.
- Ensure the platform's scalability, performance, and security.
- Develop and enforce policies and procedures for platform administration.
- Collaborate with leadership to align platform capabilities with business goals.
- Provide escalated support and troubleshooting to users.
- Oversee maintenance of role-based access to data and features in the Databricks Platform using Unity Catalog.
- Oversee implementation of external access controls for outside teams using service principles, SQL warehouses and Delta Sharing.
- Continuously improve processes and systems used to manage infrastructure, users and external access.
- Lead implementation of service principles and access tokens for external users.
- Oversee creation of queries and dashboards to monitor critical systems and processes.
- Review and maintain documentation for users and administrators.
- Automate common admin tasks using Databricks notebooks.
- Manage workflow tags, cluster tags, workflow naming convention enforcement.
- Review clusters health check and best practices implementation.
- Ensure regular backup and recovery.
- Oversee privilege reviews on users and resources.
- Stay current with industry trends and advancements in Databricks and cloud technologies.
- Lead and mentor a team of Databricks administrators.
- Provide training to junior members of the team and act as a point of escalation for complex questions and issues.
Requirements
- 6 years of relevant experience required.
- 1+ year experience with Databricks.
- Bachelor's degree in related field required (combination of education and experience may be considered in lieu of degree).
- Strong understanding of data engineering needs.
- Strong understanding of Azure infrastructure required by Databricks.
- Experience with compliance audits/audit documentation.
- Experience using Databricks APIs with tools like Postman.
- Understanding of the Databricks workspace and development environment.
- Experience using GitHub to manage source code.
- Strong SQL skills for creating admin related queries and dashboards.
- Strong debugging skills.
- Ability to do risk analysis for 3rd party integrations with Azure resources.
- Familiarity with Dynatrace.
- Proficiency in Spark, Python, SQL, and cloud platforms (AWS, Azure, or GCP).
Benefits
- Flexible PTO (designed to offer flexible time away for you!)
- Up to 12 weeks paid parental leave.
- Paid Volunteer Time Off.
- Mental health coverage.
- Quarterly Wellness stipend.
- Fertility benefits.
