Sr Data Governance Engineer

Milwaukee Tool • Menomonee Falls, WI

317d

About The Position

The Sr Data Governance Engineer will be responsible for managing and optimizing the Unity Catalog in Databricks for our company. This role will oversee the implementation, maintenance, and continuous improvement of our data governance framework within the Databricks environment. Key responsibilities include organizing and structuring data assets, managing access controls and permissions, ensuring data lineage and metadata management, and implementing data quality and security measures. The specialist will collaborate closely with data engineering, analytics, and business teams to establish best practices for data management, enforce compliance policies, and enable secure and efficient data sharing across the organization. They will also play a crucial role in data discovery, cataloging, and the overall enhancement of our data ecosystem's visibility and usability through the effective utilization of Unity Catalog's features.

Requirements

• Bachelor's degree in a technical field or equivalent relevant experience.
• Strong written, verbal, analytical, and interpersonal skills.
• Extensive experience with Databricks and its ecosystem, including a deep understanding of Delta Lake, Spark, and data lakehouse architecture.
• Strong knowledge of data governance principles, practices, and frameworks, with a focus on implementing these in cloud-based environments.
• Familiarity with cloud platforms (preferably Azure, given Databricks' strong integration), including understanding of cloud storage systems and identity management.
• Excellent communication and collaboration skills, with the ability to work effectively with technical teams and explain complex concepts to non-technical stakeholders.
• Proficiency in SQL and at least one programming language commonly used in data engineering (e.g., Python, Scala).

Nice To Haves

• Advanced proficiency in Databricks Unity Catalog architecture, including deep understanding of its three-level namespace (metastore, catalog, schema).
• Strong expertise in cloud security and access control mechanisms, with ability to implement fine-grained permissions and governance strategies.
• Comprehensive knowledge of data engineering principles, including experience with Delta Lake, PySpark, and SQL programming.
• Proven ability to configure and manage compute resources compatible with Unity Catalog, understanding access modes and security requirements.

Responsibilities

• Implement and maintain the Unity Catalog structure, including creating and organizing catalogs, schemas, and tables to ensure efficient data management and governance.
• Manage access controls and permissions, utilizing Unity Catalog's comprehensive access control model to grant or revoke privileges for users, groups, and service principals.
• Configure and manage external locations and storage credentials, enabling secure access to data sources in external storage systems like Azure Blob Storage.
• Implement data security measures, including row and column-level security using dynamic views, to ensure users only access authorized data subsets.
• Oversee data lineage tracking and auditing capabilities provided by Unity Catalog, enhancing data governance and compliance efforts.
• Collaborate with data engineering, analytics, and business teams to establish best practices for data management, enforce compliance policies, and enable secure data sharing across the organization.

Benefits

• Robust health, dental and vision insurance plans.
• Generous 401 (K) savings plan.
• Education assistance.
• On-site wellness, fitness center, food, and coffee service.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Machinery Manufacturing
• Education Level: Bachelor's degree