Databricks on Azure Administrator (Onsite Hybrid)

NTT DATAAtlanta, GA
3dHybrid

About The Position

Provision, configure, and operate Azure Databricks environments across development and production Design and maintain PCI DSS-compliant data architectures for analytics and data processing workloads Implement and enforce enterprise security, governance, and access controls using Azure IAM and Databricks Unity Catalog Manage role-based access, data masking, lineage, and audit logging to meet regulatory and risk requirements Standardize environment configuration and promotion using cluster policies, CI/CD pipelines, and Infrastructure as Code Integrate Databricks audit logs and telemetry with Azure Monitor and Log Analytics for compliance-ready observability Partner closely with security, risk, compliance, and data engineering teams to support audits and regulatory reviews Support incident response, root cause analysis, and production issue resolution Maintain operational documentation, runbooks, and governance standards Work on-site in the Atlanta office 3 days per week to support collaboration with engineering and compliance stakeholders

Requirements

  • 8+ years of experience administering enterprise data platforms in cloud environments
  • 5+ years of hands-on experience with Azure Databricks in production environments
  • 5+ years of strong experience with: Azure Databricks Delta Lake Unity Catalog
  • 5+ years of strong understanding of Azure identity and security services, including: Azure AD / Entra ID Managed Identities Azure Key Vault
  • 5+ years of experience with Azure storage and networking: ADLS Gen2 Private Endpoints VNET Injection
  • Experience implementing CI/CD pipelines using Azure DevOps or GitHub Actions
  • Hands-on experience with Infrastructure as Code (Terraform and/or ARM templates)
  • Proven experience operating in PCI DSS-compliant environments
  • Strong documentation and operational runbook creation skills
  • Exposure to incident management and production support models
  • Ability and willingness to work on-site in Atlanta 3 days per week (mandatory)

Nice To Haves

  • Prior experience in the payments, banking, or financial services industry
  • Experience supporting regulated or audit-heavy data platforms
  • Familiarity with cost management and performance optimization in Databricks
  • Experience working directly with security, risk, and compliance teams

Responsibilities

  • Provision, configure, and operate Azure Databricks environments across development and production
  • Design and maintain PCI DSS-compliant data architectures for analytics and data processing workloads
  • Implement and enforce enterprise security, governance, and access controls using Azure IAM and Databricks Unity Catalog
  • Manage role-based access, data masking, lineage, and audit logging to meet regulatory and risk requirements
  • Standardize environment configuration and promotion using cluster policies, CI/CD pipelines, and Infrastructure as Code
  • Integrate Databricks audit logs and telemetry with Azure Monitor and Log Analytics for compliance-ready observability
  • Partner closely with security, risk, compliance, and data engineering teams to support audits and regulatory reviews
  • Support incident response, root cause analysis, and production issue resolution
  • Maintain operational documentation, runbooks, and governance standards
  • Work on-site in the Atlanta office 3 days per week to support collaboration with engineering and compliance stakeholders
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service