Cloud Systems Engineer (Databricks Administrator)

The Squires GroupWashington, DC
1dOnsite

About The Position

Our client is a financial institution providing the United States with a safe, flexible, and stable monetary system. They are seeking a Cloud Systems Engineer (Databricks Administrator) to serve as the hands-on technical owner of an enterprise Databricks platform supporting a large-scale Enterprise Data Platform (EDP). This role is responsible for end-to-end platform operations, security, governance, and cost management, ensuring the environment is compliant, reliable, and optimized to support secure analytics and AI/ML workloads at scale. This role is onsite in Washington, DC, and, per our client contract, candidates must be US Citizens or Green Card Holders that have lived in the US three out of the last five years.

Requirements

  • Bachelor’s Degree in related field
  • 7+ years of experience in cloud or data platform administration and operations.
  • 4+ years of experience supporting Databricks or similar data platforms.
  • Hands-on administration of Databricks platforms, including workspaces, jobs, SQL warehouses, runtimes, Unity Catalog governance, and serverless features.
  • Strong IAM and security expertise, including SSO/SCIM, RBAC, service principals, secrets management, audit logging, and least-privilege design.
  • Cloud platform proficiency (AWS preferred), including IAM, networking, object storage security, logging/monitoring, encryption, and cross-account access.
  • Experience with automation and DevOps practices using APIs, CLI tools, infrastructure-as-code (e.g., Terraform), CI/CD pipelines, Git integrations, and Databricks Asset Bundles.
  • Solid data platform and lakehouse knowledge, including Delta Lake, storage/compute separation, SQL performance tuning, and data engineering fundamentals (Python/Scala familiarity).
  • Experience implementing data governance, metadata, lineage, classification, and retention controls in regulated environments (e.g., FedRAMP, HIPAA, SOC 2).
  • Strong communication and stakeholder management skills, including operational reporting, service-level definition, and vendor coordination.
  • Per our client contract, candidates must be US Citizens and be able to pass the background check.

Nice To Haves

  • Databricks Platform Administrator or Databricks AWS Platform Architect Certification (preferred)
  • Databricks Certified Data Engineer (Associate or Professional) Certification (preferred)
  • AWS Certified Solutions Architect (Associate or Professional) Certification (preferred)

Responsibilities

  • Administer and standardize Databricks platforms across SDLC environments, including workspaces, jobs, SQL warehouses, runtimes, and configurations.
  • Operate and support the platform, providing monitoring, alerting, runbooks, Tier 2/3 incident response, root-cause analysis, and change management.
  • Enforce security, governance, and compliance through IAM, secrets management, audit logging, Unity Catalog administration, and governed data access.
  • Manage cloud integrations, secure connectivity, and external storage in coordination with cloud, network, and governance teams.
  • Implement cost controls, capacity planning, usage reporting, and optimization strategies.
  • Automate administration and deployments using APIs, CLI, infrastructure-as-code, and CI/CD pipelines (including Databricks Asset Bundles).
  • Optimize platform performance and reliability, including SQL tuning, autoscaling, Delta Lake optimization, and DLT pipeline health.Manage third-party integrations and support user onboarding, enablement, and self-service documentation.

Benefits

  • Benefits vary by compensation type and may include paid time off (PTO), medical, dental, and vision coverage, life insurance, long-term disability insurance, a 401(k) plan, and additional optional benefits.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service