Cloud Systems Engineer (Databricks Administrator)

The Squires Group
5d$80 - $84Onsite

About The Position

Our client is a financial institution providing the United States with a safe, flexible, and stable monetary system. They are seeking a Cloud Systems Engineer ( Databricks Administrator) to serve as the hands-on technical owner of an enterprise Databricks platform supporting a large-scale Enterprise Data Platform (EDP). This role is responsible for end-to-end platform operations, security, governance, and cost management, ensuring the environment is compliant, reliable, and optimized to support secure analytics and AI/ML workloads at scale. This role is onsite in Washington, DC, and, per our client contract, candidates must be US Citizens and be able to pass the background check.

Requirements

  • Bachelor's Degree in related field
  • 7+ years of experience in cloud or data platform administration and operations.
  • 4+ years of experience supporting Databricks or similar data platforms.
  • Hands-on administration of Databricks platforms, including workspaces, jobs, SQL warehouses, runtimes, Unity Catalog governance, and serverless features.
  • Strong IAM and security expertise, including SSO/SCIM, RBAC, service principals, secrets management, audit logging, and least-privilege design.
  • Cloud platform proficiency (AWS preferred), including IAM, networking, object storage security, logging/monitoring, encryption, and cross-account access.
  • Experience with automation and DevOps practices using APIs, CLI tools, infrastructure-as-code (e.g., Terraform), CI/CD pipelines, Git integrations, and Databricks Asset Bundles.
  • Solid data platform and lakehouse knowledge, including Delta Lake, storage/compute separation, SQL performance tuning, and data engineering fundamentals (Python/Scala familiarity).
  • Experience implementing data governance, metadata, lineage, classification, and retention controls in regulated environments (e.g., FedRAMP, HIPAA, SOC 2).
  • Strong communication and stakeholder management skills, including operational reporting, service-level definition, and vendor coordination.
  • Per our client contract, candidates must be US Citizens and be able to pass the background check.

Nice To Haves

  • Databricks Platform Administrator or Databricks AWS Platform Architect Certification (preferred)
  • Databricks Certified Data Engineer (Associate or Professional) Certification (preferred)
  • AWS Certified Solutions Architect (Associate or Professional) Certification (preferred)

Responsibilities

  • Administer and standardize Databricks platforms across SDLC environments, including workspaces, jobs, SQL warehouses, runtimes, and configurations.
  • Operate and support the platform, providing monitoring, alerting, runbooks, Tier 2/3 incident response, root-cause analysis, and change management.
  • Enforce security, governance, and compliance through IAM, secrets management, audit logging, Unity Catalog administration, and governed data access.
  • Manage cloud integrations, secure connectivity, and external storage in coordination with cloud, network, and governance teams.
  • Implement cost controls, capacity planning, usage reporting, and optimization strategies.
  • Automate administration and deployments using APIs, CLI, infrastructure-as-code, and CI/CD pipelines (including Databricks Asset Bundles).
  • Optimize platform performance and reliability, including SQL tuning, autoscaling, Delta Lake optimization, and DLT pipeline health.
  • Manage third-party integrations and support user onboarding, enablement, and self-service documentation.

Benefits

  • Benefits vary by compensation type and may include paid time off (PTO), medical, dental, and vision coverage, life insurance, long-term disability insurance, a 401(k) plan, and additional optional benefits.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service