Senior Databricks Platform Engineer

General Dynamics Information Technology•USA DC Home Office (DCHOME), DC
•$186,542 - $252,380•Remote

About The Position

The Senior Databricks Platform Engineer will support GDIT’s Case Management Modernization (CMM) Program, an initiative supporting the Administrative Office of the U.S. Courts in developing a modern cloud-based solution for more than 204 federal courts. As part of the Data Modernization and Governance team, the engineer will help deliver integrated data governance, engineering, platform, reporting, analytics, and AI/ML capabilities for operational decision-making and the program’s data and analytics objectives. The role is responsible for designing, building, administering, optimizing, configuring, maintaining, and governing the Databricks Lakehouse Platform. This includes enabling scalable data engineering, analytics, and governance; managing platform performance, reliability, security, and cost; and collaborating with architecture, security, governance, and data engineering teams. The position also establishes platform standards and reusable engineering practices and provides technical guidance and mentorship to platform users and data engineers.

Requirements

  • At least 10 years of specialized experience; the qualifications section also specifies a MA/MS degree with 12 or more years of general experience and 10 or more years of specialized experience.
  • Education and experience alternatives listed: high school with 18 or more years, AA/AS with 16 or more years, BA/BS with 14 or more years, or doctorate/Ph.D. with 11 or more years. Experience may be considered in lieu of a degree as specified.
  • Strong hands-on experience implementing and administering the Databricks Lakehouse Platform, including Unity Catalog, cluster and SQL warehouse management, and job/workflow orchestration.
  • Experience in performance engineering, scalability testing, and tuning of a Databricks data platform.
  • Strong expertise in SQL, Spark performance tuning, and workload management.
  • Experience with performance and observability tools such as Grafana, Prometheus, Datadog, CloudWatch, or Elastic.
  • Hands-on experience with CI/CD pipelines such as Jenkins, GitLab CI, GitHub Actions, or Azure DevOps.
  • Proficiency in Python and Bash for automation, testing, and platform scripting; strong SQL skills.
  • Experience operating Databricks in AWS-based or hybrid cloud environments.
  • Familiarity with containerized environments such as Docker and Kubernetes, and with microservices patterns.
  • Experience with telemetry, logging standards, traceability, and root-cause analysis.
  • Ability to analyze large performance datasets to identify trends, issues, and optimization opportunities.
  • Experience with version control, build/release processes, and infrastructure-as-code automation.
  • Knowledge of data ingestion, ETL/ELT, lake/warehouse architectures, and distributed data processing.
  • Understanding of cloud security, IAM, access control, networking, and resource governance within Databricks and Unity Catalog.
  • Familiarity with federal security, compliance, and audit processes, including ATO and FedRAMP.
  • Strong troubleshooting skills and ability to optimize workload performance.

Nice To Haves

  • Databricks Certified Data Engineer Associate or Professional.
  • Databricks Certified Associate Platform Administrator.
  • Databricks Certified Machine Learning Professional.
  • Databricks Certified Associate Developer for Apache Spark.
  • Certified Data Management Professional (CDMP).
  • AWS Certified Data Analytics - Specialty.
  • AWS Certified Solutions Architect - Professional.
  • AWS Certified Data Engineer.
  • Docker Certified Associate.
  • Certified Professional DevSecOps Certification Course.
  • ITIL or AWS SysOps certification.

Responsibilities

  • Design, configure, and maintain the enterprise Databricks Lakehouse Platform, including workspaces, Unity Catalog, and scalable data architectures.
  • Administer and optimize Databricks compute, clusters, SQL warehouses, serverless capabilities, and workload management for performance, reliability, and cost efficiency.
  • Develop and optimize data pipelines, ETL/ELT processes, and ingestion frameworks using Apache Spark, Delta Lake, Delta Live Tables, and Databricks Workflows.
  • Create, maintain, and govern Unity Catalog catalogs, schemas, tables, roles, groups, and RBAC/access-control lists in accordance with AO security, IAM, and compliance policies.
  • Implement and manage Unity Catalog, RBAC, and data governance controls.
  • Automate platform provisioning, configuration, and deployments using Terraform, Python, SQL, Databricks Asset Bundles, and Databricks APIs.
  • Implement platform monitoring, logging, alerting, observability, capacity planning, and performance optimization.
  • Perform Spark and SQL performance tuning, scalability testing, and troubleshooting of platform, pipeline, and data-processing issues.
  • Implement cost optimization strategies such as autoscaling, auto-termination, right-sizing, and workload isolation; contribute to DBU consumption forecasting, financial reporting, and TCO analysis.
  • Support platform upgrades, patching, versioning, release management, and adoption of new Databricks capabilities.
  • Integrate Databricks with enterprise data sources, governance tools, BI platforms, and AI/ML environments.
  • Implement security, encryption, networking, auditing, compliance, and high-availability/disaster-recovery controls.
  • Support security audits, ATO activities, incident response, root-cause analysis, and operational reporting.
  • Establish platform standards, reusable engineering patterns, reference architectures, runbooks, and technical documentation.
  • Collaborate with architecture, security, governance, and data engineering teams and provide technical guidance and mentorship to platform users and data engineers.
  • Maintain cloud monitoring dashboards, capacity planning, and KPI metrics; evaluate new Databricks features and recommend adoption to improve performance, cost, or operability.

Benefits

  • Medical plan options, some with Health Savings Accounts.
  • Dental plan options.
  • Vision plan.
  • 401(k) plan with pre-tax and post-tax contributions and a company match.
  • Full flex work weeks where possible.
  • Paid time off plans, including vacation, sick and personal time.
  • Paid holidays.
  • Paid parental leave, including up to 160 hours in a rolling 12-month period for eligible employees.
  • Military, bereavement, and jury duty leave.
  • Typically 15 days of paid leave per calendar year for vacation, personal business, and illness, prorated based on hire date.
  • Typically 10 paid holidays per year, prorated based on hire date.
  • Short- and long-term disability benefits.
  • Life, accidental death and dismemberment, personal accident, critical illness, and business travel and accident insurance.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service