Databricks Platform Engineer

McKesson•Columbus, OH

1d•Onsite

About The Position

The Databricks Platform Engineer is responsible for building, maintaining, and optimizing the cloud-based data platform that supports analytics, reporting, and data product development across the organization. This role focuses on the operational side of data engineering, including platform administration, infrastructure automation, data ingestion capabilities, governance implementation, and platform reliability. Working independently with limited direction, this individual partners with data engineers, architects, analysts, and business stakeholders to ensure the enterprise data platform remains scalable, secure, and efficient. The ideal candidate combines hands-on experience with Databricks administration, cloud infrastructure, and data engineering best practices to enable high-quality data solutions.

Requirements

Bachelor's degree in Computer Science, Information Systems, Engineering, or related field, or equivalent experience.
4+ years of experience in Data Engineering, Data Platform Engineering, Cloud Engineering, or related disciplines.
Experience administering Databricks environments.
Experience with Terraform and Infrastructure as Code practices.
Experience supporting Azure cloud services and infrastructure.
Experience developing and maintaining data ingestion solutions.
Strong SQL and troubleshooting skills.
Experience supporting production environments and operational workloads.
Understanding of data modeling, data governance, and modern data architecture concepts.

Nice To Haves

Experience with Unity Catalog and Databricks governance capabilities.
Experience supporting Azure Data Lake, Snowflake, or related cloud data technologies.
Experience with Python and data engineering automation.
Experience working in large-scale cloud analytics environments.
Experience supporting CI/CD and deployment automation practices.
Healthcare or regulated industry experience.

Responsibilities

Administer and maintain Databricks environments supporting enterprise analytics and data engineering workloads.
Manage platform configurations, cluster performance, capacity planning, and operational stability.
Monitor platform health and troubleshoot performance, reliability, and operational issues.
Support lifecycle management of platform resources across development, testing, and production environments.
Develop and maintain Infrastructure as Code solutions using Terraform.
Support cloud-based data infrastructure within Azure environments.
Implement automation to improve platform consistency, reliability, and operational efficiency.
Partner with infrastructure and security teams to ensure adherence to enterprise standards.
Build and support data ingestion frameworks and pipelines that enable reliable movement of data across platforms.
Collaborate with Data Engineers to improve platform capabilities and optimize data processing workloads.
Support structured and unstructured data workloads within cloud data environments.
Assist in identifying and resolving data performance bottlenecks.
Support data governance initiatives using Databricks Unity Catalog.
Implement and maintain data access controls, permissions, and governance standards.
Ensure compliance with organizational security and data management requirements.
Contribute to metadata, lineage, and data quality practices.
Evaluate new tools, technologies, and platform capabilities.
Recommend improvements that enhance scalability, reliability, and developer productivity.
Document platform standards, operational procedures, and support processes.
Participate in incident response, root cause analysis, and operational reviews.