Senior Data Platform Engineer (Databricks, Python)
About The Position
CVS Health is seeking a Senior Data Platform Engineer to build, operate, and evolve its Azure Databricks data platform. The platform ingests, validates, and protects data for business-domain data engineering teams. It is operated as a software product: domain teams onboard through configuration, shared Python frameworks support ingestion, data quality, monitoring, and data protection, and changes are delivered through code review, automated testing, and CI/CD. This role combines software engineering and DevOps discipline with data engineering experience. The engineer will help develop shared platform capabilities, maintain deployment pipelines and infrastructure as code, support production operations and reliability, and work with domain teams to enable data-source onboarding and self-service. Production systems experience is particularly valued as the team shifts toward operations. The role may be performed remotely within the United States.
Requirements
- At least 3 years of progressive experience in software, platform, DevOps/SRE, or data engineering.
- At least 2 years building or operating cloud data platforms or production data systems.
- Strong Python skills, including packaging and writing modular, testable code with pytest.
- Experience with Git-based code review and building CI/CD pipelines for multi-environment deployments; GitHub Actions is preferred.
- Hands-on Terraform experience managing Azure and Databricks resources.
- Production experience with Spark/PySpark and SQL, including batch and incremental ingestion, schema evolution, medallion data modeling, and data-quality validation.
- Practical experience with Delta Lake, Unity Catalog, Databricks Jobs, and Delta Live Tables / Lakeflow.
- Working knowledge of ADLS Gen2, Entra ID, Key Vault, and cloud networking.
- Experience supporting production systems in a DevOps, SRE, or platform role, including monitoring and alerting, incident response, on-call, root-cause analysis, runbooks, and disaster-recovery planning.
- Clear communication and documentation skills, and ability to work effectively on a remote team with technical and business stakeholders.
- Bachelor's degree or equivalent practical experience.
Nice To Haves
- At least 6 years of progressive experience in software, platform, DevOps/SRE, or data engineering.
- Disciplined use of AI to accelerate development and analysis, applying the same engineering rigor and ownership to AI-assisted work as to other shipped work.
- Familiarity with healthcare payer data, including X12 834/837 or HL7, and HIPAA; HITRUST experience is a plus.
- Databricks or Azure certifications.
- Experience with Databricks Asset Bundles and system tables.
Responsibilities
- Build and maintain shared Python libraries and configuration-driven frameworks so domain teams can onboard and run pipelines with minimal platform assistance.
- Own GitHub Actions pipelines and the release process for promoting Databricks Asset Bundles from sandbox to production.
- Extend Terraform coverage of Azure and Databricks infrastructure.
- Support the production platform; enhance observability; triage incidents; lead root-cause analysis; and convert lessons learned into runbooks, automation, and permanent fixes.
- Track performance, reliability, and delivery metrics from data and platform perspectives.
- Maintain platform and data controls using Unity Catalog, and support sensitive-data protection and governance in a regulated healthcare environment.
- Partner with domain teams to onboard data sources, resolve escalated issues, and develop recurring needs into self-service features.
Benefits
- Medical coverage
- Dental coverage
- Vision coverage
- Paid time off
- Retirement savings options
- Wellness programs
- Other resources, based on eligibility
- Eligibility for a CVS Health bonus, commission, or short-term incentive program in addition to base pay
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
