Data Engineer

AnewHealth

1d•Remote

About The Position

AnewHealth is one of the nation’s leading pharmacy care management companies that specializes in caring for people with the most complex, chronic needs—wherever they call home. We enable better outcomes for patients and the healthcare organizations who support them. Established in 2023 through the combination of ExactCare and Tabula Rasa HealthCare, we provide a suite of solutions that includes comprehensive pharmacy services; full-service pharmacy benefit management; and specialized support services for Program of All-Inclusive Care for the Elderly. With over 1,400 team members, we care for more than 100,000 people across all 50 states. Job Objective: The Data Engineer will design, build, and support the data pipelines that power our analytics, reporting, and operational systems. This role's primary focus is developing and maintaining data pipelines within our Databricks environment, serving as an escalation point when production pipeline issues arise, and leading the migration of existing Azure Data Factory workflows and Azure Functions into Databricks. The individual is a hands-on engineer who is comfortable owning pipelines end to end — from design and development through troubleshooting and optimization — and who can work cross-functionally with data architects, analysts, and business stakeholders.

Requirements

3+ years of experience as a Data Engineer building and supporting production data pipelines.
Hands-on experience developing data pipelines in Databricks, including PySpark, Delta Lake, and Databricks Workflows/Jobs.
Experience with Azure Data Factory and/or Azure Functions, with the ability to interpret existing ADF pipelines/Functions and re-implement them in Databricks.
Strong SQL skills, including query optimization and experience with relational and dimensional data models.
Proficiency in Python for data engineering and pipeline automation.
Working knowledge of the broader Azure cloud ecosystem (e.g., Azure Data Lake Storage, Azure SQL Database, Azure Key Vault).
Solid understanding of ETL/ELT design patterns, data warehousing concepts, and data quality/validation practices.
Strong troubleshooting and analytical skills, with the ability to diagnose and resolve production issues under time pressure.
Excellent communication skills, with the ability to explain technical issues clearly to both technical and non-technical stakeholders.

Responsibilities

Design, develop, test, and maintain scalable, reliable data pipelines within Databricks, using PySpark, SQL, Delta Lake, and Databricks Workflows/Jobs.
Build ETL/ELT processes that ingest, transform, and deliver data from a variety of source systems into curated, analytics-ready datasets.
Implement data quality checks, validation logic, and monitoring/alerting to ensure pipeline reliability and data accuracy.
Act as a primary point of escalation for production data pipeline issues, performing root-cause analysis, troubleshooting failures, and implementing timely fixes.
Partner with support and business teams to triage incoming issues, communicate status, and drive incidents to resolution within SLA.
Document recurring issues and implement long-term fixes or process improvements to reduce future escalations.
Lead and execute the migration of existing Azure Data Factory pipelines and Azure Functions to the Databricks platform, re-architecting logic as needed to leverage Databricks-native capabilities.
Validate data parity and pipeline performance between legacy Azure-based solutions and their Databricks replacements, ensuring a clean, low-risk cutover.
Retire legacy Azure Data Factory/Azure Functions components once migrations are validated and stable.
Collaborate with data architects, analysts, and business stakeholders to translate requirements into technical designs.
Follow version control, code review, and CI/CD best practices for all pipeline code and configuration.
Contribute to documentation of pipeline architecture, data flows, and operational runbooks
Embody AnewHealth’s Core Values in all communications and interactions.
Other duties as assigned.