Senior Data Engineer (Healthcare)
About The Position
Seeking a Senior Data Engineer to design, build, and lead enterprise-scale data platforms on Azure and Databricks. The role combines hands-on development, solution architecture, technical leadership, and stakeholder management. Healthcare Payer experience is highly preferred. The position is based in Philadelphia, Pennsylvania, and is hybrid. The engineer will build scalable data platforms, data lakes, and lakehouse solutions; develop and optimize ETL/ELT pipelines; lead data architecture, data modeling, and cloud modernization initiatives; and support analytics, reporting, AI/ML, and data-driven business initiatives. The role also involves mentoring data engineering teams, establishing best practices, improving platform performance, scalability, security, and cost efficiency, and implementing CI/CD, monitoring, and production support processes. The engineer will collaborate with business leaders, architects, analysts, and product teams.
Requirements
- 10+ years of experience in Data Engineering.
- 7+ years of experience with Azure Data Services.
- 5+ years of experience with Azure Databricks.
- Experience leading enterprise cloud data modernization projects.
- Bachelor's degree in Computer Science, Engineering, Information Systems, or a related field.
- Experience with Azure Databricks, Azure Data Lake Storage (ADLS Gen2), Azure Data Factory (ADF), PySpark, Python, advanced SQL, Delta Lake, data lakehouse architecture, data modeling, ETL/ELT development, Azure Cloud Services, Git and CI/CD, and Agile/Scrum.
Nice To Haves
- Healthcare Payer domain experience; strong preference.
- Experience working directly with business stakeholders and leadership teams.
- Experience with Azure Synapse Analytics, Azure Event Hub, Kafka, Power BI, Azure DevOps, Terraform, data governance and metadata management, monitoring and observability tools, and AI/ML data pipelines.
Responsibilities
- Design and build scalable data platforms, data lakes, and lakehouse solutions.
- Develop and optimize ETL/ELT pipelines using Azure and Databricks.
- Lead data architecture, data modeling, and cloud modernization initiatives.
- Mentor data engineering teams and establish best practices.
- Improve platform performance, scalability, security, and cost efficiency.
- Implement CI/CD, monitoring, and production support processes.
- Collaborate with business leaders, architects, analysts, and product teams.
- Support analytics, reporting, AI/ML, and data-driven business initiatives.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
