Staff Software Engineer, Directory Accuracy (Health Plans)

H1•New York, NY

About The Position

H1’s Health Plans Software Engineering group builds products that help health plans maintain accurate provider data. The Directory Accuracy team owns master data management and client data integration, including the data platform that ingests, matches, and standardizes client data for provider directory accuracy, site feasibility, and healthcare professional credentialing. Its core workflow includes client entity intake, unique ID assignment, matching against H1’s core data layer, and syncing data back into client feeds and pipelines. As a Staff Software Engineer, you will design, build, and operate large-scale data pipelines and services used by health plan and life sciences customers. The role is hands-on, focused primarily on coding in PySpark, Scala, and SQL, solving data problems at scale, and shipping customer-facing features and internal tools. You will also build APIs and backend services that make pipeline outputs accessible to customers and internal teams. You will join a team consisting of a Staff engineer, a Senior engineer, and two contractors, and report to the Director of Software Engineering, Health Plans. H1 requires candidates to participate in an in-person final interview, which may require travel depending on location.

Requirements

At least 8 years of software engineering experience, with a strong focus on data engineering and building data-driven products.
Deep experience designing, building, and running production big data pipelines at scale, including ETL/ELT, orchestration, scheduling, and monitoring.
Strong proficiency in PySpark, Scala, Python, and SQL.
Solid experience with distributed data processing and Spark performance tuning.
Experience building APIs or backend services that support customer-facing applications.
Working knowledge of cloud infrastructure such as AWS, GCP, or Azure.
Hands-on experience with entity resolution, record matching, or master data management.
Experience with data quality, scoring, or validation frameworks.
Comfort working directly with client data, including messy source files, and onboarding enterprise customers.
A product-engineering mindset and concern for how customers use what you build.
Clear communication with engineers, product partners, and non-technical stakeholders; ability to take ownership of systems end to end and improve existing codebases.

Nice To Haves

Full-stack experience or experience building web UIs with a modern framework such as React.
Experience building products that turn complex data into customer-facing features.
Experience building internal self-service tools.
Experience with healthcare data such as provider or HCP directories, rosters, credentialing, clinical trial, or site feasibility data.
Experience with CTMS or other clinical systems data.

Responsibilities

Design, build, and operate large-scale data pipelines for ingesting, transforming, matching, and syncing client data using PySpark, Scala, and SQL.
Build and improve the entity matching service that resolves client records against H1’s core data layer, including its underlying schema.
Develop data asset management features such as scoring, status assignment, and configurable intake.
Build APIs and backend services that power customer-facing UIs and internal tools, making pipeline outputs easy to explore, act on, and trust.
Contribute to customer-facing and internal applications that help bring new products to market.
Build self-service internal tools that enable operations, customer success, and other non-technical teams to work with data without engineering assistance.
Work directly with enterprise client data, debug issues end to end, and make ingestion more reliable and repeatable.
Integrate clinical and provider data as new products and customers join the platform.
Work with product and design partners to shape features from customer problem through shipped product.
Improve pipeline performance, reliability, observability, testing, and documentation.
Contribute to architecture decisions and design and code reviews.
Collaborate with adjacent teams responsible for feed delivery, access infrastructure, public-facing APIs, and roster processing.