Data Engineer II- Life Sciences

H1 • New York, NY

5d • $110,000 - $135,000 • Remote

About The Position

At H1, we believe access to the best healthcare information is a basic human right. Our mission is to provide a platform that can optimally inform every doctor interaction globally. This promotes health equity and builds needed trust in healthcare systems. To accomplish this, our teams harness the power of data and AI-technology to unlock groundbreaking medical insights and convert those insights into action that result in optimal patient outcomes and accelerates an equitable and inclusive drug development lifecycle. Visit h1.com to learn more about us.
H1's Data Network (H1DN) team is the client-data mastering network at the core of how H1's products get their data. We run production ingestion for major enterprise customers. Clinical trial data is one of our highest-visibility streams: it feeds decisions about where trials run and who runs them, and the people who depend on it are as often clinical experts as they are engineers. SLAs and customer expectations drive how we work, and we're looking for engineers who are energized by that.
As a Data Engineer II on the H1DN team, you will build and operate the pipelines behind H1's clinical trials data. You'll work primarily in Python, PySpark, and SQL, and you'll work directly with clinical subject matter experts and Customer Success Managers to turn their domain knowledge into pipeline logic that holds up in production.

Requirements

• 3+ years of experience in software or data engineering, with meaningful Python in your background
• Demonstrated experience building and maintaining production-grade data pipelines in Python
• Hands-on experience with PySpark or a similar distributed data processing framework
• Strong SQL skills, including working with large, messy, multi-source datasets
• Strong understanding of software quality practices: testing, code review, documentation, and CI/CD
• Experience working with cross-functional and non-technical stakeholders

Nice To Haves

• Experience with pipeline orchestration tooling (Argo, Airflow, Databricks, dbt, or similar) preferred
• Familiarity with clinical trial data, healthcare data, or another regulated data domain a plus
• Familiarity with entity matching or data mastering a plus
• Familiarity with AWS services (S3, Lambda, ECS, or similar) a plus

Responsibilities

• Build and maintain the Python and PySpark pipelines behind the CTMS trial data pipeline intake workflows, including scoring and status logic.
• Develop the transformation logic that maps raw trial and customer data to H1's internal data models, handling diverse source formats including CSV, JSON, Parquet, and APIs.
• Write and tune SQL against large datasets to investigate data questions, validate pipeline output, and support analysis that clinical SMEs and customer-facing teams depend on.
• Turn around customer-driven changes quickly, scoping requests as they arrive, shipping changes that hold up under enterprise SLAs, and reworking logic as customer needs shift mid-flight.
• Partner with clinical SMEs to translate domain expertise into concrete data rules, then walk them through the results, explain what the pipeline did and why, and fold their feedback back into the logic.
• Build the data quality checks, validation logic, and reconciliation that let non-engineers trust pipeline output without reading the code.
• Participate in code reviews, maintaining a high bar for quality and adherence to engineering standards.
• Monitor and improve pipeline observability, contributing to alerting and dashboards that surface job health and data anomalies for both the team and internal users.

Benefits

• Full suite of health insurance options, in addition to generous paid time off
• Pre-planned company-wide wellness holidays
• Retirement options
• Health & charitable donation stipends
• Impactful Business Resource Groups
• Flexible work hours & the opportunity to work from anywhere
• The opportunity to work with leading biotech and life sciences companies in an innovative industry with a mission to improve healthcare around the globe
• stock options

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed