Senior Data Engineer, Data Platform (USA)

Virtasant

1d•Remote

About The Position

We’re looking for a Senior Data Engineer to join us and work with our client's Data Platform team. Our client is a leading healthcare technology company, dedicated to transforming the patient and provider experience through innovative, data-driven solutions. You will architect and build core services, automation tools, and integrations that power our client's data ecosystem. You’ll own high-impact platform components, improve pipeline reliability and observability, and partner closely with data engineering, analytics, and DevOps to advance the scalability and developer experience of our client's data platform. For this role, we can only consider candidates located in contiguous US states. Also, we are only able to consider candidates who are either US citizens, or Green Card Holders, or sole proprietors of their own LLC company. We are NOT able to consider candidates on any kind of visa that requires sponsorship, like STEM OPT, H4 EAD, F-1 OPT, L-2S, CPT, etc.

Requirements

7+ years of experience in data engineering or software development with at least 5 years building production-grade data or platform services
Strong programming skills in Python & SQL and at least one major data platform (Snowflake, BigQuery, Redshift, or similar)
Develop tooling for schema evolution, data contracts, and developer self-service
Deep experience with streaming, distributed compute, or S3-based table formats (Spark, Kafka, Iceberg/Delta/Hudi).
Experience with schema governance, metadata systems, and data quality frameworks.
Understanding of orchestration tools (Airflow, Dagster, Prefect, etc.)
Solid grasp of CI/CD and Docker
At least 2 years of experience in AWS
Experience with building data pipelines using dbt

Nice To Haves

Experience with data observability, data catalog, or metadata management tools
Experience working with healthcare data (X12, FHIR)
Proven experience in data migration projects (legacy technologies to the latest technologies)
Experience building internal developer platforms or data portals
Understanding of authentication/authorization (OAuth2, JWT, SSO)

Responsibilities

Build Automation & Tooling: Develop scalable backend services, APIs, and internal tools to automate data platform workflows (e.g., data onboarding, validation, pipeline orchestration, schema tracking, quality monitoring).
Data Platform Integration: Integrate tools with core data infrastructure, building pipelines (Airflow, Spark, dbt, Kafka, Snowflake, or similar) to expose capabilities via APIs and UIs.
Observability & Governance: Build visualization and monitoring components for data lineage, job health, and quality metrics.
Collaboration: Work cross-functionally with data engineering, product, and DevOps teams to define requirements and deliver end-to-end solutions.