Lead Data Engineer - Data Platform Engineering (Hybrid)

Northwell Health

1d•Hybrid

About The Position

We're looking for a hands-on Lead Data Engineer to architect and build the data pipelines and infrastructure that power our analytics, ML, and business intelligence capabilities. You'll design greenfield data solutions while modernizing our existing systems to create a scalable, reliable, and performant data platform. Leads the implementation of information systems to manage financial functions for Patient Financial Services/Accounts. Oversees projects and initiatives to meet user requirements. Serves as a liaison between department (user) and vendors. Ensures systems compliance to applicable laws, regulatory standards and policies. This is a unique opportunity to own critical data infrastructure from the ground up. You'll spend your time building robust ETL/ELT pipelines, optimizing data models, building reusable and extensible frameworks, and mentoring the team all while solving complex challenges around data ingestion, transformation, and orchestration at scale.

Requirements

Bachelor's Degree required, or equivalent combination of education and related experience.
5-7 years of relevant experience including technical experience with Apache Hadoop, NoSQL, setting up cloud clusters, Apache Spark, and other advanced data science and big data technologies, required.

Nice To Haves

Extensive Google Cloud Platform (GCP) experience
Previous experience as a Data Platform Engineer/ Data Engineer/ Analytics Engineer for a large organization
Experience in/ with Python (FastAPI, Pandas, Polars, etc.)
Experience with infrastructure as code, specifically Terraform
Extensive experience with Airflow, DBT, and/ or Dataform
Experience with OpenLineage, OpenMetadata and data contracts
Extensive experience with BigQuery, CloudSQL, Pub/ Sub, Dataflow, Cloud Storage, etc.
Experience with the Cloud Healthcare API/ FHIR/ HL7

Responsibilities

Coordinates implementation of information system initiatives to meet user requirements.
Communicates with user departments and project teams regarding implementation activities and system changes to ensure feasibility.
Develops system specifications that appropriately meet department requirements.
Develops systems to track data in comprehensive and innovative ways.
Collaborates with hospital departments and outside vendors to facilitate managed care contract implementation.
Coordinates and maintains communication between the hospital and vendor(s) regarding system applications.
Performs periodic post-installation reviews of system initiatives.
Conducts system-wide in-services with managers and staff, as necessary.
Ensures systems compliance to applicable laws, regulatory standards and policies.
Uses knowledge and skills to contribute to the development of functional objectives and principles to achieve goals in innovative ways.
Problems addressed are of diverse scope and complexity ranging from moderate to substantial.
Performs related duties as required.
All responsibilities noted here are considered essential functions of the job under the Americans with Disabilities Act.
Duties not mentioned here, but considered related are not essential functions.