Data Engineer II - Windreich Department of AI & Human Health Research (On Site)

Mount Sinai Health Systems•New York, NY
•$90,000 - $135,285•Onsite

About The Position

The Data Engineer II will join the Windreich Department of AI and Human Health and the Institute for Critical Care Medicine (ICCM). The role designs, implements, maintains, and monitors datamarts, data warehouses, databases, data pipelines, and data visualization platforms for healthcare data. It supports both existing ETL and data warehousing systems and evolving big-data, streaming, and pipeline architectures, selecting and implementing solutions that advance translational research and improve clinical care. The position builds infrastructure that turns raw data from diverse sources into usable, reliable insights for operational, research, and data science initiatives. It works with cross-functional teams—including data scientists, healthcare providers, and IT professionals—to translate requirements into data solutions, support data-driven decisions, and maintain secure, high-quality data systems. The role also contributes to standards, documentation, monitoring, backup, disaster recovery, metadata cataloging, and compliance with Institutional Review Board and HIPAA requirements.

Requirements

  • Bachelor’s degree in Computer Science or a related discipline.
  • At least 4 years of relevant professional development experience, preferably in a Linux environment.
  • Strong SQL and NoSQL database knowledge, including Oracle, PostgreSQL/MySQL, and MongoDB or similar.
  • Proficiency in at least two of Scala, Python, and Java, and flexibility to learn new languages.
  • Proficiency in RESTful service development, preferably using Node.js, Django, and PHP.
  • Experience with microservices and service-oriented architecture (SOA).
  • Proficiency installing and configuring big-data software and technologies.
  • Knowledge of Hadoop, Spark, Kafka, other big-data technology stacks, and streaming tools.
  • Familiarity with and ability to use a wide variety of open-source technologies and tools.
  • Experience with Agile methodology.
  • Excellent analytical and problem-solving skills, attention to detail, effective communication, and ability to collaborate in a team environment.

Nice To Haves

  • Advanced degree preferred.
  • Bachelor’s degree in Computer Science, Information Technology, or a related field; a master’s degree is preferred.
  • Strong proficiency in ETL processes, data warehousing, and data integration, with proven database development and management experience.
  • Strong SQL skills and experience with relational databases such as Microsoft SQL Server, Oracle, or PostgreSQL.
  • At least 2 years of hands-on experience building and maintaining ETL/ELT pipelines from Epic Clarity and Caboodle, with working knowledge of their data models.
  • Epic Clarity or Caboodle Data Model certification.
  • Proficiency in Python and experience with modern data engineering tools, including Databricks, Snowflake, or Microsoft Fabric; Airflow or dbt; and Git-based CI/CD.
  • Experience using AI agents or LLM-based tools for database and data engineering tasks.
  • Working knowledge of cloud architecture and implementation on Azure or AWS, including serverless computing, virtual machines, cloud security, and other cloud services.
  • Experience working with JIRA.

Responsibilities

  • Facilitate collection of data from diverse sources, standardize formats, maintain data quality, and ensure downstream users can access data quickly through a common interface.
  • Ensure data streams and pipelines are scalable, repeatable, secure, and capable of serving multiple users.
  • Design and develop a comprehensive datamart framework and healthcare data visualization platforms, ensuring scalability, efficiency, and data integrity.
  • Administer relational databases such as PostgreSQL and Microsoft SQL Server, optimize performance, and ensure high availability.
  • Develop and implement ETL processes to integrate healthcare data, including data from Epic Caboodle and Clarity, into the data mart.
  • Apply AI agents to data engineering tasks such as pipeline development, SQL generation, data quality checks, documentation, and natural-language database access.
  • Create infrastructure that provides insight from raw data and handles diverse data sources.
  • Develop prototypes and proofs of concept for selected solutions, and implement complex big-data projects involving collection, parsing, and management of large datasets across multiple platforms.
  • Translate business requirements into modern data pipeline solutions and create centralized solution documents and diagrams.
  • Design and implement monitoring, backup, and disaster-recovery capabilities for data systems.
  • Create a data catalog store of metadata.
  • Maintain data integrity and security across storage systems and ensure compliance with Institutional Review Board and HIPAA requirements and applicable policies and procedures.
  • Assist in developing and documenting standards and procedures for data management, design, and maintenance.
  • Work flexibly across technologies and languages, keep skills current with big-data trends, and collaborate with data scientists, healthcare providers, and IT professionals.
  • Perform other duties as assigned.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service