About The Position

The Data Engineer II will join the Windreich Department of AI and Human Health and the Institute for Critical Care Medicine (ICCM), designing, implementing, and maintaining datamarts, data warehouses, databases, and data visualization platforms for healthcare data. The role supports existing ETL and data warehousing systems as well as future big-data, streaming, and pipeline architectures, selecting and implementing appropriate solutions to advance translational research and improve clinical care. The position builds infrastructure that turns raw data from diverse sources into usable insights. It develops scalable, secure, and repeatable data streams and pipelines; supports operational, research, and data science initiatives; and works with cross-functional teams to understand requirements and enable data-driven decisions. The engineer also applies AI agents to data engineering tasks, documents solutions and standards, and maintains data integrity, security, and compliance with Institutional Review Board and HIPAA policies and procedures.

Requirements

  • Bachelor’s degree in Computer Science or a related discipline.
  • At least 4 years of relevant professional development experience, preferably in a Linux environment.
  • Strong SQL and NoSQL database knowledge, including Oracle, PostgreSQL/MySQL, and MongoDB or similar.
  • Proficiency in at least two of Scala, Python, and Java, with flexibility to learn new languages.
  • Proficiency in RESTful service development, preferably using Node.js, Django, and PHP.
  • Experience with microservices and service-oriented architecture (SOA).
  • Proficiency installing and configuring big-data software and technology.
  • Knowledge of Hadoop, Spark, Kafka, other big-data technology stacks, and streaming tools.
  • Familiarity with a wide variety of open-source technologies and tools.
  • Experience working in an Agile methodology.
  • Strong analytical and problem-solving skills and attention to detail.
  • Effective communication skills and ability to collaborate in a team environment.

Nice To Haves

  • An advanced degree; the preferred qualifications specify a master’s degree as preferred.
  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Strong proficiency in ETL processes, data warehousing, and data integration, with proven database development and management experience.
  • Strong SQL skills and experience with relational databases such as Microsoft SQL Server, Oracle, or PostgreSQL.
  • At least 2 years of hands-on experience building and maintaining ETL/ELT pipelines from Epic Clarity and Caboodle, with working knowledge of their data models.
  • Epic Clarity or Caboodle Data Model certification.
  • Proficiency in Python and experience with modern data engineering tools, including Databricks, Snowflake, or Microsoft Fabric; Airflow or dbt; and Git-based CI/CD.
  • Experience using AI agents or LLM-based tools for database and data engineering tasks.
  • Working knowledge of Azure or AWS cloud architecture and implementation, including serverless computing, virtual machines, cloud security, and other cloud services.
  • Experience working with JIRA.

Responsibilities

  • Facilitate collection of data from multiple sources, standardize formats, ensure data quality, and make data accessible to downstream users through common interfaces.
  • Ensure data streams and pipelines are scalable, repeatable, secure, and able to serve multiple users.
  • Design and develop a comprehensive healthcare datamart framework and data visualization platforms, ensuring scalability, efficiency, and data integrity.
  • Manage and administer relational database management systems such as Postgres and Microsoft SQL Server, optimizing performance and availability.
  • Develop and implement ETL processes integrating healthcare data, including data from Epic Caboodle and Clarity databases, into the datamart.
  • Apply AI agents to pipeline development, SQL generation, data quality checks, documentation, and natural-language database access.
  • Create infrastructure that provides insight from raw data and handles diverse data sources.
  • Develop prototypes and proofs of concept, and implement complex big-data projects to collect, parse, and manage large datasets across platforms for operational, research, and data science initiatives.
  • Translate business requirements into modern data pipeline solutions and create centralized documentation and diagrams of solutions.
  • Design and implement monitoring, backup, and disaster recovery for data systems.
  • Create a data catalog store for metadata.
  • Protect data integrity and security across storage systems and ensure compliance with Institutional Review Board and HIPAA policies and procedures.
  • Assist in developing and documenting standards and procedures for data management, design, and maintenance.
  • Work with cross-functional teams, including data scientists, healthcare providers, and IT professionals, to understand requirements, develop solutions, and support data-driven decision-making.
  • Keep skills and knowledge current, remain open to different technologies and languages, and perform other duties as assigned.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service