Senior Data Engineer

Med-MetrixParsippany-Troy Hills, NJ
1d

About The Position

The Senior Data Engineer designs, builds, and maintains scalable data pipelines and architectures to support the Denials AI workflow under the guidance of the Team Lead, Data Management. This role ensures data is reliable, compliant with HIPAA, and optimized.

Requirements

  • Bachelor’s or master’s degree in Computer Science, Data Engineering, or related field
  • 5+ years of hands‑on experience building and operating production‑grade data pipelines
  • Solid experience with workflow orchestration tools (Dagster) and transformation frameworks (DBT) or other similar tools such (Microsoft SSIS, AWS Glue, Air Flow)
  • Strong SQL skills on PostgreSQL for data modeling and query optimization or any other similar technologies (Microsoft SQL Server, Oracle, AWS RDS)
  • Working knowledge with AWS data services: Athena, Glue, SQS, SNS, IAM, and CloudWatch
  • Basic proficiency in Python and Python data frameworks (Pandas, PySpark)
  • Experience with version control (GitHub) and CI/CD for data projects
  • Familiarity with healthcare data standards and HIPAA compliance
  • Experience mentoring or leading small technical efforts
  • Proficiency in Microsoft Office Suite
  • Strong interpersonal skills, ability to communicate well at all levels of the organization
  • Strong problem solving and creative skills and the ability to exercise sound judgment and make decisions based on accurate and timely analyses
  • High level of integrity and dependability with a strong sense of urgency and results oriented
  • Excellent written and verbal communication skills required

Responsibilities

  • Collaborate with the Team Lead and cross‑functional teams to gather and refine data requirements for Denials AI solutions
  • Design, implement, and optimize ETL/ELT pipelines using Python, Dagster, DBT, and AWS data services (Athena, Glue, SQS)
  • Develop and maintain data models in PostgreSQL; write efficient SQL for querying and performance tuning
  • Monitor pipeline health and performance; troubleshoot data incidents and implement preventive measures
  • Enforce data quality and governance standards, including HIPAA compliance for PHI handling
  • Conduct code reviews, share best practices, and mentor junior data engineers
  • Automate deployment and monitoring tasks using infrastructure-as-code and AWS CloudWatch metrics and alarms
  • Document data workflows, schemas, and operational runbooks to support team knowledge transfer
  • Other duties as assigned
  • Use, protect and disclose patients’ protected health information (PHI) only in accordance with Health Insurance Portability and Accountability Act (HIPAA) standards
  • Understand and comply with Information Security and HIPAA policies and procedures at all times
  • Limit viewing of PHI to the absolute minimum as necessary to perform assigned duties
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service