Senior Data Engineer

NateraAustin, TX
6h

About The Position

Design, develop, and maintain robust, scalable, and secure data pipelines for ingesting, transforming, and validating clinical real-world data (RWD) from various sources. Implement software solutions using programming languages (e.g., Python, SQL) and cloud technologies (e.g., AWS) to support clinical data management and analysis workflows. Work closely with the clinical data management specialist and other engineers to ensure software and data are of high-quality, scalable, and compliant with industry standards.

Requirements

  • BS degree in computer science or comparable program.
  • 4-5+ years of overall software development experience, preferably building complex data or process management applications
  • SQL databases (Postgres, Snowflake, Redshift, Athena), SQL, and ETL
  • Excel/Macros, Quicksight and Tableau or similar applications
  • AWS services like Redshift and S3
  • Software engineering best practices including agile methodologies, code reviews, source management, build processes, testing, and operations
  • Proficient with data standards (e.g., CDISC, FHIR) and regulatory requirements (e.g., HIPAA, GDPR) for data management and DEID.
  • In-depth knowledge of relational databases (e.g., PostgreSQL, MySQL).
  • Expert knowledge of version control (Git), CI/CD pipelines, and agile development methodologies.
  • Excellent written and verbal communication skills, capable of collaborating with clinical and non-clinical teams.
  • Proven ability to work independently, manage time effectively, prioritize and organize tasks, and meet strict productivity and quality deadlines
  • Possess a high level of initiative and self-motivation.
  • Team player; can navigate supporting highly visible projects and tasks.
  • In-depth attention to detail and a fast learner.
  • Responding to shifting priorities and changes.

Responsibilities

  • Collaborate with software/quality engineers/analysts and product managers (technical and non-technical) to make key design and technical implementation decisions.
  • Partner with stakeholders and users to define requirements and deliver reliable, extensible, operations-friendly applications, services, solutions, data pipelines, or reports.
  • Communicate testing progress, risks, and quality metrics effectively to project stakeholders and senior management.
  • Design, build, and optimize production-grade ETL/ELT data pipelines and software components based on product requirements, and where applicable innovative ideas based on domain expertise.
  • Analyze and fix defects identified within applications, services, solutions, data pipelines, or reports.Along with creating unit tests and coordinate testing within the Clinical Data and Software engineering team, and all relevant cross-functional teams.
  • Write SQL, Python, ELT code to query raw and structured clinical, and genomic data for various clinical data management activities and to provide data as a service.
  • Create data marts, including performing data transformation and de-identification for internal and external data projects, research initiatives, quality monitoring programs, and meeting regulator submission requirements.
  • Develop and maintain scalable data pipelines, storage solutions, and processing workflows using AWS services (e.g., S3, Redshift).
  • Experience with Apache Airflow for scheduling and managing complex data workflows.
  • Review design alternatives and architectural proposals and provide relevant and timely recommendations and suggestions to leadership.
  • Accurately scope and estimate work using sound engineering best practices.
  • Apply version control (Git), CI/CD pipelines, and agile development methodologies.
  • Perform code reviews and provide relevant and timely recommendations and suggestions for solutioning to the leadership team, and when appropriate, independently implement solutions.
  • Support staff recruitment and onboarding.
  • Provide strong leadership and support to new hires and cross-functional team members, fostering an environment of professional development and growth.
  • Maintenance of all relevant clinical or technical licensures. Attend conferences relevant to role and clinical field.
  • Other duties and responsibilities to be performed as assigned

Benefits

  • Employee benefits include comprehensive medical, dental, vision, life and disability plans for eligible employees and their dependents.
  • Additionally, Natera employees and their immediate families receive free testing in addition to fertility care benefits.
  • Other benefits include pregnancy and baby bonding leave, 401k benefits, commuter benefits and much more.
  • We also offer a generous employee referral program!
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service