Data Engineer IV

Fred Hutchinson Cancer Center•Seattle, WA

11d

About The Position

The Data Engineer IV is a senior member of the Office of the Chief Data Office (OCDO) Data Engineering team leading the development of new translational data infrastructure, integrations, and user-facing applications. This role combines deep data engineering expertise in the Databricks Lakehouse ecosystem with hands-on experience in designing and operating cloud infrastructure-as-code (IaC) on AWS using Terraform. This engineer will be responsible for ensuring data pipelines, compute infrastructure, and security architecture are aligned, reproducible, and cost-efficient. The ideal candidate will lead by example in engineering excellence, reliability, and collaboration, helping the team scale data services for research and clinical innovation in a secure, compliant, and responsive environment.

Requirements

BS in Computer Science, Engineering or equivalent experience.
Minimum of 10 years of experience with various database platforms, reporting tools, and data structures.
Minimum of 10 years of experience with database design and ETL development.
Minimum of 10 years of experience in technical leadership.
Proficient in one or more scripting language.
In-depth knowledge and expertise of database technologies, along with solid programming, design and system analysis skills.
Proven track record researching, implementing and socializing technical solutions.

Nice To Haves

Advanced skills using and collaborating on code development using git/GitHub and deep familiarity with SDLC processes and implementation.
CI/CD automation experience including testing and environment promotion for data pipelines.
Proven experience designing and operating Databricks based pipelines (Delta Lake, Jobs/Workflows, DLT).
Proficiency in AWS services (S3, IAM, Lambda, EC2, networking) and pipeline troubleshooting.
Strong debugging, cost-performance tuning, and incident remediation skills.
Experience mentoring engineers, leading design sessions, and demonstrated ownership and reliability of data engineering implementations.
Deep familiarity with Databricks–AWS integrations, including Terraform-based cluster management and policy enforcement.
Experience in regulated or healthcare environments (e.g., HIPAA, FHIR, OMOP).
Familiarity with data governance, lineage, and observability tools (e.g., Great Expectations, Monte Carlo).
Hands-on experience with Terraform or other IaC tools for infrastructure management.
Experience with Airflow, dbt, or Dagster for orchestration and transformation design.

Responsibilities

Lead the research, design, and development of data solutions to address analytical, research, and clinical data requirements, ensuring system scalability, security, performance and reliability.
Design and maintain data applications such as interfaces, ingestion pipelines, data transfer mechanisms and data partition strategies using Databricks, Delta Lake, Unity Catalog, and related cloud technologies to enable efficient access of data structures.
Develop prototypes and pilot new data engineering solutions to determine their viability for adoption and long-term operational support.
Lead the planning process around future growth scalability, and optimization of data solutions.
Establish and support data standards, governance practices, lineage tracking, and data quality processes.
Lead efforts to improve processes and meet strategic goals for data engineering, data management, infrastructure management, infrastructure automation, and platform reliability.
Proactively identify issues, troubleshoot and tune data solutions for scientific computing.
Work with internal stakeholders to correctly scope, define, implement, and deliver data platform solutions.
Prepare and present technical information on data solutions to all levels of stakeholders.
Independently organize and manage multiple complex projects, priorities, and technical initiatives simultaneously.
Prepare and maintain written technical design specifications, flow charts and data flow diagrams as needed for new and existing applications.