Principal Data Engineer

Abbott•Madison, WI
•$129,300 - $258,700

About The Position

The Principal Data Engineer is a senior individual contributor and accountable technical leader for assigned cross-domain initiatives and enterprise data engineering capabilities. The role owns integrated technical direction and outcomes across multiple data domains, stewards enterprise engineering standards and reference architectures, and drives convergence when duplicated or inconsistent solutions create enterprise cost, risk, or operational burden. The position advises on scope, sequencing, capacity, dependencies, and technical debt, but does not independently commit domain resources or business delivery dates and has no people-management responsibility. Enterprise Data operates a domain-aligned model built on Databricks and Unity Catalog. In partnership with Domain Leaders, Staff Engineers, Platform Engineering, and other organizations, the Principal Data Engineer turns ambiguous enterprise needs into executable architecture and carries complex or high-risk work through validation and production. The role remains hands-on with prototyping, reference implementations, critical-path development, design and code reviews, and production problem solving. The position leads architecture and technical delivery for enterprise capabilities such as semantic and metrics layers, canonical data models, batch, API, event-driven, and streaming patterns, and governed data products for analytics, machine learning, and AI. It also establishes data-contract standards, mentors engineers across domains, supports operational excellence and cost efficiency, and ensures architectures handling protected health information address applicable security, privacy, lineage, audit, Quality Management System, HIPAA, CLIA, and regulatory requirements. The role may require nights and/or weekends as needed and travel 10% of the time. The listed base pay range is $129,300–$258,700, with possible variation by location.

Requirements

  • Bachelor's degree in Data Science, Computer Science, Information Systems, Mathematics, or Engineering; alternatively, a high school diploma or GED and 12 years of relevant experience in lieu of a bachelor's degree.
  • Expert-level experience in software development design and development and relevant domain-specific skills.
  • Experience with Spark on Databricks or comparable platforms; Python, Scala, SQL, and Snowflake.
  • Experience with ETL and ELT data pipelines, including batch and event-driven patterns.
  • Experience designing and implementing data-modeling solutions using relational, dimensional, and/or NoSQL databases.
  • Knowledge of database architecture testing methodologies, including executing test plans, debugging, and using testing scripts and tools.
  • Experience with open data file and table formats such as Parquet, Avro, and Delta Lake; cloud infrastructure and delivery services such as AWS, S3, SQS, and GitLab CI/CD.
  • REST API development experience and familiarity with BI concepts and Tableau performance considerations.
  • Experience with Agile development tools, including JIRA and Confluence repository.
  • Demonstrated ability to lead through influence across multiple teams and communicate complex technical decisions to senior engineering, business, and executive stakeholders.
  • Ability to perform the essential duties of the position with or without accommodation.

Nice To Haves

  • Databricks, Apache Spark, Delta Lake, and Unity Catalog experience at enterprise scale.
  • Kafka, change data capture, and production event-streaming architecture experience.
  • Experience designing semantic or metrics layers, canonical data models, and governed data products.
  • Cloud data architecture experience in AWS, Azure, or Google Cloud Platform.
  • Experience in life sciences, diagnostics, or clinical laboratory environments involving protected health information, HIPAA, CLIA, FDA, or Quality Management System requirements.
  • Experience with technical assessment and architecture direction for vendor and external-partner platforms.

Responsibilities

  • Own technical outcomes for assigned cross-domain initiatives from initial ambiguity through production and lifecycle support.
  • Translate enterprise needs into integrated architecture and executable technical plans, breaking complex work into deliverable increments across domains.
  • Coordinate technical execution across domain Staff Engineers and partner teams; identify dependencies and architectural risks, and escalate decisions requiring business or delivery authority.
  • Remain hands-on through prototypes, reference implementations, critical-path development, technical validation, and production problem solving.
  • Define, steward, and evolve enterprise data engineering standards, patterns, and reference architectures; drive convergence where inconsistent or duplicative implementations create cost, risk, or operational burden.
  • Lead architecture for assigned enterprise capabilities, including semantic and metrics layers, canonical data models, batch, API, event-driven, and streaming patterns, and governed data products for analytics, machine learning, and AI.
  • Establish enterprise data-contract standards for schemas, service expectations, compatibility, breaking-change policy, and producer-consumer responsibilities; partner with Platform Engineering to turn recurring cross-domain needs into shared capabilities.
  • Lead enterprise design and code reviews for high-complexity or cross-domain work; coach and mentor Staff and Senior Engineers across domains without formal people authority.
  • Communicate architecture and technical tradeoffs to engineering, business, and executive stakeholders, and create reusable guidance that improves engineering consistency.
  • Evaluate architecture tradeoffs across reliability, scalability, performance, security, privacy, operability, adoption, and technical cost; drive cost-efficient use of compute, storage, streaming, and orchestration.
  • Act as the enterprise technical escalation point for incidents involving multiple domains or shared architecture patterns; lead root-cause analysis and preventive changes for recurring issues.
  • Design and review architectures handling protected health information to meet applicable security, privacy, lineage, audit, Quality Management System, HIPAA, CLIA, and regulatory requirements.
  • Provide technical direction and due diligence for vendor and external-partner solutions; advance responsible engineering practices, including approved AI-assisted development capabilities.
  • Uphold company mission and values through accountability, innovation, integrity, quality, and teamwork.
  • Support and comply with company Quality Management System policies and procedures.
  • Maintain regular and reliable attendance.
  • Model an inclusion mindset and related behaviors for the organization.
  • Be able to work nights and/or weekends as needed.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service