SENIOR DATA ARCHITECT

Legent Health•Plano, TX

About The Position

Legent Health is seeking a Senior Data Architect to own the design and evolution of its enterprise data platform. The role sets the architectural direction for moving clinical, financial, supply chain, and operational data from source systems into a governed analytics layer used by leadership. It is a senior individual-contributor position with significant design authority. The architect will design the platform using the Microsoft Azure data stack, including Azure Data Factory for orchestration, Databricks and PySpark for large-scale transformation, and Delta Lake as a serving layer for analytics and downstream applications. The role spans platform strategy and modernization, production data engineering, data modeling and governance, cost and performance optimization, security and compliance, and technical collaboration with business and IT stakeholders. The position also serves as a senior technical reference for data engineering and modeling practices. The architect translates business needs into architectural requirements, communicates proposals and tradeoffs to leadership, supports change control and release governance, and uses and encourages AI-assisted tooling in data work.

Requirements

  • Seven or more years in data engineering, data warehousing, or data architecture, including two or more years in a lead or architect capacity.
  • Deep hands-on proficiency with Azure Data Factory, including metadata-driven pipeline design and production support ownership.
  • Deep hands-on proficiency with Databricks and PySpark, including Delta Lake, performance tuning, and cluster configuration.
  • Expert SQL skills, including complex analytical queries, window functions, query-plan interpretation, and performance tuning.
  • Demonstrated experience designing dimensional models and enterprise data warehouse or lakehouse architectures from the ground up.
  • Experience with Git-based version control and CI/CD for data-platform code.
  • Working knowledge of Azure platform services, including storage, networking basics, identity and access management, and Key Vault.
  • Ability to communicate architecture decisions to non-technical stakeholders.
  • Practical experience using AI-assisted tools in data design, development, and documentation, and designing data for reliable use by AI-enabled tools.
  • Bachelor’s degree in Computer Science, Information Systems, Engineering, or a related field, or equivalent practical experience.

Nice To Haves

  • Healthcare experience, particularly with EMR/EHR data, revenue cycle, supply chain, or perioperative analytics.
  • Familiarity with healthcare data standards and coding systems, including HL7 v2, FHIR, X12 837/835, CPT, ICD-10, and DRG.
  • Experience with Azure Synapse Analytics and Microsoft Fabric, including migration planning from existing Synapse or Azure SQL architectures.
  • Power BI experience at the semantic-model level, including DAX, composite models, incremental refresh, and gateway configuration.
  • Strong Python skills beyond PySpark, including modular, testable code rather than notebook scripts.
  • Experience with Unity Catalog, Purview, or comparable governance and cataloging tools.
  • Infrastructure-as-code experience with Terraform, Bicep, or ARM templates.
  • Streaming or near-real-time ingestion experience, including Event Hubs, Structured Streaming, or Auto Loader.
  • Relevant certification such as Azure Data Engineer Associate, Azure Solutions Architect Expert, or Databricks Certified Data Engineer Professional.

Responsibilities

  • Own the target-state architecture for the enterprise data platform, including ingestion patterns, medallion layering, storage design, and analytics serving layer.
  • Define and document standards for pipeline design, naming, partitioning, data typing, slowly changing dimensions, and incremental loads.
  • Evaluate platform options and make build-versus-buy and tooling recommendations based on cost, performance, and maintainability.
  • Drive platform modernization, including consolidation of legacy extracts, reduction of point-to-point integrations, and migration planning that preserves existing reporting.
  • Design for cost control through cluster sizing and autoscaling, job scheduling, storage tiering, and monitoring spend against workload value.
  • Design, build, and optimize Azure Data Factory orchestration, including metadata-driven pipelines, linked services, integration runtimes, dependencies, retries, and alerting.
  • Develop production-grade Databricks transformation logic using PySpark and Spark SQL, including Delta Lake tables, MERGE-based upserts, schema evolution, partitioning, and query-performance optimization.
  • Tune Spark workloads by diagnosing skew, spill, and shuffle problems, right-sizing clusters, and reducing runtime and cost without sacrificing correctness.
  • Build ingestion from on-premises SQL Server, flat files and SFTP feeds, REST APIs, and vendor extracts, with reliable change detection and watermarking.
  • Implement Git-based CI/CD, environment promotion, and automated deployment of notebooks, pipelines, and schema changes.
  • Establish data quality controls, including source reconciliation, row-count and grain validation, duplicate and fan-out detection, and regression baselines for known-good results.
  • Design dimensional and semantic models that support analytics and establish single-source-of-truth definitions for core metrics.
  • Partner with analysts on semantic-layer design, validating grain, relationships, and measure logic before reports are built.
  • Implement data lineage, cataloging, and documentation.
  • Design access controls and data protection for protected health information, including row-level security, masking, least-privilege service principals, and Key Vault-managed secrets.
  • Ensure platform design supports HIPAA compliance, auditability, and retention requirements.
  • Serve as the senior technical reference for data engineering and modeling practices.
  • Use AI-assisted tooling in design, development, documentation, and data quality work, and help the team do the same.
  • Translate ambiguous needs from clinical, revenue cycle, and finance stakeholders into architectural requirements.
  • Present architecture proposals, risks, and tradeoffs to IT and executive leadership in actionable terms.
  • Participate in change control and release governance for platform changes affecting production reporting.

Benefits

  • Competitive salary and performance incentives
  • Comprehensive benefits package
  • Paid time off
  • Wellness programs
  • Career development and training opportunities
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service