Principal Data Engineer - H&B Data Platform (Azure)

Willis Towers Watson-posted 6 months ago
$180,000 - $220,000/Yr
Full-time • Senior
Washington, DC
Insurance Carriers and Related Activities
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

Our Health and Benefits business helps large and mid-size clients control health and welfare plan costs, improve health outcomes and promote employee engagement through broad-based, state-of-the-art interventions. We provide solutions encompassing creative plan design, vendor evaluation and management, pricing and funding strategies, data analytics, valuation support, legal compliance and governance strategies. We also provide specialty consulting services including clinical/health management program design, pharmacy solutions, disability/absence management strategies and claims audit services. Product based solutions such as our pharmacy purchasing coalition round out our broad-based suite of offerings. In this role, we are seeking an experienced, hands-on, and innovative Principal Data Engineer with expertise in the Azure Cloud platform to design, implement, and optimize scalable data solutions. The ideal candidate will have deep expertise in data engineering, data architecture, cloud solutions, and experience with healthcare and benefits data systems. They will work closely with a cross functional team of Data, DevOps, and Analytics engineers to architect a robust data platform for H&B, ensure efficient data management, and support enterprise-level decision making process.

  • Lead the end-to-end data engineering of the health and benefits data platform using Azure services, ensuring scalability, flexibility, and reliability.
  • Develop broad understanding of the data lakehouse architecture, including the impact of changes on a whole system, built for analytic purposes.
  • Design a new or improve upon existing architecture including data ingestion, storage, transformation and consumption layers.
  • Provide technical direction and guidance to a team of data engineers.
  • Define flexible, scalable and dynamic ingestion pipelines that can handle all data formats such as CSV, XML, Parquet, Replication Services, APIs, etc.
  • Define flexible, scalable and repeatable ETL/ELT pipelines to load the data warehouse with precision and quality.
  • Define data models, schemas, and database structures optimized for H&B use cases including claims, census, placement, broking and finance sources.
  • Design solutions for seamless integration of diverse health and benefits data sources.
  • Implement data governance and security best practices in compliance with industry standards and regulations using Microsoft Purview.
  • Evaluate data lakehouse architecture, within the medallion architecture method, to understand how technical decisions may impact business outcomes.
  • Draw on internal and external practices to establish data lakehouse architecture best practices and standards within the team.
  • Continuously develop technical knowledge and be recognised as a key resource across the global team.
  • Collaborate with other specialists and/or technical experts to ensure H&B Data Platform is delivering to the highest possible standards.
  • Initiate practices that will increase code quality, performance and security.
  • Develop recommendations for continuous improvements initiatives.
  • Build the team's technical expertise/capabilities/skills through the delivery of regular feedback, knowledge sharing, and coaching.
  • Analyze existing database designs, pipelines and code base to suggest improvements that promote performance, stability and interoperability.
  • Work with product management and business subject matter experts to translate business requirements into a scalable and flexible data lakehouse design.
  • Maintain the governance model on the data lakehouse architecture through training, design reviews, code reviews, and progress reviews.
  • Participate in the development of Data Lakehouse Architecture and development roadmaps in support of business strategies and objectives.
  • Enable business intelligence, reporting and analytic stakeholders with a data warehouse that is performant, optimized, flexible and scalable.
  • Communicate with key stakeholders and development teams on technical solutions.
  • Candidate must have significant experience in a technology related discipline, such as IT or Engineering with a Bachelor's/College Degree in these areas being required.
  • Strong experience in databases, data warehouses, tools and methodologies.
  • Strong skills across a broad range of database technologies including Azure Data Factory, Azure Synapse Analytics, Azure Databricks, Azure SQL Database, Azure Data Lake Storage, and other Azure Services.
  • Working knowledge of Microsoft Fabric is preferred.
  • Data Analysis, Data Modeling, Data Integration, Data Warehousing, Database Design, previous experience in implementing or working within the Medallion Architecture preferred.
  • Experience in data warehousing techniques such as Kimball vs. Inmon.
  • Experience with database performance evaluation and remediation, cloud-based knowledge preferred.
  • Develop strategies for data acquisitions, archive recovery and implementation.
  • Working knowledge of cloud-computing costs and ways to reduce those costs in a distributed-computing environment.
  • Superior Python, PySpark and SQL skills.
  • Ability to design and develop Databases, Data Warehouses and Multidimensional Databases.
  • Experience in Data Governance including Microsoft Purview, Azure Data Catalogue, Azure Data Share, and other Azure tools.
  • Familiarity with legal risks related to global data usage, data residency and rights.
  • Experience in data security, including Azure Key Vault, Azure Data Encryption, Azure Data Masking, Azure Data Anonymization, and Azure Active Directory.
  • Ability to develop end-end data platform strategies for flexible high-performance reporting and business intelligence.
  • Experience using data modeling tools & methodology.
  • Experience working within an Agile Scrum Development Life Cycle, across varying levels of Agile maturity.
  • Experience working with geographically distributed scrum teams.
  • Excellent verbal and writing skills, including the ability to research, design, and write new documentation.
  • Working knowledge of Microsoft Fabric.
  • Experience in implementing or working within the Medallion Architecture.
  • Health and Welfare Benefits: Medical (including prescription coverage), Dental, Vision, Health Savings Account, Commuter Account, Health Care and Dependent Care Flexible Spending Accounts, Group Accident, Group Critical Illness, Life Insurance, AD&D, Group Legal, Identify Theft Protection, Wellbeing Program and Work/Life Resources.
  • Leave Benefits: Paid Holidays, Annual Paid Time Off, Short-Term Disability, Long-Term Disability, Other Leaves (e.g., Bereavement, FMLA, ADA, Jury Duty, Military Leave, and Parental and Adoption Leave).
  • Retirement Benefits: Contributory Pension Plan and Savings Plan (401k).
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Azure Data Engineer Resume Examples
•
Azure Data Engineer Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service