Senior Data Engineer (Health Research Team)

Milliman•Chicago, IL

20h•Hybrid

About The Position

Milliman’s Health Research Team (HRT) is seeking an enthusiastic and detail-oriented Senior Data Engineer to join our team, under the guidance of the Senior Manager, Health Data Analytics. In this role, you will design, maintain, and enhance data ETL pipelines, ensuring the smooth ingestion and transformation of data ultimately destined for Databricks. You will primarily work with Python, PySpark, and SQL, using AWS services like EC2 and S3. Additionally, you will process healthcare data through a variety of Milliman tools. This role is based out of the Milliman office in Chicago, IL, but candidates hired into this role may work remotely anywhere in the US or in the office on a weekly basis with flexible work arrangements. Travel to Milliman’s Chicago office for three consecutive days each quarter is required.

Requirements

A bachelor’s degree in Computer / Software Engineering, Computer Science, Information Technology, Electrical Engineering, Data Science, Actuarial Science, or similar fields
6+ years of relevant experience in data engineering or related roles, with advanced programming in SQL or Python languages
Demonstrates a strong capability to consistently produce high quality, accurate deliverables on schedule and effectively communicate progress, outcomes, and recommended next actions
Four or more years of experience in the following areas:
Building data pipelines for enrollment, claims (medical or pharmacy), risk scores, or other common healthcare data sources
Data modeling and architecture within Databricks or similar cloud-based analytics and AI platforms
Utilizing distributed data processing frameworks, preferably Apache Spark (PySpark/Spark SQL)
Using GitHub for version control, code review, and branching strategies
Applying best data governance and retention practices
Practicing intermediate or higher knowledge of other Microsoft Office applications, including Teams, Word, PowerPoint, SharePoint, and Outlook, as well as Adobe Acrobat
Travel to Milliman’s Chicago office for three consecutive days each quarter is required

Nice To Haves

Ability to use REST API to perform standard database functions
Experience migrating between AWS and Azure
Competent with coding in the SAS Windowing Environment
General business knowledge of at least two healthcare lines of business (e.g. individual, employer group, Medicare, Part D, Medicaid, Dental, etc.)
Exposure to CMS’ LDS SAF data files
Proficiency in performing intermediate Excel skills, including complex formulas, Power Query, or VBA automation
Experience working in a project management setting
Strong written and verbal communication skills, especially communicating technical details to nontechnical audiences
Polished demeanor with a consultative approach, capable of interacting with, influencing, and communicating effectively with all levels of health professionals; flexible, with a strong work ethic and a team-player attitude
Displays a positive attitude, a growth mindset, and eagerness to learn; open to receiving and integrating feedback effectively
Stays up to date with the rapidly evolving data technology landscape
Service-oriented, dependable, and tactful, with the ability to work independently
Demonstrates integrity and respect for confidentiality
Skilled in prioritizing and managing multiple projects and tasks amidst interruptions and tight deadlines
Takes pride in their work and showcases excellent problem-solving ability which adds value to the business

Responsibilities

Work closely with key stakeholders to ensure data pipelines meet business objectives and data transformations meet data analyst requirements
Write, incorporate, and maintain Databricks’ notebook scripts within our standard data and tool processing jobs
Ensure the integrity of the HRT’s data pipelines, Databricks lakehouse, APIs, and Milliman’s products by conducting in-depth validation reviews and by applying data governance and retention policies
Lead comprehensive data pipeline reviews across HRT's data assets, ensuring accuracy, completeness, consistency, and timeliness of healthcare data pipelines and downstream products
Design, develop, and execute systematic data validation frameworks to identify anomalies, discrepancies, and integrity issues within our data pipelines and product tools
Investigate and document root causes of data pipeline failures, partnering with data engineering and analytics teams to implement corrective actions and preventive controls
Establish and maintain data quality metrics, scorecards, and dashboards to monitor ongoing pipeline health and communicate findings to stakeholders at all levels
Deploy workflows into production environments, ensuring robust operation, monitoring performance, and promptly addressing any pipeline issues, to maintain reliability and stability
Collaborate with other HRT data analytics, engineering, and project management professionals to identify, propose, and implement process enhancements
Assist in developing ad hoc data workflows, which support Health Research Board (HRB) approved initiatives and Milliman practice client projects
Provide support to Milliman’s practices via our help desk system by answering a variety of questions, most often about our data assets and data use policies
Collaborate with HRT finance, operations, and project management teammates through providing technical and healthcare data expertise
Communicate progress, status, issues, decisions on a regular cadence

Benefits

Medical, Dental and Vision – Coverage for employees, dependents, and domestic partners.
Employee Assistance Program (EAP) – Confidential support for personal and work-related challenges.
401(k) Plan – Includes a company matching program and profit-sharing contributions.
Discretionary Bonus Program – Recognizing employee contributions.
Flexible Spending Accounts (FSA) – Pre-tax savings for dependent care, transportation, and eligible medical expenses.
Paid Time Off (PTO) – Begins accruing on the first day of work. Full-time employees accrue 15 days per year, and employees working less than full-time accrue PTO on a prorated basis.
Holidays – A minimum of 10 observed holidays per year.
Family Building Benefits – Includes adoption and fertility assistance.
Paid Parental Leave – Up to 12 weeks of paid leave for employees who meet eligibility criteria.
Life Insurance & AD&D – 100% of premiums covered by Milliman.
Short-Term and Long-Term Disability – Fully paid by Milliman.