LillyDirect Pharmacy Master Data Technical Lead

Eli Lilly and Company • Us, IN

3d

About The Position

The Technical Lead for the LillyDirect Pharmacy Covered Entity Master Data team owns the technical direction and delivery of a data platform that creates trusted, consented customer and partner profiles. This hands-on technical leadership role sets engineering standards, guides data engineers, and serves as a technical expert on integrating Reltio profile master data and Transcend consent management with Lilly’s AWS and Databricks data platform. The role ensures that accurate data, used with appropriate consent, reaches patients and business users.

The role defines the architecture for profile master data, consent and preference flows, and data subject request workflows. It translates privacy and regulatory requirements into technical controls, protects sensitive data, and establishes data quality, lineage, reconciliation, and auditability practices. It also leads the design and delivery of batch and near-real-time data pipelines, lakehouse structures, CI/CD and infrastructure-as-code standards, performance and cost tuning, and production support.

As a technical leader, this position sets coding, review, and documentation practices; mentors engineers; partners with product owners, architects, vendors, and business stakeholders; and represents the team in architecture, security, and platform governance forums. The anticipated wage is $129,000–$231,000. Full-time equivalent employees are eligible for a company bonus, depending in part on company and individual performance, and eligible employees may participate in the company’s benefits program.

Requirements

• Bachelor’s or master’s degree in Computer Science, Engineering, or a related quantitative field.
• At least 8 years of professional experience in data engineering or software engineering.
• At least 3 years of experience as a tech lead, principal engineer, or senior individual contributor.
• At least 3 years of hands-on experience with Reltio or a comparable MDM platform for profile or customer master data, including match rules, survivorship, and integration patterns.

Nice To Haves

• Working understanding of consent and preference management, including opt-in and opt-out, purpose, channel, and enforcement in pipelines and downstream use.
• Hands-on experience with Transcend or a similar consent platform for consent, preference, or data subject request workflows.
• Expert-level Python and PySpark skills, including production-grade code, automated testing, and performance tuning, and advanced SQL skills including window functions, CTEs, and query optimization.
• Strong hands-on experience building data pipelines on AWS, such as with S3, Glue, Lambda, Step Functions, Athena or Redshift, and IAM, and on Databricks, including Delta Lake.
• Experience with dimensional and lakehouse medallion data modeling and with data governance, security, and quality practices, including protection of PII and PHI.
• Experience with CI/CD, Git, and infrastructure-as-code tools such as Terraform, CDK, or CloudFormation.
• Ability to lead technical design, mentor engineers, and communicate clearly with technical and non-technical stakeholders.
• Pharmaceutical, healthcare, or pharmacy industry experience, and experience in regulated environments with privacy and compliance requirements.
• Experience partnering with and influencing vendor resources on solution development and delivery.
• Experience with orchestration tools such as Apache Airflow or Databricks Workflows.
• Familiarity with data quality frameworks such as Great Expectations or dbt tests, and streaming platforms such as Kafka, Kinesis, or MSK.
• Familiarity with data catalog and governance tools such as Unity Catalog or AWS Lake Formation.
• AWS Certified Data Engineer - Associate, AWS Solutions Architect, or Databricks Certified Data Engineer (Associate or Professional).

Responsibilities

• Define and own the technical architecture for profile master data, including Reltio integration, match and merge logic, survivorship rules, and golden-record delivery to downstream consumers.
• Design flows for consent and preference data from Transcend and ensure consent status is consistently enforced in pipelines, profiles, and downstream use.
• Design workflows for data subject requests, including access and deletion, across profile data and downstream systems, ensuring requests are consistently honored and evidenced.
• Partner with Privacy, Legal, Quality, and business teams to translate consent and regulatory requirements, including HIPAA and applicable privacy laws, into technical controls.
• Define controls for protecting sensitive PII and PHI, including access control, masking, encryption, and retention, in line with Lilly standards.
• Build data quality, lineage, and reconciliation checks to establish that profile and consent data is accurate, complete, and auditable.
• Lead design and delivery of batch and near-real-time pipelines using Python and PySpark on Databricks and AWS.
• Design Delta Lake and medallion lakehouse structures, including partitioning, schema evolution, and Unity Catalog governance.
• Build observable pipelines with error handling, retries, alerting, and clear SLAs.
• Set CI/CD and infrastructure-as-code standards for data workloads in partnership with the DevOps engineer.
• Tune SQL, Spark jobs, and data models for performance and cost.
• Own production support for data pipelines, including escalation, incident response, and root cause analysis, in partnership with the DevOps engineer.
• Set coding standards, code review practices, and documentation practices, including architecture decision records, runbooks, and data contracts.
• Mentor engineers through design reviews, pair programming, and knowledge sessions.
• Partner with product owners, architects, and vendor teams to turn business needs into a technical roadmap and influence vendor resources so delivery aligns with the team’s data and technical direction.
• Represent the team in architecture reviews, security reviews, and platform governance forums.

Benefits

• Company bonus, depending in part on company and individual performance.
• Company-sponsored 401(k) participation eligibility.
• Pension.
• Vacation benefits.
• Medical, dental, vision, and prescription drug benefits eligibility.
• Flexible benefits, including healthcare and/or dependent day care flexible spending accounts.
• Life insurance and death benefits.
• Certain time off and leave of absence benefits.
• Well-being benefits, including an employee assistance program, fitness benefits, and employee clubs and activities.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior