Data Engineer, Senior

UPMC•Pittsburgh, PA

2d•Hybrid

About The Position

Senior Data Engineers develop custom end-to-end integration solutions for large, diverse, and complex healthcare datasets. The work follows test-driven development, SDLC standards, and scrum principles, with a strong emphasis on accuracy, performance stability, security, monitoring, alerting, and pipeline uptime. The role works closely with business, technical, and potentially clinical professionals. Additional responsibilities may include product support and ongoing data maintenance. The position requires managing multiple projects, prioritizing work, and communicating effectively in writing and verbally. It is in-office three days per week. Applicants must be legally authorized to work in the United States without requiring current or future employment visa sponsorship; UPMC does not offer sponsorship and does not participate in STEM OPT.

Requirements

Typically 7 or more years of relevant experience, or an equivalent combination of education and experience.
Technical writing skills.
Proficiency in integration tools, ETL concepts, Java, Python, Spark, Kubernetes, OMOP CDM, Microsoft Fabric, and AWS tools such as Lambda Functions, S3, and AWS Glue.
Advanced analytical and problem-solving skills.
Ability to set and meet deadlines for complex projects.
Ability to work in high-pressure situations.
Reporting and data visualization skills.
Excellent attention to detail.
Proficiency in healthcare IT data or systems is required.
Legally authorized to work in the United States without requiring current or future employment visa sponsorship.

Nice To Haves

A bachelor's degree in mathematics, statistics, economics, finance, computer science, or another relevant field is preferred.
Experience with modern, scalable big-data architecture.
Experience with modern AI development workflows and accelerators.
Experience with clinical data formats and exchange protocols such as HL7, CDA, CCDA, and FHIR is strongly preferred.

Responsibilities

Deliver complex end-to-end integration solutions that follow Data Engineering best practices and use test-driven development and standard SDLC practices.
Execute solutions using appropriate Data Engineering design, development, and delivery processes.
Model adherence to integration policies and procedures for other team members.
Create infrastructure diagrams for project-specific integrations.
Create monitoring, alerting, and error messaging that integrate with relevant tools and follow Data Engineering standards.
Independently manage complex projects and multiple user stories, carrying stories through each scrum stage gate.
Represent the Data Engineering team in vendor and client discussions to refine requirements, identify data sources, make design decisions, follow standards, and obtain necessary access for accurate data representation.
Work constructively with teams and roles across the organization while representing the Data team as a subject matter expert.
Write and maintain technical implementation and support documentation for integrations.
Document and troubleshoot production issues, address them appropriately with customers, and communicate effectively with the team and stakeholders.
Manage tasks and timelines for assigned work and promptly communicate risks and delays to the team lead.
Deliver clear, concise, and effective written and oral communications.
Complete projects, tasks, and initiatives with a team-first approach; collaborate, provide feedback, and adapt to change as needed.
Pursue self-study, training, and opportunities to broaden expertise and stay current with industry and organizational trends; seek and incorporate feedback.
Build relationships across the One-Enterprises organization and develop awareness of business drivers and customer needs to align work and accelerate value delivery.
Assist with educating and coaching members of the Data Engineering team and the broader UPMC Enterprises team.
Objectively assess and sign off on teammates' work according to team standards and processes.