Sr. Enterprise Data Engineer
About The Position
The Senior Enterprise Data Engineer designs and creates complex data pipelines and curated data structures and products for use by data analysts across Stanford Health Care (SHC). The role develops data ingestion processes for the SHC Enterprise Data Platform (Lake), supports data movement processes, and provides consultation to other data engineers. Its purpose is to deliver data solutions for broad, consistent enterprise use that improve patient experience and outcomes, research capabilities, and operational results. The position collaborates with leaders and users to develop complex data stores and pipelines based on business needs; researches and maintains standard data modeling, DevOps, and development tools and processes; and explores technologies to improve solutions and efficiency. It performs and supports complex data mart analysis, development, and testing, applies knowledge across SHC data domains, and supports data-driven decision-making. The engineer contributes to data governance and stewardship, including metadata and data quality, and manages complex work, dependencies, expectations, and project delivery across departments. The role also helps define development and analytics standards, leads design reviews and peer reviews, supports analyst training and adoption of best practices, participates in analytics community and project working groups, tunes solution performance, and troubleshoots incidents through root cause analysis and countermeasures. Employees are expected to follow SHC’s C-I-CARE standards and support an exceptional patient and family experience.
Requirements
- Bachelor’s degree in information technology, information systems, business management, business analytics, business administration, or a directly related field from an accredited college or university.
- At least 7 years of experience in reporting, analytics, business intelligence, or healthcare technology; alternatively, at least 3 years of development experience in cloud data lake technologies (such as PySpark notebooks or pipelines on Databricks) using DevOps, CI/CD, and orchestration processes.
- Advanced knowledge of relational database concepts and design.
- Advanced data modeling skills and ability to translate business requirements into logical and physical database designs for moderate to large complex projects.
- Ability to develop secure, highly automated production solutions in cloud data platforms and technologies such as Azure, Databricks, PySpark, notebooks, and GitHub.
- Expert knowledge of SQL and ability to relate and use data across multiple data domains.
- Expert knowledge and skills in SHC standard development and design tools and general DevOps concepts and practices.
- Ability to tune performance of moderately complex solutions and troubleshoot incidents using root cause analysis and countermeasures.
- Ability to work without direct supervision and provide regular updates to a supervisor about tasks, pain points, and potential roadblocks.
- Demonstrated ability to complete complex projects and produce good-quality work with only rare problems or defects in moderate to complex solutions.
- Ability to present moderately complex ideas and information to varied audiences, including senior managers and industry groups.
- Effective verbal, written, and interpersonal communication skills.
- Ability to understand how work supports SHC’s vision and propose better ways to achieve it.
- Commitment to SHC C-I-CARE patient- and family-centered interaction standards.
Responsibilities
- Collaborate with leaders and users to create, test, and implement complex data stores and pipelines based on business needs and requirements.
- Research, plan, and maintain the performance of SHC’s standard data modeling, DevOps, and development tools and processes.
- Explore new technologies to create solutions and improve development or operational efficiency.
- Independently analyze, develop, and test complex data marts, and support other data engineers performing these tasks.
- Apply knowledge of SHC data domains to produce high-quality solutions and encourage data-driven decision-making.
- Build and maintain working relationships with users and team members, including directors and above.
- Participate as a technical data steward in metadata, data quality, and other data governance activities; help identify and resolve data quality issues.
- Manage multiple complex activities, including tasks, dependencies, and scope and timeline expectations.
- Provide project management or leadership to drive project timelines and deliverables across departments and functions.
- Participate in project working groups with team members, users, analysts, clinicians, and SHC leadership.
- Lead teams in defining design and development standards and conduct peer reviews of solution designs for compliance.
- Define analytics standards and best practices and support business data analysts with training and adoption.
- Contribute to SHC analytics community meetings.
- Tune performance of complex solutions.
- Troubleshoot incidents, perform root cause analysis, and establish countermeasures to improve supported solutions.
- Follow SHC C-I-CARE standards in interactions with patients, families, and colleagues.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
