Sr. Enterprise AI Platform Engineer
About The Position
This role focuses on designing, developing, and enhancing the processes, tools, and infrastructure that support Stanford Health Care (SHC) data scientists as they create and deploy AI/ML solutions using the Enterprise Data Platform. The position coordinates closely with data scientists on DevOps, SecOps, and FinOps processes; infrastructure planning; automated Infrastructure as Code (IaC); and monitoring to assess the accuracy, validity, and usefulness of AI/ML solutions over time. The posting also describes responsibilities for a senior enterprise data engineering role: designing complex data pipelines and curated data structures or products for enterprise-wide use, and consulting with and supporting other data engineers in designing, developing, and implementing data movement processes. The role provides data solutions for broad and consistent use across SHC. The engineer collaborates with leaders and users to develop complex data stores and pipelines, maintains and improves standard data modeling, DevOps, and development tools and processes, and explores new technologies to improve solutions and operational efficiency. The position contributes to data governance, data quality, analytics standards, project delivery, and technical leadership across teams and departments. It requires strong communication and relationship-building skills, independent work, and a commitment to SHC’s patient- and family-centered C-I-CARE standards.
Requirements
- Bachelor’s degree in information technology, information systems, business management, business analytics, business administration, or a directly related field from an accredited college or university.
- At least 7 years of experience in reporting, analytics, business intelligence, or healthcare technology; alternatively, at least 3 years of development experience in cloud data lake technologies, such as PySpark notebooks or pipelines on Databricks, using DevOps, CI/CD, and orchestration processes.
- Advanced knowledge of relational database concepts and design.
- Advanced data modeling skills, including translating business requirements into logical and physical database designs for moderately complex to large projects.
- Ability to develop secure, highly automated production solutions using cloud data platforms and technologies such as Azure, Databricks, PySpark, notebooks, and GitHub.
- Expert knowledge of SQL and proficiency in relating and using data across multiple data domains.
- Expert knowledge and skills in SHC’s standard development and design tools and general DevOps concepts and practices.
- Ability to tune moderately complex solutions and troubleshoot incidents, perform root-cause analysis, and establish countermeasures.
- Ability to work without direct supervision and provide regular updates to a supervisor on pending tasks, pain points, and potential roadblocks.
- Demonstrated ability to complete complex projects and deliver good-quality work with only rare problems or defects in moderately to highly complex solutions.
- Ability to present moderately complex ideas and information to varied audiences, including senior managers and industry groups.
- Effective verbal, written, and interpersonal communication skills.
- Understand how work supports SHC’s vision and propose better ways to achieve it.
- Adopt and execute SHC’s C-I-CARE standards for patient- and family-centered interactions.
Responsibilities
- Collaborate with leaders and users to create, test, and implement complex data stores, pipelines, and related solutions based on business needs and requirements.
- Research, roadmap, and maintain the performance of SHC’s standard data modeling, DevOps, and development tools and processes.
- Explore new technologies to create solutions and improve development or operational efficiency.
- Independently analyze, develop, and test complex data marts, and support other data engineers performing these tasks.
- Use knowledge of SHC data domains to produce high-quality solutions and encourage data-driven decision-making.
- Build strong working relationships with users and team members, including directors and above.
- Participate as a technical data steward in metadata, data quality, and other data governance activities; help identify and resolve data quality issues.
- Manage multiple complex activities, including tasks, dependencies, and user and team expectations about scope and delivery timelines.
- Provide project management or leadership to drive timelines and deliverables across departments and functions.
- Participate in project working groups with team members, users, analysts, clinicians, and SHC leadership.
- Lead teams in defining design and development standards and conduct peer reviews of solution designs for compliance.
- Define analytics standards and best practices and support business data analysts in training and adopting them.
- Participate in and contribute to SHC analytics community meetings.
- Tune the performance of complex solutions.
- Troubleshoot incidents, perform root-cause analysis, and establish countermeasures to improve supported solutions.
- Coordinate with data scientists on DevOps, SecOps, FinOps, infrastructure planning, and automated IaC processes for AI/ML solutions.
- Create monitoring capabilities to assess AI/ML solution accuracy, validity, and usefulness over time.
- Adopt and execute SHC C-I-CARE standards in interactions with patients, families, and colleagues.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
