Clinical Informatics Specialist

UCSF•San Francisco, CA

1d•$110,000 - $115,000

About The Position

The California Department of Public Health (CDPH) Office of Data Strategy is recruiting for a Clinical Informatics Specialist III to join an innovative team advancing CDPH’s enterprise data modernization efforts. The incumbent will apply advanced data engineering and informatics expertise within a cloud-native data environment (primarily Databricks, leveraging Apache Spark and Delta Lake for big-data processing and storage) to design, build, and maintain scalable data pipelines and enterprise data marts that support public health program operations, analytics, and strategic decision-making. The incumbent will serve as a core member of a cross-functional team, collaborating closely with data scientists, analysts, informaticians, and public health program partners to deliver high-quality, well-governed, and interoperable data products.

Requirements

Bachelor's degree in public health, health care information technology, computer science, or related area, and / or equivalent combination of experience / training PLUS either 3 years of experience in computer or data pipeline programming and database management, OR 3 years working in public health
Strong skills associated with statistical analysis, database management and systems programming, including SQL, R, Python, and/or experience with Apache Spark language APIs (e.g. PySpark, sparklyr).
Experience with Databricks, Delta Lake, or cloud-based data lake architectures.
Broadly encompassing or in-depth knowledge of clinical, health systems, health analytics, or public health informatics.
Thorough knowledge of all relevant clinical or public health informatics software and systems, and of the highly complex concepts, principles, policies, methodologies, techniques, best practices, regulations, and standards practices involved with health systems, health analytics, public health surveillance or electronic medical data management.
Strong analytical and critical thinking skills, with the ability to quickly analyze problems, determine appropriate level of intervention, and develop and apply effective solutions, collect and analyze system performance data, and produce substantive reports and analyses
Strong problem-resolution skills, with the ability to quickly diagnose problems, and develop, test, and implement appropriate and effective solutions in a timely manner
Ability to work with senior staff and managers in clinical information technology, health care management, and business analytics, serving as a technical resource and providing advice and counsel on issues of functionality, efficiency, cost-effectiveness, policy, and performance
Experience using version control systems (e.g., Git) for collaborative development and code management.
Strong ability to communicate complex information in a clear and concise manner both verbally and in writing.

Nice To Haves

Master’s degree in computer science, informatics, public health, biostatistics, epidemiology or epidemiology and biostatistics and / or equivalent combination of experience / training PLUS either 1 year of experience in computer or data pipeline programming and database management, OR 1 year working in public health
Detail oriented, with proven ability to effectively manage time, see projects through to completion, organize competing priorities, and effectively address complex, urgent issues as they arise
Strong interpersonal skills, with the ability to collaborate productively, work in a team environment, and to train and support clinical informatics users at all professional and technical levels throughout the medical center
Strong ability to think creatively to recommend action steps or strategize solutions relative to public health surveillance, epidemiology, informatics, program evaluation, or research.
Demonstrated proficiency relating to logical data design, data warehouse design, data integration, and data modeling.

Responsibilities

Works with business, technical, and clinical personnel to develop and implement complex clinical informatics solutions and to create integrated architecture to ensure optimal use of tools and components.
Collaborates with senior engineering staff, the Clinical Informatics Specialist 4, and other Office of Data Strategy personnel to design, implement, and maintain highly complex public health data systems and pipelines. Ensures that systems and enterprise data marts are built for scalability, interoperability, reliability, and ease of use within a modern cloud environment (e.g., Databricks, Delta Lake, cloud storage).
Works closely with subject‑matter experts and technical teams to translate public health program workflows and data needs into technical requirements. Develops and maintains ingestion, transformation, and curation logic using SQL, Python, PySpark, or related technologies. Performs advanced quality assurance testing, validation, and monitoring of data pipelines to ensure data accuracy, reliability, security, and confidentiality.
Troubleshoots and resolves technical and data‑quality issues across integrated data systems. Develops dashboards, metrics, and monitoring tools to track pipeline performance and inform decisions about system enhancements.
Collaborates closely with business operations, healthcare clinicians, and IT applications and technical teams to translate operations workflow and patient experience objectives into technical requirements.
Develops and maintains deep familiarity with CDPH’s data systems, data elements, and metadata structures to promote consistency, alignment, and interoperability across programs. Designs, implements, and maintains complex cloud-based data pipelines and transformation logic using SQL, Python, PySpark, R, or related tools.
Develops and maintains technical documentation, including data models, workflow diagrams, pipeline specifications, metadata, and operational runbooks to support ongoing maintenance and reuse. Automates data ingestion, validation, quality checks, and reporting processes to improve efficiency and reduce manual workload.
Provides coordination and guidance to internal CDPH programs and Local Health Jurisdictions (LHJs) on topics related to data management, data quality, matching, linkage, and dissemination.
Recommends best practices and establishes protocols for producing routine and ad hoc analytical data products using multisource data integrations. Contributes to the development of dynamic dashboards (e.g., R/Shiny, Databricks SQL dashboards, Tableau) to support operational awareness and public health action.
Serves on multidisciplinary project teams to support data architecture planning and the development of scalable, cost-effective solutions that meet evolving programmatic and technical needs.
Serves as a technical resource for data engineering, informatics, and data management needs across the Office of Data Strategy. Writes and optimizes SQL queries, Python/PySpark transformations, R scripts, and related code to support pipeline optimization, data access, and data integration across multiple systems.
Provides advanced troubleshooting and issue resolution for data ingestion processes, cloud-based pipelines, automated jobs, and system integrations. Supports improvements to data structures and workflows related to communicable disease data systems by recommending and implementing enhancements that strengthen data quality, automation, and performance.
Develops and maintains technical documentation, operational procedures, and training materials to support internal teams and external partners. Performs complex quality assurance and data validation activities, ensuring pipeline outputs are accurate, timely, and aligned with data governance standards.
Serves as a technical liaison between the Office of Data Strategy, CDPH programs, and external partners to support adoption of modern data engineering practices, tools, and standards. Provides guidance on data security, confidentiality, metadata practices, and cloud data management.
Conducts routine data quality assurance activities and recommends improvements to data architecture, pipeline design, and system functionality. Supports production of dashboards and automated reports that promote transparency, operational awareness, and program decision-making.
Participates in departmental and programmatic strategic planning efforts, including initiatives related to racial equity, data modernization, and emergency response. Ensures timely completion of engineering-related project deliverables and fosters adoption of scalable, efficient, and well-designed data solutions.
Provides support, troubleshooting, and problem solving at an advanced level, and may produce and deliver user training curricula and system documentation to support internal and external partners. Ensures successful completion of project deliverables.
Contributes to preparation of dashboards and automated reports. Participates in departmental and programmatic strategic planning and other related initiatives (such as in support of racial equity and emergency response).