Program Evaluator

ATA Services Inc•Honolulu, HI

2d•$0 - $52•Hybrid

About The Position

ATA Services is seeking Program Evaluators to provide evaluation and epidemiological support to the Adult Mental Health Division (AMHD) for reports to the legislature on emergency transportations, assisted community treatment petitions and orders, and related services or programs. This position collects, analyzes, and interprets behavioral health and service utilization data; designs and leads the development of reporting and evaluation systems; and works with DOH and partnering agencies to manage local logistics and data collection support. The Program Evaluator applies qualitative and quantitative research methods to assess program implementation, data infrastructure, and outcomes; and supports DOH in meeting annual legislative reporting requirements while building a sustainable framework for ongoing program monitoring and quality improvement.

Requirements

Master's degree from an accredited college or university in Health Services Administration, Public Health, Psychology, Epidemiology, Social Work, Public Administration, or a related field.
Minimum of two years of professional experience in program evaluation, applied research, or health services/quality improvement, including experience with mixed-methods (qualitative and quantitative) research designs.
Demonstrated experience designing and conducting interviews, surveys, and other qualitative data collection including coding and synthesis.
Experience with quantitative data reporting, statistical analysis, and interpretation of administrative and health services data.
Working knowledge of relational database principles, data mapping, and data quality/gap analysis.
Familiarity with IRB protocols and human subjects research requirements.

Responsibilities

Review legislation and relevant materials to document current implementation and operational processes, including variation across agencies and/or programs.
Conduct semi-structured interviews and/or surveys with relevant stakeholders (e.g., service providers, hospitals, court personnel) to supplement document review and identify barriers to and facilitators of successful program implementation.
Conduct data mapping and gap analysis of existing data systems relevant to reporting. Inventory available data relevant to legislative reporting elements, noting data quality, completeness, and limitations.
Assess feasibility of administrative data linkages, including records from other agencies (e.g., MedQuEST, hospitals, behavioral health facilities, district and circuit courts, law enforcement). Prepare and submit IRB materials as needed.
Develop an evaluation framework linking contextual inputs, program characteristics, and outcomes informed by program reporting elements.
Draft appropriate program evaluation and analysis plans.
Develop standardized data collection tools.
Conduct data quality assessments and preliminary descriptive analyses.
Provide recommendations for future outcome evaluation activities and draft and finalize annual legislative reports in coordination with DOH staff, incorporating qualitative implementation findings, the data inventory, and evaluation/analysis findings as appropriate.
Assist with drafting testimony as needed.
Organize and facilitate in-person or virtual meetings as needed to engage DOH staff and partnering agencies.
Translate technical findings into clear, actionable recommendations for DOH leadership and other stakeholders.
Performs other duties as assigned.