Program Evaluator - Proactive Support Team (P

Urban Pathways, Inc. • New York, NY

90d

About The Position

Reporting to the Medical Director, the Program Evaluator for the Proactive Support Team (PST) program will have a central role in documenting the impact of the PST model, supporting replication across sites, and producing evaluation reports that inform system-level improvements. The Program Evaluator will be responsible for leading data management, evaluation, and outcome measurements across the initiative. This role ensures that program fidelity, feasibility, scalability, and sustainability are rigorously assessed, and that data drives both daily practice and long-term strategy. The Program Evaluator will work closely with program leadership, frontline staff, and external evaluators to design, manage, and interpret qualitative and quantitative data systems, ensuring accurate reporting to funders and stakeholders. The Program Evaluator will be an active listener, provide high-quality customer service, and respond by exhibiting cross-cultural awareness with the ability to promote and contribute to an equitable and inclusive anti-racist organizational culture and environment.

Requirements

• Master’s degree in Public Health, Social Work, Psychology, Evaluation Science, Data Analytics, or a related field required.
• At least 3 years of experience in program evaluation, applied research, or data analytics in a human services or healthcare setting.
• Experience with Institutional Review Board (IRB) protocols and mixed-methods evaluation preferred.
• Strong knowledge of evaluation frameworks (logic models, outcomes-based evaluation, CQI).
• Proficiency in both quantitative and qualitative methods.
• Skilled in data visualization and dashboard creation (Excel, Power BI, Tableau, or similar).
• Excellent communication skills, with ability to translate data into actionable insights for staff and leadership.
• Strong problem-solving and project management skills.
• Commitment to Urban Pathways’ mission of person-centered, strength-based care.

Nice To Haves

• Experience with Institutional Review Board (IRB) protocols and mixed-methods evaluation preferred.

Responsibilities

• Design and oversee data collection systems to track engagement, service utilization, housing stability, and health outcomes.
• Develop and manage program logic models, KPIs, and fidelity monitoring tools.
• Conduct internal program evaluation, including pre/post surveys, staff fidelity assessments, and resident outcome tracking.
• Collaborate with external evaluators to ensure independent validation of results.
• Prepare IRB protocols and ensure compliance with ethical research standards.
• Conduct both qualitative (e.g., interviews, focus groups) and quantitative (e.g., statistical analysis, dashboards) evaluations.
• Produce monthly dashboards, quarterly performance reports, and annual evaluation summaries for funders and leadership.
• Support continuous quality improvement by providing timely feedback loops to program staff.
• Work with program staff to integrate evaluation findings into daily practice.
• Train staff in data literacy, documentation standards, and fidelity to the PST engagement model.
• Support program leadership in aligning evaluation findings with organizational strategic priorities.
• Disseminate findings to stakeholders, including through conference presentations, peer-reviewed publications, and policy briefs.
• Ensure timely submission of accurate evaluation reports to Helmsley Charitable Trust and other funders.
• Manage data entry and reporting platforms (e.g., AWARDS, Excel, statistical packages).
• Assist with grant applications by providing evaluation data, outcomes analysis, and projected impact metrics.
• Ensure compliance with all Urban Pathways, regulatory, and funding agency requirements regarding data management.
• Communicate effectively, both verbally and in writing, in a professional manner.
• Facilitate and attend meetings, training, and supervisory sessions.
• Respond promptly to communications, including phone calls, emails, and written inquiries.

Benefits

• Healthcare Coverage: Medical, dental, and vision insurance plans to keep you and your family in good health.
• Retirement Savings: A 403(b) plan and a 401(a) with employer annual contribution to help you plan for a secure financial future.
• Paid Time Off: Generous paid time off, including vacation, holidays, and personal days.
• Professional Development: Opportunities for continuous learning and professional development to enhance your skills and advance your career.
• Flexible Work Arrangements: Work-life balance is important to us, and we offer flexible work arrangements to accommodate your needs.
• Wellness Programs: Employee wellness programs, including fitness initiatives and mental health support.
• Employee Assistance Program (EAP): Confidential counseling and support services for personal or work-related issues.
• Employee Recognition: Recognition programs to celebrate and reward outstanding contributions.

What This Job Offers

• Career Level: Mid Level
• Education Level: Master's degree
• Number of Employees: 251-500 employees