Program Quality Evaluator

Global Support and Development•Charlotte, NC

2d•Onsite

About The Position

The Program Quality Evaluator leads the technical design and execution of strategic, programmatic, project-level, and rapid-response evaluations across Global Support and Development’s Programs Section. The role develops and implements evaluation strategies, data collection, and learning processes across GSD sub-strategies, programs, and projects, and supports the Program Quality and Design Coordinator in designing sustainable external projects with GSD staff and partners. The position leads evaluations across GSD focus areas, supports evaluation action and learning plans, and ensures participatory evaluation design involving staff and project partners. Responsibilities include developing evaluation Terms of Reference, recruiting and managing third-party evaluators, conducting qualitative and quantitative evaluation work, applying AI responsibly, supporting the GSD Measurement Framework, facilitating validation of findings, and leading the biannual learning agenda. The evaluator also produces briefs, reports, and presentations; leads impact reporting; and supports preparedness project co-design with partners in the Caribbean and Central America. This is an on-site role in Charlotte, North Carolina, with routine domestic and international travel of up to 30%. Work is generally sedentary in an office setting but may involve movement, lifting and moving items up to 20 pounds, bending and stooping, extended computer use, and travel with overnight stays. Staff must follow applicable safety protocols, including use of PPE when required. Applicants must be eligible to work in the United States; sponsorship is not offered.

Requirements

At least 12 years of international evaluation experience in response and development settings, including designing, leading, executing, and actioning varied evaluations in international disaster preparedness, response, and related fields.
At least 10 years of successful management of external evaluation vendor teams in international humanitarian and development settings, including designing and executing scopes of work and contracts, maintaining quality and timeliness, and tracking deadlines, scope, and budget.
At least 10 years of proven qualitative and quantitative data collection and analysis experience, with a solid grounding in valid uses of artificial intelligence in evaluation.
At least 8 years of experience designing projects in international disaster management settings.
At least 12 years of experience working in international humanitarian and development settings.
Ability to work independently with minimal support while meeting quality assurance expectations.
Master’s degree in Evaluation, Social Sciences, Research Methods, International Development, Statistics, or a related field.
Strong understanding of a wide range of evaluation designs and specialized frameworks, including OECD-DAC evaluation criteria.
Technical proficiency in qualitative and quantitative evaluation methodologies.
Proficiency with quantitative analysis tools such as SPSS, Stata, or R, and/or qualitative analysis tools such as NVivo or ATLAS.ti.
Ability to design, lead, and execute multi-country, regional, and multi-portfolio evaluations to identify systems change.
Expertise in experimental and quasi-experimental designs, mixed-methods research, and specialized evaluation frameworks.
Ability to build Monitoring, Evaluation, and Learning systems, theories of change, and results frameworks from scratch.
Experience with mobile data collection software such as KoboToolbox or ODK, and data visualization tools such as Tableau or PowerBI.
Cultural awareness across GSD’s areas of operation—the Caribbean, Central America, and the Pacific—and ability to collaborate and build relationships with a wide range of stakeholders.
Experience overseeing and assuring the quality of data and information collection, management, and analysis.
Understanding of emergency or disaster-response best practices, including safeguarding, protection mainstreaming, beneficiary selection, and project management.
Outstanding written and verbal communication skills, including presentations for diverse audiences.
Technical competence in sampling, statistical analysis, and other types of data analysis.
Discernment and discretion regarding confidential organizational, partner, and donor activities and communications.
Strong organizational skills and ability to shift tasks rapidly.
Must be eligible to work in the United States; sponsorship is not offered.

Nice To Haves

Project management certification is desired.
Fluency in Spanish is highly desirable.

Responsibilities

Lead technical design, execution, and synthesis of project- and program strategy-level evaluations across GSD focus areas, including response evaluations, in accordance with GSD quality standards.
Ensure evaluation management action and learning plans are executed.
Ensure program- and project-level evaluation designs are participatory and inclusive of GSD staff and project partners.
Develop evaluation Terms of Reference and recruit and manage evaluation personnel when third parties conduct evaluations.
Lead evaluation implementation as appropriate, using qualitative and quantitative data collection and analysis tools aligned with industry standards.
Ensure AI is integrated into program quality evaluations and related work responsibly and in accordance with GSD and industry standards.
Support continued operationalization of the GSD Measurement Framework.
Organize and co-facilitate validation of evaluation findings with internal teams, local partners, and institutional stakeholders.
Lead development and execution of the biannual learning agenda aligned with the organization’s business model and strategic aim.
Develop and deliver evaluation briefs, summary reports, and presentation decks to support organizational learning, including at the senior leadership team level.
Lead impact reporting and socialization.
Support the Program Quality and Design Coordinator in co-designing preparedness projects with GSD staff and partners in the Caribbean and Central America.
Support the Program Quality and Design Coordinator in leading timely, efficient co-design processes that meet or exceed GSD minimum expectations.
Promote responsible stewardship of financial and other resources to maximize benefits for people affected by or at risk from disasters.
Promote and embody GSD’s values of accountability, humility, and integrity.
Foster excellence and equity by prioritizing inclusion and learning in program quality and performance measurement.
Perform other duties as assigned.