Consultant, MLE Strategy (Immunization Demand Generation Pilot)

Evidence Action

3d•Remote

About The Position

Evidence Action is preparing to pilot an Immunization Demand Generation (IDG) program in Nigeria, focused on increasing routine childhood vaccination coverage by boosting demand among caregivers of children under two. The intervention comprises three components: (1) digital reminders (text and voice) to caregivers about vaccination schedules, (2) community ambassadors who encourage vaccination uptake through trusted social networks, and (3) targeted incentives for caregivers in areas with low baseline vaccination rates. The pilot will be implemented across 10 LGAs in two Nigerian states. Supervised by the Associate Director of MLE Strategy, this consultancy will design, develop, and implement the MLE system for the IDG pilot, with a focus on three primary functions: (1) formative research design and analysis, (2) MLE system design and tool development, and (3) data analysis and reporting. Phase 1 - Formative Research and Early MLE Design (roughly months 1 to 2 of engagement) Revised pilot MLE concept note - Review the existing MLE documentation, pilot proposal, and budget; identify gaps, outdated assumptions, and areas requiring alignment with the program team; produce a revised concept note signed off by the Global MLE-S team and program leads Formative research design and report - Design in-country formative research (timing dependent), including development of data collection tools (structured observation guides, health worker, caregiver, and community health worker interview guides) to assess preferences and proposed pilot design; support in-country data collection and analysis; document findings and implications in a formative research report Pilot MLE framework - Begin drafting the MLE framework, including indicator definitions, sampling approach, sample size calculations, evaluation methodology, and data flow documentation. Refine sample size calculations based on evolving pilot design and treatment variation decisions, in coordination with J-PAL where applicable Phase 2 - MLE Design Finalization, Baseline, and Pre-Pilot (roughly months 3 to 5 of engagement) Independent Monitoring Firm Selection and IRB Preparation - Support selection of an IM firm for the pilot data collection and IRB preparation for the pilot, including contributing to the pilot IRB protocol Data collection instruments package - Develop all data collection instruments ready for piloting at the start of Phase 2: baseline and endline surveys, phone validation surveys, ambassador and caregiver surveys, and data validation tools; include community survey instruments if community-level coverage data is determined to be a priority during the framework design Finalized instruments and data quality assurance protocols - Oversee pilot-testing of all data collection instruments, make revisions as needed, and produce data quality assurance protocols including data verification approaches Baseline report - Oversee baseline survey implementation including enumerator training and quality monitoring; deliver a baseline report with findings and implications for program design Phase 3 - Pilot Implementation and Monitoring (roughly months 6 to 12 of engagement) Process monitoring outputs - Implement the process monitoring approach, producing summary outputs for the program team at the frequency established in the design Program performance reports - Conduct periodic data quality checks and support troubleshooting of data collection systems; Support interim data analysis and produce summary outputs for program team use and donor reporting Phase 4 - Pilot Endline analysis, reporting, and closeout (roughly months 12 to 15 of engagement) Endline survey and data validation report - Oversee endline facility survey implementation including enumerator training and quality monitoring; conduct data validation exercises to assess the accuracy and completeness of data collected during endline Pilot report - Support production of the pilot report, including evaluation analysis, data quality findings, cost-effectiveness inputs, and recommendations for program adaptation and scale-up decisions Learning synthesis - Contribute to a synthesis covering what worked, what did not, and what would need to change for potential scale-up Through Pilot Work Participate in regular coordination meetings with the Global MLE-S team and country program team, including scheduled check-ins and ad hoc calls as needed, and be available for meeting scheduled during the West Africa time zone working hours (UTC+1) Contribute MLE inputs to discussions and pilot development throughout the program Flag emerging issues, timeline risks, or scope changes proactively to the Global MLE Strategy Associate Director Accommodate periodic meetings across West Africa and US Eastern time zones as agreed with the team The consultant must be available for at least one in-country trip to Nigeria, likely during the baseline data collection phase.

Requirements

Advanced degree in public health, epidemiology, statistics, public policy, or a related field.
5 - 7 years of MLE experience in global health programs.
Demonstrated experience designing and implementing MLE systems for facility-based and community-based health programs in low- and middle-income countries.
Quantitative skills, including experience with sampling design, survey implementation, and data analysis.
Proficiency in Stata or equivalent required.
Experience developing data quality assessment and verification methodologies.
Ability to work independently and manage MLE workstreams with limited in-country support.
Ability to produce clear, decision-oriented reports for program and donor audiences.
Must be available for at least one in-country trip to Nigeria, likely during the baseline data collection phase.
Ability to be available for meetings scheduled during the West Africa time zone working hours (UTC+1).

Nice To Haves

Experience with immunization programs.
Experience with digital health interventions.
Experience working with community health workers or ambassadors.
Familiarity with J-PAL methodologies.

Responsibilities

Design, develop, and implement the MLE system for the IDG pilot.
Conduct formative research design and analysis.
Develop MLE system design and tools.
Perform data analysis and reporting.
Review existing MLE documentation, pilot proposal, and budget to identify gaps and areas for alignment.
Produce a revised MLE concept note.
Design in-country formative research, including developing data collection tools.
Support in-country data collection and analysis for formative research.
Document formative research findings and implications.
Draft the MLE framework, including indicator definitions, sampling approach, sample size calculations, evaluation methodology, and data flow documentation.
Refine sample size calculations based on evolving pilot design.
Support the selection of an Independent Monitoring Firm.
Assist with IRB preparation for the pilot.
Develop all data collection instruments, including baseline and endline surveys, phone validation surveys, ambassador and caregiver surveys, and data validation tools.
Oversee pilot-testing of data collection instruments and make revisions.
Produce data quality assurance protocols.
Oversee baseline survey implementation, including enumerator training and quality monitoring.
Deliver a baseline report with findings and implications for program design.
Implement the process monitoring approach and produce summary outputs.
Conduct periodic data quality checks and support troubleshooting of data collection systems.
Support interim data analysis and produce summary outputs for program team use and donor reporting.
Oversee endline survey implementation, including enumerator training and quality monitoring.
Conduct data validation exercises to assess data accuracy and completeness.
Support the production of the pilot report, including evaluation analysis, data quality findings, cost-effectiveness inputs, and recommendations.
Contribute to a synthesis of lessons learned for potential scale-up.
Participate in regular coordination meetings with the MLE-S team and country program team.
Contribute MLE inputs to discussions and pilot development.
Flag emerging issues, timeline risks, or scope changes proactively.
Accommodate periodic meetings across West Africa and US Eastern time zones.