Implementation Science Evaluation
Designing Tailored Solutions
The Implementation Science Collaborative (ISC) responds to pressing needs and questions related to global health programs and policies. In service to USAID, the HEARD project has evaluated two global as well as country-focused evaluation activities in Jordan, Nigeria, Guinea, and Burkina Faso.
Our Approach
All of our activities begin with a rapid scoping of proposed evaluations of multi-country or country-specific interventions. In addition to providing input to evaluation design, the Implementation Science Collaborative can also be engaged to evaluate any or every phase of program implementation.
Our global anchor partners The City University of New York, School of Public Health & Health Policy, and The University of California, San Francisco, Center for Global Health Delivery, Diplomacy & Economics, together with our sub-regional and technical resource partners, are mobilized to generate, analyze, and synthesize use evidence through country-driven needs and approaches. ISC’s global anchors serve as the Evaluation Lead, guiding the evaluation design and methodology and participating, as needed, in scoping activities.
In collaboration with the Evaluation Lead, the Design Lead is responsible for leading the design of the evaluation, developing the protocol and tools, and managing the data analysis process. The Evaluation Implementation Team is composed of individuals from Project Anchor partners, the ISC Core Team, and Sub-Regional Anchors for evaluations in their respective regions. Other Technical Resource Partners can be brought in through a competitive process, as needed.
A Strategy Reference Group (SRG) is established for evaluations that would benefit from applying the consideration of a broader expert group to the evaluation findings. The SRG will review the evaluation findings and take a consensus building approach to develop recommendations in areas of interest for the client/requestor.
The ISC is establishing an Evaluation & Dissemination Group to increase the relevance of and accessibility to implementation science and evaluation study findings.
Partners
All activities are led by a combination of global and sub-regional anchors in collaboration with other partners.
Evaluation Activities
This evaluation explored the quality, management, sustainability, and USAID alignment of Health Service Delivery and its activities to expand the access to and availability of integrated health services to quality Reproductive, Maternal, Newborn and Child Health (RMNCH) services in Jordan. The team used a combination of qualitative data collection, surveys, facility checklists and observations, validation of select monitoring data, and analysis of secondary data sources.
USAID Guinea launched a flagship five-year HSD Activity in December 2015 to support the provision of an essential and integrated care package for maternal, neonatal child health and family planning in a consistent, high-quality manner in health facilities and surrounding communities in seven out of eight the regions Guinea (Boké, Conakry, Kindia, Mamou, Faranah, Kankan and Labé). Goals of the evaluation were to: identify and document best/good practices, lessons learned, and insights from engagement of public/private sectors, and understand factors affecting post-investment sustainability of service delivery processes and outcomes.
Final Evaluation Report – FR | EN
Final Evaluation Report Brief – FR | EN
Standards-Based Management and Recognition (SBMR) Case Study – FR | EN
SBMR Case Study Brief – FR | EN
The purpose of this assessment was to explore the status of the Positive Youth Development (PYD) approach, YouthPower’s role in facilitating PYD uptake, and strategic considerations looking forward. The assessment examined successes and challenges of YouthPower’s experience with PYD programs; the extent to which the PYD approach is understood and utilized by youth development partners in the field; YouthPower’s role in advancing PYD, and the key considerations for expanding use of the approach globally. Assessment results will inform USAID on how the agency can most effectively support PYD through future youth development procurements, including YouthPower 2.
Final Evaluation Report –EN
Executive Summary –EN
PYD Assessment Presentation –EN
The purpose of this midterm evaluation was to review Global Health Program Cycle Improvement (GHPro) Project’s performance to date in the landscape of various support mechanisms funded by USAID’s Bureau for Global Health, with the goal of identifying opportunities to add value, improve program quality and efficiency, and reduce cost.
The purpose of the IMC Project was to contribute to a 50% reduction of malaria morbidity and mortality in Burkina Faso, relative to 2011 health management information system data, by improving the quality of prevention, diagnosis and treatment of malaria in 100% of the country’s public health facilities by the end of 2018. With the project originally due to end in September 2018, USAID/Burkina Faso requested an external evaluation to assess project progress and challenges related to malaria prevention and treatment efforts and to aid in the development of plans for future USAID-funded support to the national malaria control effort.
The USAID Health Evaluation and Applied Research Development project supported the USAID Nigeria Mission by developing an evaluation scope to address a complex set of impact evaluation and embedded learning needs. As the USAID Mission in Nigeria was preparing to award for two new, five-year bilateral health projects, the Integrated Health Project and President’s Malaria Initiative for States Project, the Mission sought support in conceptualizing an impact evaluation design that would not only measure achievement of intended Project outcomes and impacts, but also draw insights on the comparative strengths of the different program strategies, particularly the projects’ contrasting vertical and integrated approaches to malaria care.
