Types of Research
This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement.
Aid results information is often not comparable, since monitoring and evaluation frameworks, information gathering processes, and definitions of “results” differ across donors and governments. This report reviews approaches to results monitoring and evaluation used by governments in developing countries, and highlights trends and gaps in national monitoring and evaluation (M&E) systems. We collect evidence on 42 separate government M&E systems in 23 developing countries, including 17 general national M&E systems and 25 sector-specific national M&E systems, with 14 focused on HIV/AIDS, 8 on health, and 3 on agriculture. The evidence review includes external case studies and evaluations of M&E systems, government M&E assessments, M&E plans, strategic plans with an M&E component, and multi-country reviews of M&E, accountability, and aid effectiveness. We evaluate harmonization of government and development partner M&E systems, coordination and institutionalization of government M&E, challenges in data collection and monitoring, and analysis and use of results information. We also report on key characteristics of M&E systems in different sectors.
This report reviews the current body of peer-reviewed scholarship exploring the impacts of morbidity on economic growth. This overview seeks to provide a concise introduction to the major theories and empirical evidence linking morbidity – and the myriad different measures of morbidity – to economic growth, which is defined primarily in terms of gross domestic product (GDP) and related metrics (wages, productivity, etc.). Through a systematic review of published manuscripts in the fields of health economics and economic development we further identify the most commonly-used pathways linking morbidity to economic growth. We also highlight the apparent gaps in the empirical literature (i.e., theorized pathways from morbidity to growth that remain relatively untested in the published empirical literature to date).
Donors and governments are increasingly seeking to implement development projects through self-help groups (SHGs) in the belief that such institutional arrangements will enhance development outcomes, encourage sustainability, and foster capacity in local civil society – all at lower cost to coffers. But little is known about the effectiveness of such institutional arrangements or the potential harm that might be caused by using SHGs as ‘vehicles’ for the delivery of development aid. This report synthesizes available evidence on the effectiveness of Self-Help Groups (SHGs) in promoting health, finance, agriculture, and empowerment objectives in South Asia and Sub-Saharan Africa. Our findings are intended to inform strategic decisions about how to best use scarce resources to leverage existing SHG interventions in various geographies and to better understand how local institutions such as SHGs can serve as platforms to enhance investments.
This report draws on past and present peer-reviewed articles and published reports by institutions including the World Health Organization (WHO), the UK Department for International Development (DFID), and others to provide a scoping summary of the household-level spillovers and broader impacts of a select group of health initiatives. Rather than focusing on estimates of the direct health impacts of investments (e.g., reductions in mortality from vaccine delivery), we focus on estimates of the less-often reported spillover effects of specific health investments on household welfare or the broader economy. The brief is designed to give a concise overview of major theories linking health improvements to broader social and economic outcomes, followed by more in-depth summaries of available local- and country-level estimates of broader impacts, defined as project spillovers offering local, regional and national social and economic benefits not typically reported in project evaluations.
The commercial alcohol industry in Africa may provide opportunities to increase market access and incomes for smallholder farmers by increasing access to agriculture-alcohol value chains. Despite the benefits of increased market opportunities, the high costs to human health and social welfare from increased alcohol use and alcoholism could contribute to a net loss for society. To better understand the tradeoffs between increased market access for smallholders and societal costs associated with harmful alcohol consumption, this paper provides an inventory of the societal costs of alcohol in Sub-Saharan Africa (SSA). We examine direct costs associated with addressing harmful effects of alcohol and treating alcohol-related illnesses, as well as indirect costs associated with the goods and services that are not delivered as a consequence of drinking and its impact on personal productivity. We identified resources using Google Scholar and the University of Washington libraries, and utilized the Global Burden of Disease (GBD) database by the Institute for Health Metrics and Evaluation (IHME) and the World Health Organization’s Global Information System on Alcohol and Health (GISAH) database. We also utilized FAOSTAT to retrieve raw data on national-level alcohol production and export statistics. We find that hazardous alcohol use contributes to early mortality and morbidity, loss of productivity, property damage, and other social costs and harms for drinkers and those around them. Drinking also affects vulnerable segments of the population disproportionately. Policymakers, local authorities, and donor agencies can use the information presented in this paper to plan and prepare for the higher consumption levels and subsequent social costs that may follow through agricultural development and economic growth in the region.
This paper is the third in EPAR’s series on Higher Education in Africa. Our research tasks in this phase build on Phase I, in which we sought to identify measurable rates of return on tertiary agricultural education in Africa and describe the current state of African higher agricultural education (HAE), and Phase II, in which we identified countries’ experiences with national higher education capacity building through partnership building, cross-border opportunities such as ‘twinning,’ and various retention and diaspora engagement strategies. In this phase we discuss successful regional education models, particularly in Sub-Saharan Africa. We have organized our findings and analysis into three sections.The first section organizes the literature under categories of regional higher education models or ‘hubs’ and discusses measurement of the regional impact of higher education. The second section provides bibliometric data identifying academically productive countries and universities in Sub-Saharan Africa.The final section provides a list of regional higher education models identified in the literature and through a web-based review of existing higher education networks and hubs. We also include a list of challenges and responses to regional coordination.
Our initial agriculture capacity building search revealed best practices including institutional partnership building, cross-border opportunities such as ‘twinning,’ and views that these practices are most effective when accompanied by appropriate policies and regulatory frameworks to incentivize return on education to home countries. In addition, the literature explained the historical and political context in which some countries successfully built higher educational capacity, suggesting a set of socio-political conditions necessary for a ‘surge’ in capacity building to occur. Our results raised questions about challenges shaping these best practices (e.g. “brain drain” leading to the need for cross-border opportunities) as well as possible approaches to address these underlying issues. To further examine identified challenges from our initial findings, we re-oriented our search to investigate retention strategies, regional or intra-national network capacity building approaches, and whether there is in fact a need for higher education capacity in all countries through comparative advantage or otherwise. This report presents a review of the literature on the best and worst practices for national agricultural capacity building when investing in a country's higher education system or when investing directly in national or relevant global research capacity. We find that several countries have successfully employed a variety of retention, return, and diaspora strategies to build capacity by capitalizing on the feedback loops of international mobility. In addition, several countries in Africa have employed strategies to address the rural-to-urban “brain drain” by prioritizing education of students with post-secondary rural agricultural work experience and strong ties to rural communities in order to return the benefit of this education to local communities. The report discusses these and other strategies as well as analysis related to the ‘whole system effect’ of higher education and subsequent ‘need’ for Higher Agricultural Education (HAE) capacity in all countries.
This literature review examines the returns to tertiary agricultural sciences education, particularly in Sub-Saharan Africa (SSA). We include information from organizations’ program documents and gray literature, including the World Bank, UNESCO, ILO, IFPRI, ASTI, various Ministries of Education, country-specific NARS, and ADBG. We find no calculated rate of return (RoR) to tertiary agricultural science, including in SSA. We do find estimates for the return on tertiary education in general, ranging from 12-30% in SSA, along with qualitative support for the value of agricultural science education. The private value of this education can be somewhat inferred from the unmet demand of African students for agricultural science training in North America, Europe, and Australia, and the private and social value from the demand for educated researchers in NARS and SSAQ labor markets. Educated agricultural scientists are hypothesized to affect agricultural productivity via research and development and their influence on policy. Despite the dearth of quantitative ROR evidence, we do find several articles describing the need for increased higher agricultural education and proposing recommendations toward this aim. In this report, we summarize these qualitative results as evidence of the value of tertiary education.
This brief provides an overview of the national and zonal characteristics of agricultural production in Tanzania using the 2008/2009 wave of the Tanzania National Panel Survey (TZNPS), part of the Living Standards Measurement Study – Integrated Surveys on Agriculture (LSMS-ISA). More detailed information and analysis is available in the separate EPAR Tanzania LSMS-ISA Reference Report, Sections A-G.