Evans School Policy Analysis & Research Group (EPAR)

This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement. 

Aid results information is often not comparable, since monitoring and evaluation frameworks, information gathering processes, and definitions of “results” differ across donors and governments. This report reviews approaches to results monitoring and evaluation used by governments in developing countries, and highlights trends and gaps in national monitoring and evaluation (M&E) systems. We collect evidence on 42 separate government M&E systems in 23 developing countries, including 17 general national M&E systems and 25 sector-specific national M&E systems, with 14 focused on HIV/AIDS, 8 on health, and 3 on agriculture. The evidence review includes external case studies and evaluations of M&E systems, government M&E assessments, M&E plans, strategic plans with an M&E component, and multi-country reviews of M&E, accountability, and aid effectiveness. We evaluate harmonization of government and development partner M&E systems, coordination and institutionalization of government M&E, challenges in data collection and monitoring, and analysis and use of results information. We also report on key characteristics of M&E systems in different sectors. 

Ecosystem services are the benefits people obtain from ecosystems, such as provisioning of fresh water, food, feed, fiber, biodiversity, energy, and nutrient cycling. Agricultural production can substantially affect the functioning of ecosystems, both positively and negatively. The purpose of this report is to provide an overview of the impacts of agricultural technologies and practices on ecosystem services such as soil fertility, water, biodiversity, air, and climate. The report describes the environmental impacts of different aspects of intensive cropping practices and of inputs associated with intensification. We further explore these impacts by examining intensive rice systems and industrial crop processing. Although this report focuses on the impacts of agricultural practices on the environment, many of the practices also have implications for plant, animal, and human health. Farmers and others who come in contact with air, water, and soils polluted by chemical fertilizers and pesticides may face negative health consequences, for instance. By impacting components of the ecosystem, these practices affect the health of plants and animals living within the ecosystem. We find that the unintended environmental consequences of intensive agricultural practices and inputs are varied and potentially severe. In some cases, sustaining or increasing agricultural productivity depends upon reducing impacts to the environment, such as maintaining productive soils by avoiding salinization from irrigation water. However, in other cases, eliminating negative environmental impacts may involve unacceptable trade-offs with food provision or other development goals. Determining the appropriate balance of costs and benefits from intensive agricultural practices is a location-specific exercise requiring knowledge of natural, economic, and social conditions. 

EPAR’s Political Economy of Fertilizer Policy series provides a history of government intervention in the fertilizer markets of eight Sub-Saharan African countries: Côte d’Ivoire, Ghana, Kenya, Malawi, Mozambique, Nigeria, Senegal, and Tanzania. The briefs focus on details of present and past voucher programs, input subsidies, tariffs in the fertilizer sector, and the political context of these policies. The briefs illustrate these policies’ effect on key domestic crops and focus on the strengths and weaknesses of current market structure. Fertilizer policy in SSA has been extremely dynamic over the last fifty years, swinging from enormous levels of intervention in the 1960s and 70s to liberalization of markets of the 1980s and 1990s. More recently, intervention has become more moderate, focusing on “market smart” subsidies and support. This executive summary highlights key findings and common themes from the series.