Evans School Policy Analysis & Research Group (EPAR)

This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement. 

This brief reviews the evidence of realized yield gains by smallholder farmers attributable to the use of high-quality seed and/or improved seed varieties. Our analysis suggests that in most cases, use of improved varieties and/or quality seed is associated with modest yield increases.  In the sample of 395 trials reviewed, positive yield changes accompanied the use of improved variety or quality seed, on average, in 10 out of 12 crops, with rice and cassava as the two exceptions.

Aid results information is often not comparable, since monitoring and evaluation frameworks, information gathering processes, and definitions of “results” differ across donors and governments. This report reviews approaches to results monitoring and evaluation used by governments in developing countries, and highlights trends and gaps in national monitoring and evaluation (M&E) systems. We collect evidence on 42 separate government M&E systems in 23 developing countries, including 17 general national M&E systems and 25 sector-specific national M&E systems, with 14 focused on HIV/AIDS, 8 on health, and 3 on agriculture. The evidence review includes external case studies and evaluations of M&E systems, government M&E assessments, M&E plans, strategic plans with an M&E component, and multi-country reviews of M&E, accountability, and aid effectiveness. We evaluate harmonization of government and development partner M&E systems, coordination and institutionalization of government M&E, challenges in data collection and monitoring, and analysis and use of results information. We also report on key characteristics of M&E systems in different sectors. 

Water is a critical input for significantly enhancing smallholder farmer productivity in Sub-Saharan Africa (SSA) where less than 5% of farm land is irrigated, and in India where 42% of farm land is irrigated.  For many years, donors have invested in human-powered treadle pump technologies as a point of entry for smallholder farmers unable to afford motorized pumps. In spite of some successes in treadle pump promotion, however, there is a widespread perception that as soon as smallholder farmers can afford to they quickly transition to motorized diesel- powered pumps. While diesel pumps substantially ease farmers’ workload, they pollute excessively (both in terms of local air quality and greenhouse gas emissions), pump excessive amounts of water, and put farmers at the mercy of cyclical spikes in fuel prices. This brief provides an overview of state-of-the-art alternative energy pumps, including technologies available and implementation lessons learned from China, India, Africa, South America and other regions. Through a literature review, written surveys and phone interviews with water pump producers and non-governmental organizations (NGOs) we evaluate the availability, affordability, and adoption rates of alternative energy technologies in developing countries. Our findings suggest that no single alternative energy water pumping system is a “silver bullet” for rural smallholder irrigation needs. Biofuels may prove a successful short- to intermediate-term solution for farmers who already have access to diesel pumps, but other problems associated with diesel engines, including high maintenance costs and excessive water use remain even when biofuels are used. Solar systems eliminate pollution almost entirely, reduce water consumption, and eliminate the need to purchase fuels. However solar systems are typically prohibitively expensive for smallholder farmers. Wind powered pumping solutions have not proven successful to date, with high costs and irregular wind patterns (either too little or too much wind) proving substantial barriers to widespread adoption.