Evans School Policy Analysis & Research Group (EPAR)

This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement. 

This brief reviews the evidence of realized yield gains by smallholder farmers attributable to the use of high-quality seed and/or improved seed varieties. Our analysis suggests that in most cases, use of improved varieties and/or quality seed is associated with modest yield increases.  In the sample of 395 trials reviewed, positive yield changes accompanied the use of improved variety or quality seed, on average, in 10 out of 12 crops, with rice and cassava as the two exceptions.

Water is a critical input for significantly enhancing smallholder farmer productivity in Sub-Saharan Africa (SSA) where less than 5% of farm land is irrigated, and in India where 42% of farm land is irrigated.  For many years, donors have invested in human-powered treadle pump technologies as a point of entry for smallholder farmers unable to afford motorized pumps. In spite of some successes in treadle pump promotion, however, there is a widespread perception that as soon as smallholder farmers can afford to they quickly transition to motorized diesel- powered pumps. While diesel pumps substantially ease farmers’ workload, they pollute excessively (both in terms of local air quality and greenhouse gas emissions), pump excessive amounts of water, and put farmers at the mercy of cyclical spikes in fuel prices. This brief provides an overview of state-of-the-art alternative energy pumps, including technologies available and implementation lessons learned from China, India, Africa, South America and other regions. Through a literature review, written surveys and phone interviews with water pump producers and non-governmental organizations (NGOs) we evaluate the availability, affordability, and adoption rates of alternative energy technologies in developing countries. Our findings suggest that no single alternative energy water pumping system is a “silver bullet” for rural smallholder irrigation needs. Biofuels may prove a successful short- to intermediate-term solution for farmers who already have access to diesel pumps, but other problems associated with diesel engines, including high maintenance costs and excessive water use remain even when biofuels are used. Solar systems eliminate pollution almost entirely, reduce water consumption, and eliminate the need to purchase fuels. However solar systems are typically prohibitively expensive for smallholder farmers. Wind powered pumping solutions have not proven successful to date, with high costs and irregular wind patterns (either too little or too much wind) proving substantial barriers to widespread adoption.

Introducing technology that is designed to be physically appropriate and valuable to women farmers can increase yields and raise income. But gender issues for agricultural technology projects in Sub-Saharan Africa (SSA) are extremely complex. The EPAR series on Gender and Cropping in SSA offers examples of how these issues can affect crop production and adoption of agricultural technologies at each point in the crop cycle for eight crops (cassava, cotton, maize, millet, rice, sorghum, wheat, and yam). This executive summary highlights innovative opportunities for interventions that consider these dimensions of gender. We encourage readers to consult the crop specific briefs for more details. We find that involving both men and women in the development, testing, and dissemination of agricultural technology has been shown to be successful in helping both benefit. Nevertheless, a consistent finding throughout the Gender and Cropping in SSA series is that maximum benefits from technological innovations cannot be realized when upstream factors like education, power, and land tenure heavily influence outcomes. Addressing these more basic upstream causes of gender inequality may be even more important in helping households increase productivity and maximize the benefits of technological interventions.