Evans School Policy Analysis & Research Group (EPAR)

This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement. 

Aid results information is often not comparable, since monitoring and evaluation frameworks, information gathering processes, and definitions of “results” differ across donors and governments. This report reviews approaches to results monitoring and evaluation used by governments in developing countries, and highlights trends and gaps in national monitoring and evaluation (M&E) systems. We collect evidence on 42 separate government M&E systems in 23 developing countries, including 17 general national M&E systems and 25 sector-specific national M&E systems, with 14 focused on HIV/AIDS, 8 on health, and 3 on agriculture. The evidence review includes external case studies and evaluations of M&E systems, government M&E assessments, M&E plans, strategic plans with an M&E component, and multi-country reviews of M&E, accountability, and aid effectiveness. We evaluate harmonization of government and development partner M&E systems, coordination and institutionalization of government M&E, challenges in data collection and monitoring, and analysis and use of results information. We also report on key characteristics of M&E systems in different sectors. 

This poster presentation summarizes research on changes in crop planting decisions on the extensive and intensive margin in Tanzania, with regards to changes in agricultural land that a farmer has available and area planted in the context of smallholders and farming systems. We use household survey data from the Tanzania National Panel Survey (TNPS), part of the World Bank’s Living Standards Measurement Study–Integrated Surveys on Agriculture (LSMS – ISA) to test how much the agricultural land available to households changes, how much farmers change the proportion of land decidated to growing priority crops, and how crop area changes vary with changes in landholding. We find that almost half of households had a change of agricultural land area of at least half a hectare from 2008-2010. Smallholder farmers on average decreased the amount of available land between 2008 and 2010, while non-smallholder farmers increased agricultural land area during that time period, but that smallholder households planted a greater proportion of their agricultural land than nonsmallholders. Eighty percent of households changed crop proportions from 2008 to 2010, yet aggregate level indicators mask household level changes.

Consumer attitudes are a key component in private sector market segmentation. Knowledge about consumers’ tastes can lead to better product design and more effective communication with target markets. Similarly, evidence suggests that farmers’ attitudes influence whether they adopt productivity-increasing technologies. Using consumer insights from the private sector, agricultural intervention programs can use market research, product development, and communication strategies to better understand farmers as consumers and best target interventions. This brief provides an overview of how farmers' attitudes affect their willingness to adopt new technology, and how knowledge of farmer attitudes can improve program design and implementation.