Evans School Policy Analysis & Research Group (EPAR)

This four-part analysis describes the current suite of food security measures, then analyzes the respective relationships between food security and poverty, GDP, and crop yields using findings from in-depth literature reviews. Food security measures are criticized for inaccurately characterizing food security at individual, household, and national scales, yet guidelines exist to prescribe a food security measure for a given situation. Some authors see the potential of a combination of indicators that apply at different scales rather than a single, universal food security measure. Limited literature exists on the relationship between food security and poverty, GDP, or crop yields. The relationship between food security and poverty is particularly challenging because neither term has a consistent definition, and the limited literature suggests a lack of consensus among experts. Little empirical research exists on the relationship between food security and GDP, though studies generally note an association between the two Studies that evaluate food security and crop yields provide limited evidence that the two are associated, though many studies use measures of crop yield as food security indicators and vice versa. More research is needed to establish whether there are preferred food security measurement tools for specific scales and situations, and to further explore the relationship between food security and poverty, GDP, and crop yields.

This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement. 

Common estimates of agricultural productivity rely upon crude measures of crop yield, typically defined as the weight harvested of a crop divided by the area harvested. But this common yield measure poorly reflects performance among farm systems combining multiple crops in one area (e.g., intercropping), and also ignores the possibility that farmers might lose crop area between planting and harvest (e.g., partial crop failure). Drawing on detailed plot-level data from Tanzania’s National Panel Survey, our research contrasts measures of smallholder productivity using production per hectare harvested and production per hectare planted.

An initial analysis (Research Brief - Rice Productivity Measurement) looking at rice production finds that yield by area planted differs significantly from yield by area harvested, particularly for smaller farms and female-headed households. OLS regression further reveals different demographic and management-related drivers of variability in yield gains – and thus different implications for policy and development interventions – depending on the yield measurement used. Findings suggest a need to better specify “yield” to more effectively guide agricultural development efforts.

Aid results information is often not comparable, since monitoring and evaluation frameworks, information gathering processes, and definitions of “results” differ across donors and governments. This report reviews approaches to results monitoring and evaluation used by governments in developing countries, and highlights trends and gaps in national monitoring and evaluation (M&E) systems. We collect evidence on 42 separate government M&E systems in 23 developing countries, including 17 general national M&E systems and 25 sector-specific national M&E systems, with 14 focused on HIV/AIDS, 8 on health, and 3 on agriculture. The evidence review includes external case studies and evaluations of M&E systems, government M&E assessments, M&E plans, strategic plans with an M&E component, and multi-country reviews of M&E, accountability, and aid effectiveness. We evaluate harmonization of government and development partner M&E systems, coordination and institutionalization of government M&E, challenges in data collection and monitoring, and analysis and use of results information. We also report on key characteristics of M&E systems in different sectors.