Evans School Policy Analysis & Research Group (EPAR)

There is a wide gap between realized and potential yields for many crops in Sub-Saharan Africa (SSA). Experts identify poor soil quality as a primary constraint to increased agricultural productivity. Therefore, increasing agricultural productivity by improving soil quality is seen as a viable strategy to enhance food security. Yet adoption rates of programs focused on improving soil quality have generally been lower than expected. We explore a seldom considered factor that may limit farmers’ demand for improved soil quality, namely, whether farmers’ self-assessments of their soil quality match soil scientists’ assessments. In this paper, using Tanzania National Panel Survey (TZNPS) data, part of the Living Standards Measurement Study – Integrated Surveys on Agriculture (LSMS-ISA), we compare farmers’ own assessments of soil quality with scientific measurements of soil quality from the Harmonized World Soil Database (HWSD). We find a considerable “mismatch” and most notably, that 11.5 percent of survey households that reported having “good” soil quality are measured by scientific standards to have severely constrained nutrient availability. Mismatches between scientific measurements and farmer assessments of soil quality may highlight a potential barrier for programs seeking to encourage farmers to adopt soil quality improvement activities. 

Household survey data are a key source of information for policy-makers at all levels. In developing countries, household data are commonly used to target interventions and evaluate progress towards development goals. The World Bank’s Living Standards Measurement Study - Integrated Surveys on Agriculture (LSMS-ISA) are a particularly rich source of nationally-representative panel data for six Sub-Saharan African countries: Ethiopia, Malawi, Niger, Nigeria, Tanzania, and Uganda. To help understand how these data are used, EPAR reviewed the existing literature referencing the LSMS-ISA and identified 415 publications, working papers, reports, and presentations with primary research based on LSMS-ISA data. We find that use of the LSMS-ISA has been increasing each year since the first survey waves were made available in 2009, with several universities, multilateral organizations, government offices, and research groups across the globe using the data to answer questions on agricultural productivity, farm management, poverty and welfare, nutrition, and several other topics.

This report reviews approaches to results measurement used by multilateral and bilateral donor organizations and highlights trends and gaps in how donors measure and report on their performance. Our review consists of assessing donor organizations in terms of their institutional design and levels of evaluation for results measurement, their organizational processes for measuring types of results including coordination and alignment with recipients, outputs and implementation, outcomes and impacts, and costs and effectiveness, and their processes for reporting and using results information. We collect evidence on 12 bilateral organizations and 10 multilateral organizations. The evidence review includes multi-country reviews of aid effectiveness, peer reviews by other donor organizations, donor evaluation plans and frameworks, and donor results and reporting documents. The report is based on an accompanying spreadsheet that contains the coded information from the 22 donor organizations. We find that donors report several types of results, but that there are challenges to measuring certain results at the aggregate donor level, due to challenges with funding and coordination for results measurement at the project, country, portfolio, and donor levels. Approaches to results measurement vary across donor organizations. We identify some trends and differences among groups of donors, notably between bilateral and multilateral donors, but overall there are no clear delineations in how donors approach results measurement. 

This brief reviews the evidence of realized yield gains by smallholder farmers attributable to the use of high-quality seed and/or improved seed varieties. Our analysis suggests that in most cases, use of improved varieties and/or quality seed is associated with modest yield increases.  In the sample of 395 trials reviewed, positive yield changes accompanied the use of improved variety or quality seed, on average, in 10 out of 12 crops, with rice and cassava as the two exceptions.