When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages
49 Pages Posted: 20 Oct 2010
There are 2 versions of this paper
When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages
When Does Rigorous Impact Evaluation Make a Difference? The Case of the Millennium Villages
Date Written: October 11, 2010
Abstract
When is the rigorous impact evaluation of development projects a luxury, and when is it a necessity?
The authors study one high-profile case: the Millennium Villages Project (MVP), an experimental and intensive package intervention to spark sustained local economic development in rural Africa. They illustrate the benefits of rigorous impact evaluation in this setting by showing that estimates of the project’s effects depend heavily on the evaluation method.
Comparing trends at the MVP intervention sites in Kenya, Ghana, and Nigeria to trends in the surrounding areas yields much more modest estimates of the project’s effects than the before-versus-after comparisons published thus far by the MVP. Neither approach constitutes a rigorous impact evaluation of the MVP, which is impossible to perform due to weaknesses in the evaluation design of the project’s initial phase. These weaknesses include the subjective choice of intervention sites, the subjective choice of comparison sites, the lack of baseline data on comparison sites, the small sample size, and the short time horizon. We describe how the next wave of the intervention could be designed to allow proper evaluation of the MVP’s impact at little additional cost.
Keywords: aid effectiveness
Suggested Citation: Suggested Citation
Do you have negative results from your research you’d like to share?
Recommended Papers
-
Program Evaluation and Research Designs
By John E. Dinardo and David Lee
-
By Nava Ashraf, Günther Fink, ...
-
By Nava Ashraf, Günther Fink, ...
-
Identification of Models of the Labor Market
By Eric French and Christopher Taber
-
What Linear Estimators Miss: Re-Examining the Effects of Family Income on Child Outcomes
By Katrine Vellesen Løken, Magne Mogstad, ...
-
Reintegrating Rebels into Civilian Life: Quasi-Experimental Evidence from Burundi
By Michael J. Gilligan, Cyrus Samii, ...
-
By David Kiss