Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: the Case of Manpower Training

37 Pages Posted: 6 Apr 2004 Last revised: 29 Oct 2022

See all articles by James J. Heckman

James J. Heckman

University of Chicago - Department of Economics; National Bureau of Economic Research (NBER); American Bar Foundation; Institute for the Study of Labor (IZA); CESifo (Center for Economic Studies and Ifo Institute)

Date Written: February 1989

Abstract

The recent literature on evaluating manpower training programs demonstrates that alternative nonexperimental estimators of the same program produce a array of estimates of program impact. These findings have led to the call for experiments to be used to perform credible program evaluations. Missing in all of the recent pessimistic analyses of nonexperimental methods is any systematic discussion of how to choose among competing estimators. This paper explores the value of simple specification tests in selecting an appropriate nonexperimental estimator. A reanalysis of the National Supported Work Demonstration Data previously analyzed by proponents of social experiments reveals that a simple testing procedure eliminates the range of nonexperimental estimators that are at variance with the experimental estimates of program impact.

Suggested Citation

Heckman, James J., Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: the Case of Manpower Training (February 1989). NBER Working Paper No. w2861, Available at SSRN: https://ssrn.com/abstract=457554

James J. Heckman (Contact Author)

University of Chicago - Department of Economics ( email )

1126 East 59th Street
Chicago, IL 60637
United States
773-702-0634 (Phone)
773-702-8490 (Fax)

National Bureau of Economic Research (NBER)

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

American Bar Foundation

750 N. Lake Shore Drive
Chicago, IL 60611
United States

Institute for the Study of Labor (IZA)

P.O. Box 7240
Bonn, D-53072
Germany

CESifo (Center for Economic Studies and Ifo Institute)

Poschinger Str. 5
Munich, DE-81679
Germany