The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con Out of Econometrics

39 Pages Posted: 8 Mar 2010 Last revised: 27 Feb 2022

See all articles by Joshua D. Angrist

Joshua D. Angrist

Massachusetts Institute of Technology (MIT) - Department of Economics; National Bureau of Economic Research (NBER); IZA Institute of Labor Economics

Jörn-Steffen Pischke

London School of Economics; National Bureau of Economic Research (NBER); Centre for Economic Policy Research (CEPR); IZA Institute of Labor Economics

Multiple version iconThere are 3 versions of this paper

Date Written: March 2010

Abstract

This essay reviews progress in empirical economics since Leamer's (1983) critique. Leamer highlighted the benefits of sensitivity analysis, a procedure in which researchers show how their results change with changes in specification or functional form. Sensitivity analysis has had a salutary but not a revolutionary effect on econometric practice. As we see it, the credibility revolution in empirical work can be traced to the rise of a design-based approach that emphasizes the identification of causal effects. Design-based studies typically feature either real or natural experiments and are distinguished by their prima facie credibility and by the attention investigators devote to making the case for a causal interpretation of the findings their designs generate. Design-based studies are most often found in the microeconomic fields of Development, Education, Environment, Labor, Health, and Public Finance, but are still rare in Industrial Organization and Macroeconomics. We explain why IO and Macro would do well to embrace a design-based approach. Finally, we respond to the charge that the design-based revolution has overreached.

Suggested Citation

Angrist, Joshua and Pischke, Jörn-Steffen (Steve), The Credibility Revolution in Empirical Economics: How Better Research Design is Taking the Con Out of Econometrics (March 2010). NBER Working Paper No. w15794, Available at SSRN: https://ssrn.com/abstract=1565896

Joshua Angrist (Contact Author)

Massachusetts Institute of Technology (MIT) - Department of Economics ( email )

50 Memorial Drive
E52-353
Cambridge, MA 02142
United States
617-253-8909 (Phone)
617-253-1330 (Fax)

National Bureau of Economic Research (NBER)

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

IZA Institute of Labor Economics

P.O. Box 7240
Bonn, D-53072
Germany

Jörn-Steffen (Steve) Pischke

London School of Economics ( email )

Houghton Street
London WC2A 2AE
+44 207 955 6509 (Phone)
+44 207 955 7595 (Fax)

National Bureau of Economic Research (NBER)

1050 Massachusetts Avenue
Cambridge, MA 02138
United States

Centre for Economic Policy Research (CEPR)

London
United Kingdom

IZA Institute of Labor Economics

P.O. Box 7240
Bonn, D-53072
Germany

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
143
Abstract Views
1,703
Rank
125,394
PlumX Metrics