|
|
|
|
||||
|
||||
Star Wars: The Empirics Strike BackAbel BrodeurParis School of Economics (PSE); London School of Economics & Political Science (LSE) - Centre for Economic Performance (CEP); Institute for the Study of Labor (IZA) Mathias LéParis School of Economics (PSE) Marc SangnierFrench National Center for Scientific Research (CNRS) - Research Group in Quantitative Saving (GREQAM); Aix-Marseille University Yanos ZylberbergCREI and Universitat Pompeu Fabra June 18, 2012 Paris School of Economics Working Paper No. 2012-29 Abstract: Journals favor rejections of the null hypothesis. This selection upon results may distort the behavior of researchers. Using 50,000 tests published between 2005 and 2011 in the AER, JPE and QJE, we identify a residual in the distribution of tests that cannot be explained by selection. The distribution of p-values exhibits a camel shape with abundant p-values above .25, a valley between .25 and .10 and a bump slightly under .05. Missing tests are those which would have been accepted but close to being rejected (p-values between .25 and .10). We show that this pattern corresponds to a shift in the distribution of p-values: between 10% and 20% of marginally rejected tests are misallocated. Our interpretation is that researchers might be tempted to inflate the value of their tests by choosing the specification that provides the highest statistics. Note that Inflation is larger in articles where stars are used in order to highlight statistical significance and lower in articles with theoretical models.
Number of Pages in PDF File: 38 Keywords: Hypothesis testing, distorting incentives, selection bias, research in economics JEL Classification: A11, B41, C13, C44 working papers seriesDate posted: June 23, 2012Suggested CitationContact Information
|
|
||||||||||||||||||||||||||
© 2013 Social Science Electronic Publishing, Inc. All Rights Reserved.
FAQ
Terms of Use
Privacy Policy
Copyright
This page was processed by apollo4 in 0.531 seconds
