Abstract

http://ssrn.com/abstract=1802650
 
 

References (67)



 


 



Are Surveys of Experts Unbiased? Evidence from College Football Rankings


Justin M. Ross


Indiana University - School of Public & Environmental Affairs

Sarah E. Larson


Indiana University Bloomington - School of Public & Environmental Affairs (SPEA)

Chad Wall


Virginia Commonwealth University (VCU)

April 4, 2011

Contemporary Economic Policy, Forthcoming
Indiana University-Bloomington: School of Public & Environmental Affairs Research Paper Series No. 2011-04-01

Abstract:     
Policy makers are frequently interested in soliciting unbiased information regarding alternative policies, and expert surveys can be influential. Since ranking policies is an often subjective process, there is always the concern of bias, both intentional and not. Expert bias is difficult to discern in the policy world, but surveys of expert opinion are compiled and "tested" for accuracy weekly in college football, allowing for hypothesis testing. While previous research has used college football rankings to determine the ability of surveys to incorporate relevant information, this paper examines the Associated Press and American Football Coaches' Association rankings for evidence of systematic bias. Specifically, more than 1,300 games from the 2003 to 2008 regular seasons are tested for factors that are systematically correlated with upsets. Both polls predict the winner nearly 80 percent of the time, and though there is evidence of systematic conference bias, correcting the rankings would only improve the accuracy of the polls by about 1 percent. There is no evidence of a bias favoring "big market" teams, nor teams that have strong journalism programs or are from the East Coast.

Number of Pages in PDF File: 38

Keywords: College Football, Bias, Expert Judgment, Crowd Wisdom

JEL Classification: D4, L83

working papers series





Download This Paper

Date posted: April 5, 2011 ; Last revised: July 22, 2011

Suggested Citation

Ross, Justin M. and Larson, Sarah E. and Wall, Chad, Are Surveys of Experts Unbiased? Evidence from College Football Rankings (April 4, 2011). Contemporary Economic Policy, Forthcoming; Indiana University-Bloomington: School of Public & Environmental Affairs Research Paper Series No. 2011-04-01. Available at SSRN: http://ssrn.com/abstract=1802650 or http://dx.doi.org/10.2139/ssrn.1802650

Contact Information

Justin M. Ross (Contact Author)
Indiana University - School of Public & Environmental Affairs ( email )
1315 East Tenth Street
Bloomington, IN 47405
United States

Sarah E. Larson
Indiana University Bloomington - School of Public & Environmental Affairs (SPEA) ( email )
1315 East Tenth Street
Bloomington, IN 47405
United States
Chad Wall
Virginia Commonwealth University (VCU) ( email )
1015 Floyd Avenue
Richmond, VA 23284
United States
Feedback to SSRN


Paper statistics
Abstract Views: 439
Downloads: 36
References:  67

© 2014 Social Science Electronic Publishing, Inc. All Rights Reserved.  FAQ   Terms of Use   Privacy Policy   Copyright   Contact Us
This page was processed by apollo2 in 0.375 seconds