Strong Claims and Weak Evidence: Reassessing the Predictive Validity of the IAT
Journal of Applied Psychology, Vol. 94, No. 3, 567-582, 2009, DOI: 10.1037/a0014665
17 Pages Posted: 6 Feb 2015 Last revised: 26 Feb 2015
Date Written: 2009
Abstract
The authors reanalyzed data from 2 influential studies — A. R. McConnell and J. M. Leibold (2001) and J. C. Ziegert and P. J. Hanges (2005) — that explore links between implicit bias and discriminatory behavior and that have been invoked to support strong claims about the predictive validity of the Implicit Association Test. In both of these studies, the inclusion of race Implicit Association Test scores in regression models reduced prediction errors by only tiny amounts, and Implicit Association Test scores did not permit prediction of individual-level behaviors. Furthermore, the results were not robust when the impact of rater reliability, statistical specifications, and/or outliers were taken into account, and reanalysis of A. R. McConnell & J. M. Leibold (2001) revealed a pattern of behavior consistent with a pro-Black behavioral bias, rather than the anti-Black bias suggested in the original study.
Keywords: Implicit Association Test, predictive validity, discrimination, implicit bias
Suggested Citation: Suggested Citation