The Variability of Criterion-Related Validity Estimates among Interviewers and Interview Panels

13 Pages Posted: 13 Aug 2006

See all articles by Chad H. Van Iddekinge

Chad H. Van Iddekinge

Florida State University - College of Business

Christopher E. Sager

Human Resource Research Organization (HumRRO)

Jennifer L. Burnfield

Human Resource Research Organization (HumRRO)

Tonia S. Heffner

U.S. Army Research Institute for the Behavioral and Social Sciences

Abstract

The authors examined differences in criterion-related validity estimates among ratings from individual interviewers and interview panels within a structured interview. Senior non-commissioned officers (NCOs) in the U.S. Army (N=64) conducted panel interviews with 944 junior NCOs during a concurrent validation project. Analysis of the data revealed considerable variation in interviewer validity coefficients in relation to multiple performance criteria. Results also indicated the importance of adopting a multivariate perspective when evaluating interviewer validity differences in that the amount of variation in validity coefficients differed both by interview dimension and criterion. A similar pattern of findings emerged when analyses were performed on ratings averaged within interview panel. Nonetheless, when meta-analysis was used to estimate the amount of true variance in interviewer- and panel-level validity coefficients, most or all of the variance for some interview-criterion combinations appeared to be due to statistical artifacts.

Suggested Citation

Van Iddekinge, Chad H. and Sager, Christopher E. and Burnfield, Jennifer L. and Heffner, Tonia S., The Variability of Criterion-Related Validity Estimates among Interviewers and Interview Panels. International Journal of Selection and Assessment, Vol. 14, No. 3, pp. 193-205, September 2006, Available at SSRN: https://ssrn.com/abstract=924031 or http://dx.doi.org/10.1111/j.1468-2389.2006.00352.x

Chad H. Van Iddekinge (Contact Author)

Florida State University - College of Business ( email )

423 Rovetta Business Building
Tallahassee, FL 32306-1110
United States

Christopher E. Sager

Human Resource Research Organization (HumRRO) ( email )

Alexandria, VA
United States

Jennifer L. Burnfield

Human Resource Research Organization (HumRRO)

Alexandria, VA
United States

Tonia S. Heffner

U.S. Army Research Institute for the Behavioral and Social Sciences ( email )

Arlington, VA
United States

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
24
Abstract Views
908
PlumX Metrics