Increasing Validity with Forced-Choice Criterion Measurement Formats
affiliation not provided to SSRN
International Journal of Selection and Assessment, Vol. 15, Issue 3, pp. 263-272, September 2007
The relative validities of forced-choice (ipsative) and Likert rating-scale item formats as criterion measures are examined. While there has been much debate about the relative technical and psychometric merits and demerits of ipsative instruments, the present research focused on the crucial question of whether the use of this format has any practical benefit in terms of improved validity. An analysis is reported from a meta-analysis data set. This demonstrates that higher operational validity coefficients (prediction of line-manager ratings of competencies) are associated with the use of forced-choice (r=.38) rather than rating scale (r=.25) item formats for the criterion measurement instrument when performance is rated by the same line managers on both formats and where the predictor is held constant. Thus the apparent criterion-related validity of a predictor can increase by 50% simply by changing the format of the criterion measurement instrument. The implications of this for practice are discussed.
Number of Pages in PDF File: 10Accepted Paper Series
Date posted: August 17, 2007
© 2013 Social Science Electronic Publishing, Inc. All Rights Reserved.
This page was processed by apollo1 in 0.625 seconds