Comparing Personality Test Formats and Warnings: Effects on Criterion-Related Validity and Test-Taker Reactions

15 Pages Posted: 19 May 2008

See all articles by Patrick D. Converse

Patrick D. Converse

Florida Institute of Technology

Frederick L. Oswald

Michigan State University

Anna Imus

affiliation not provided to SSRN

Cynthia Hedricks

SkillSurvey, Inc.

Radha Roy

affiliation not provided to SSRN

Abstract

The potential for applicant response distortion on personality measures remains a major concern in high-stakes testing situations. Many approaches to understanding response distortion are too transparent (e.g., instructed faking studies) or are too subtle (e.g., correlations with social desirability measures as indices of faking). Recent research reveals more promising approaches in two methods: using forced-choice (FC) personality test items and warning against faking. The present study examined effects of these two methods on criterion-related validity and test-taker reactions. Results supported incremental validity for an FC and Likert-scale measure in warning and no-warning conditions, above and beyond cognitive ability. No clear differences emerged between the FC vs Likert measures or warning vs no-warning conditions in terms of validity. However, some evidence suggested that FC measures and warnings may produce negative test-taker reactions. We conclude with implications for implementation in selection settings.

Suggested Citation

Converse, Patrick D. and Oswald, Frederick L. and Imus, Anna and Hedricks, Cynthia and Roy, Radha, Comparing Personality Test Formats and Warnings: Effects on Criterion-Related Validity and Test-Taker Reactions. International Journal of Selection and Assessment, Vol. 16, Issue 2, pp. 155-169, June 2008, Available at SSRN: https://ssrn.com/abstract=1134121 or http://dx.doi.org/10.1111/j.1468-2389.2008.00420.x

Patrick D. Converse (Contact Author)

Florida Institute of Technology

Frederick L. Oswald

Michigan State University ( email )

Agriculture Hall
East Lansing, MI 48824-1122
United States

Anna Imus

affiliation not provided to SSRN

No Address Available

Cynthia Hedricks

SkillSurvey, Inc.

Berwyn, PA 19312
United States

Radha Roy

affiliation not provided to SSRN

No Address Available

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
2
Abstract Views
1,734
PlumX Metrics