The Magnitude and Extent of Cheating and Response Distortion Effects on Unproctored Internet-Based Tests of Cognitive Ability and Personality

16 Pages Posted: 15 Feb 2010

See all articles by Winfred Arthur

Winfred Arthur

affiliation not provided to SSRN

Ryan M. Glaze

affiliation not provided to SSRN

Anton J. Villado

Rice University

Jason E. Taylor

University of Virginia - Department of Economics

Abstract

The use of unproctored internet-based testing (UIT) for employee selection is quite widespread. Although this mode of testing has advantages over onsite testing, researchers and practitioners continue to be concerned about potential malfeasance (e.g., cheating and response distortion) under high-stakes conditions. Therefore, the primary objective of the present study was to investigate the magnitude and extent of high- and low-stakes retest effects on the scores of a UIT speeded cognitive ability test and two UIT personality measures. These data permitted inferences about the magnitude and extent of malfeasant responding. The study objectives were accomplished by implementing two within-subjects design studies (Study 1N=296; Study 2N=318) in which test takers first completed the tests as job applicants (high-stakes) or incumbents (low-stakes) then as research participants (low-stakes). For the speeded cognitive ability measure, the pattern of test score differences was more consonant with a psychometric practice effect than a malfeasance explanation. This result is likely due to the speeded nature of the test. And for the UIT personality measures, the pattern of higher high-stakes scores compared with lower low-stakes scores is similar to those reported for proctored tests in the extant literature. Thus, our results indicate that the use of a UIT administration does not uniquely threaten personality measures in terms of elevated scores under high-stakes testing that are higher than those observed for proctored tests in the extant literature.

Suggested Citation

Arthur, Winfred and Glaze, Ryan M. and Villado, Anton J. and Taylor, Jason E., The Magnitude and Extent of Cheating and Response Distortion Effects on Unproctored Internet-Based Tests of Cognitive Ability and Personality. International Journal of Selection and Assessment, Vol. 18, Issue 1, pp. 1-16, March 2010, Available at SSRN: https://ssrn.com/abstract=1552558 or http://dx.doi.org/10.1111/j.1468-2389.2010.00476.x

Winfred Arthur (Contact Author)

affiliation not provided to SSRN

No Address Available

Ryan M. Glaze

affiliation not provided to SSRN

No Address Available

Anton J. Villado

Rice University

6100 South Main Street
Houston, TX 77005-1892
United States

Jason E. Taylor

University of Virginia - Department of Economics ( email )

P.O. Box 400182
Charlottesville, VA 22904-4182
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
2
Abstract Views
380
PlumX Metrics