The Use of Mobile Devices in High‐Stakes Remotely Delivered Assessments and Testing

11 Pages Posted: 25 Apr 2014

See all articles by Winfred Arthur Jr

Winfred Arthur Jr

Texas A&M University

Dennis Doverspike

University of Akron

Gonzalo Muñoz

Texas A&M University; Adolfo Ibanez University

Jason E. Taylor

University of Virginia - Department of Economics

Alison Carr

University of Akron

Date Written: June 2014

Abstract

With Internet access no longer restricted to desktop and laptop computers, job applicants now have the opportunity to complete remotely delivered assessments on mobile, handheld small screen devices such as smartphones, and personal digital assistants. In this study, a large dataset is used to investigate demographic and score differences between job applicants who completed a remotely delivered high‐stakes assessment on a mobile device and those who completed it on a nonmobile device. Based on a sample of 3,575,207 job applicants who completed an unproctored Internet‐based assessment between January 2011 and April 2012, the percentage of applicants completing the assessment on a mobile device was small, 1.93%, but nevertheless represented more than 69,000 people. Overall, there were small test‐taker demographic differences in the use of mobile devices versus nonmobile devices in that mobile devices were slightly more likely to be used by women, African‐Americans and Hispanics, and younger applicants. Scores on a personality measure were similar for mobile and nonmobile devices but scores on a general mental ability test were substantially lower for mobile devices. Tests of measurement invariance also indicated equivalence across the mobile and nonmobile samples. Test taker and organizational implications for completing remotely delivered high‐stakes noncognitive and cognitive assessments on mobile versus nonmobile devices are discussed.

Suggested Citation

Arthur Jr, Winfred and Doverspike, Dennis and Muñoz, Gonzalo and Taylor, Jason E. and Carr, Alison, The Use of Mobile Devices in High‐Stakes Remotely Delivered Assessments and Testing (June 2014). International Journal of Selection and Assessment, Vol. 22, Issue 2, pp. 113-123, 2014, Available at SSRN: https://ssrn.com/abstract=2429072 or http://dx.doi.org/10.1111/ijsa.12062

Winfred Arthur Jr (Contact Author)

Texas A&M University ( email )

College Station, TX 77843-4353
United States

Dennis Doverspike

University of Akron

259 S. Broadway
Akron, OH 44325
United States

Gonzalo Muñoz

Texas A&M University

Langford Building A
798 Ross St.
College Station, TX 77843-3137
United States

Adolfo Ibanez University

Diagonal Las Torres 2640 Peñaleón
Presidente Errázuriz 3485 Las Condes
Santiago, 794-1169
Chile

Jason E. Taylor

University of Virginia - Department of Economics ( email )

P.O. Box 400182
Charlottesville, VA 22904-4182
United States

Alison Carr

University of Akron

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
0
Abstract Views
365
PlumX Metrics