Practical Methods for Assessing the Quality of Subjective Selection Processes

41 Pages Posted: 24 Sep 2014 Last revised: 14 Jul 2016

See all articles by Laura J. Kornish

Laura J. Kornish

University of Colorado at Boulder - Leeds School of Business

Karl T. Ulrich

The Wharton School

Date Written: April 10, 2016

Abstract

Selection processes are everywhere in business and society: new product development, college admissions, hiring, and even academic journal submissions. Information on candidates is typically combined in a subjective or holistic manner, making assessment of the quality of the process challenging. In this paper, we address the question, “how can we determine the effectiveness of a selection process?” We show that even if selection is subjective, we can evaluate the process by measuring an additional audit variable that is at least somewhat predictive of performance. This approach can be used either with or without observing eventual performance. We illustrate our methods with data from two commercial settings in which new product opportunities are selected.

Keywords: selection, evaluation, filter, assessment, innovation, hiring, recruiting, admissions

JEL Classification: C4, D8

Suggested Citation

Kornish, Laura J. and Ulrich, Karl T., Practical Methods for Assessing the Quality of Subjective Selection Processes (April 10, 2016). Available at SSRN: https://ssrn.com/abstract=2499049 or http://dx.doi.org/10.2139/ssrn.2499049

Laura J. Kornish (Contact Author)

University of Colorado at Boulder - Leeds School of Business ( email )

Boulder, CO 80309-0419
United States

Karl T. Ulrich

The Wharton School ( email )

Philadelphia, PA 19104
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
227
rank
129,887
Abstract Views
1,167
PlumX Metrics