The Role of Problem Specification in Crowdsourcing Contests for Design Problems: A Theoretical and Empirical Analysis

39 Pages Posted: 30 Oct 2018 Last revised: 31 Oct 2019

See all articles by Zhaohui (Zoey) Jiang

Zhaohui (Zoey) Jiang

Carnegie Mellon University - David A. Tepper School of Business

Yan Huang

Carnegie Mellon University - David A. Tepper School of Business

Damian R. Beil

Stephen M. Ross School of Business

Date Written: October 16, 2019

Abstract

This paper studies the role of seekers' problem specification in crowdsourcing contests for design problems. Platforms hosting design contests offer detailed guidance for seekers to specify their problems when launching a contest. Yet, problem specification in such crowdsourcing contests is something the theoretical and empirical literature has largely overlooked. We aim to fill this gap by offering an empirically-validated model to generate insights for the provision of information at contest launch. We develop a game-theoretic model featuring different types of information (categorized as “conceptual objectives” or “execution guidelines”) conveyed in problem specifications, and assess their impact on design processes and submission qualities. Real-world data is used to empirically test hypotheses and policy recommendations generated from the model, and a quasi-natural experiment provides further empirical validation. We show theoretically and verify empirically that, with more conceptual objectives disclosed in the problem specification, the number of participants in a contest eventually decreases; with more execution guidelines in the problem specification, the trial effort provision by each participant increases; and the best solution quality always increases with more execution guidelines, but eventually decreases with more conceptual objectives. We find that, to maximize the best solution quality in crowdsourced design problems, seekers should always provide more execution guidelines, and only a moderate number of conceptual objectives.

Keywords: crowdsourcing contests, problem specification, design, game theory, empirical analysis

Suggested Citation

Jiang, Zhaohui (Zoey) and Huang, Yan and Beil, Damian R., The Role of Problem Specification in Crowdsourcing Contests for Design Problems: A Theoretical and Empirical Analysis (October 16, 2019). Ross School of Business Paper No. 1388, Available at SSRN: https://ssrn.com/abstract=3260862 or http://dx.doi.org/10.2139/ssrn.3260862

Zhaohui (Zoey) Jiang (Contact Author)

Carnegie Mellon University - David A. Tepper School of Business ( email )

5000 Forbes Avenue
Pittsburgh, PA 15213-3890
United States

Yan Huang

Carnegie Mellon University - David A. Tepper School of Business ( email )

5000 Forbes Avenue
Pittsburgh, PA 15213-3890
United States

Damian R. Beil

Stephen M. Ross School of Business ( email )

701 Tappan Street
Ann Arbor, MI MI 48109
United States

HOME PAGE: http://https://sites.google.com/a/umich.edu/damianbeil/

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
150
Abstract Views
948
rank
230,867
PlumX Metrics