Risks and Rewards of Crowdsourcing Marketplaces

Chandler, J., Paolacci, G., & Mueller, P. (2013). Risks and rewards of crowdsourcing marketplaces. In Handbook of Human Computation (pp. 377-392). Springer New York.

30 Pages Posted: 5 Feb 2014

See all articles by Jesse Chandler

Jesse Chandler

Princeton University - Woodrow Wilson School of Public and International Affairs

Gabriele Paolacci

Erasmus University - Rotterdam School of Management

Pam Mueller

Princeton University - Department of Psychology

Date Written: February 4, 2014

Abstract

Crowdsourcing has become an increasingly popular means of flexibly deploying large amounts of human computational power. The present chapter investigates the role of microtask labor marketplaces in managing human and hybrid human machine computing. Labor marketplaces offer many advantages that in combination allow human intelligence to be allocated across projects rapidly and efficiently and information to be transmitted effectively between market participants. Human computation comes with a set of challenges that are distinct from machine computation, including increased unsystematic error (e.g. mistakes) and systematic error (e.g. cognitive biases), both of which can be exacerbated when motivation is low, incentives are misaligned, and task requirements are poorly communicated. We provide specific guidance to how to ameliorate these issues through task design, workforce selection, data cleaning and aggregation.

Suggested Citation

Chandler, Jesse and Paolacci, Gabriele and Mueller, Pam, Risks and Rewards of Crowdsourcing Marketplaces (February 4, 2014). Chandler, J., Paolacci, G., & Mueller, P. (2013). Risks and rewards of crowdsourcing marketplaces. In Handbook of Human Computation (pp. 377-392). Springer New York.. Available at SSRN: https://ssrn.com/abstract=2390570

Jesse Chandler (Contact Author)

Princeton University - Woodrow Wilson School of Public and International Affairs ( email )

Princeton University
Princeton, NJ 08544-1021
United States

Gabriele Paolacci

Erasmus University - Rotterdam School of Management ( email )

3000 DR Rotterdam
Netherlands

Pam Mueller

Princeton University - Department of Psychology ( email )

Green Hall
Princeton, NJ 08540
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
47
Abstract Views
496
PlumX Metrics