Experiments on Crowdsourcing Policy Assessment

Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.

16 Pages Posted: 6 May 2014 Last revised: 17 Dec 2015

John Prpić

Lulea University of Technology

Araz Taeihagh

Singapore Management University

James Melton

Central Michigan University - College of Business Administration

Date Written: May 5, 2014

Abstract

Can Crowds serve as useful allies in policy design? How do non-expert Crowds perform relative to experts in the assessment of policy measures? Does the geographic location of non-expert Crowds, with relevance to the policy context, alter the performance of non-experts Crowds in the assessment of policy measures? In this work, we investigate these questions by undertaking experiments designed to replicate expert policy assessments with non-expert Crowds recruited from Virtual Labor Markets. We use a set of ninety-six climate change adaptation policy measures previously evaluated by experts in the Netherlands as our control condition to conduct experiments using two discrete sets of non-expert Crowds recruited from Virtual Labor Markets. We vary the composition of our non-expert Crowds along two conditions: participants recruited from a geographical location directly relevant to the policy context and participants recruited at-large. We discuss our research methods in detail and provide the findings of our experiments.

Keywords: Crowdsourcing, Crowdsourcing Experiment, Policy Assessment, Climate Change, Expert Policy Assessment, Non-Expert Policy Assessment, Virtual Labor Markets, Crowds, Policy Measures, Experimental Methods, Climate Change Adaptation

Suggested Citation

Prpić, John and Taeihagh, Araz and Melton, James, Experiments on Crowdsourcing Policy Assessment (May 5, 2014). Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy. . Available at SSRN: https://ssrn.com/abstract=2433391

John Prpić

Lulea University of Technology ( email )

Sweden

Araz Taeihagh (Contact Author)

Singapore Management University ( email )

School of Social Sciences
90 Stamford Road
Singapore, 178903
Singapore
+65 6828 0627 (Phone)
+65 6828 0423 (Fax)

HOME PAGE: http://socsc.smu.edu.sg/faculty/profile/130431/Araz-TAEIHAGH

James Melton

Central Michigan University - College of Business Administration ( email )

Mt. Pleasant, MI 48858
United States

Paper statistics

Downloads
116
Rank
196,387
Abstract Views
1,010