Experiments on Crowdsourcing Policy Assessment
Lulea University of Technology - Faculty of Business Administration, Students
Singapore Management University
Central Michigan University - College of Business Administration
May 5, 2014
Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.
Can Crowds serve as useful allies in policy design? How do non-expert Crowds perform relative to experts in the assessment of policy measures? Does the geographic location of non-expert Crowds, with relevance to the policy context, alter the performance of non-experts Crowds in the assessment of policy measures? In this work, we investigate these questions by undertaking experiments designed to replicate expert policy assessments with non-expert Crowds recruited from Virtual Labor Markets. We use a set of ninety-six climate change adaptation policy measures previously evaluated by experts in the Netherlands as our control condition to conduct experiments using two discrete sets of non-expert Crowds recruited from Virtual Labor Markets. We vary the composition of our non-expert Crowds along two conditions: participants recruited from a geographical location directly relevant to the policy context and participants recruited at-large. We discuss our research methods in detail and provide the findings of our experiments.
Number of Pages in PDF File: 16
Keywords: Crowdsourcing, Crowdsourcing Experiment, Policy Assessment, Climate Change, Expert Policy Assessment, Non-Expert Policy Assessment, Virtual Labor Markets, Crowds, Policy Measures, Experimental Methods, Climate Change Adaptation
Date posted: May 6, 2014 ; Last revised: December 17, 2015