Experiments on Crowdsourcing Policy Assessment

Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy.

16 Pages Posted: 6 May 2014 Last revised: 17 Dec 2015

See all articles by John Prpić PhD

John Prpić PhD

Thompson Rivers University

Araz Taeihagh

National University of Singapore (NUS) - Lee Kuan Yew School of Public Policy

James Melton

Central Michigan University - College of Business Administration

Date Written: May 5, 2014

Abstract

Can Crowds serve as useful allies in policy design? How do non-expert Crowds perform relative to experts in the assessment of policy measures? Does the geographic location of non-expert Crowds, with relevance to the policy context, alter the performance of non-experts Crowds in the assessment of policy measures? In this work, we investigate these questions by undertaking experiments designed to replicate expert policy assessments with non-expert Crowds recruited from Virtual Labor Markets. We use a set of ninety-six climate change adaptation policy measures previously evaluated by experts in the Netherlands as our control condition to conduct experiments using two discrete sets of non-expert Crowds recruited from Virtual Labor Markets. We vary the composition of our non-expert Crowds along two conditions: participants recruited from a geographical location directly relevant to the policy context and participants recruited at-large. We discuss our research methods in detail and provide the findings of our experiments.

Keywords: Crowdsourcing, Crowdsourcing Experiment, Policy Assessment, Climate Change, Expert Policy Assessment, Non-Expert Policy Assessment, Virtual Labor Markets, Crowds, Policy Measures, Experimental Methods, Climate Change Adaptation

Suggested Citation

Prpić, John and Taeihagh, Araz and Melton, James, Experiments on Crowdsourcing Policy Assessment (May 5, 2014). Prpić, J., Taeihagh, A., & Melton, J. (2014). Experiments on Crowdsourcing Policy Assessment. Oxford Internet Institute, University of Oxford - IPP 2014 - Crowdsourcing for Politics and Policy. , Available at SSRN: https://ssrn.com/abstract=2433391

John Prpić

Thompson Rivers University ( email )

900 McGill Road
IB2008
Kamloops, BC V2C 5N3
Canada

Araz Taeihagh (Contact Author)

National University of Singapore (NUS) - Lee Kuan Yew School of Public Policy ( email )

469B Bukit Timah Road
Li Ka Shing Building, Level 2
Singapore, 259771
Singapore
+65 6601 5254 (Phone)

HOME PAGE: http://www.taeihagh.com/publications

James Melton

Central Michigan University - College of Business Administration ( email )

Mt. Pleasant, MI 48858
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
167
Abstract Views
2,296
Rank
379,863
PlumX Metrics