Nonnaïveté Among Amazon Mechanical Turk Workers: Consequences and Solutions for Behavioral Researchers
Forthcoming, Chandler, J., Mueller, P., Paolacci, G. Nonnaïveté among Amazon Mechanical Turk Workers: Consequences and Solutions for Behavioral Researchers. Behavior Research Methods. DOI 10.3758/s13428-013-0365-7
19 Pages Posted: 5 Feb 2014
Date Written: February 4, 2014
Abstract
Crowdsourcing services — particularly Amazon Mechanical Turk — have made it easy for behavioral scientists to recruit research participants. However, researchers have overlooked crucial differences between crowdsourcing and traditional recruitment methods that provide unique opportunities and challenges. We show that crowdsourced workers are likely to participate across multiple related experiments and that researchers are overzealous in the exclusion of research participants. We describe how both of these problems can be avoided using advanced interface features that also allow prescreening and longitudinal data collection. Using these techniques can minimize the effects of previously ignored drawbacks and expand the scope of crowdsourcing as a tool for psychological research.
Keywords: Crowdsourcing, Internet research, Data quality, Longitudinal research, Mechanical Turk, MTurk
Suggested Citation: Suggested Citation
Do you have a job opening that you would like to promote on SSRN?
Recommended Papers
-
Preferences for Redistribution
By Alberto F. Alesina and Paola Giuliano
-
Preferences for Redistribution
By Alberto F. Alesina and Paola Giuliano
-
Preferences for Redistribution
By Alberto F. Alesina and Paola Giuliano
-
Social Mobility and the Demand for Redistribution: the Poum Hypothesis
By Roland Bénabou and Efe A. Ok
-
Why Doesn't the Us Have a European-Style Welfare State?
By Alberto F. Alesina, Edward L. Glaeser, ...
-
Belief in a Just World and Redistributive Politics
By Roland Bénabou and Jean Tirole