Abstract

http://ssrn.com/abstract=1691163
 
 

Citations (16)



 
 

Footnotes (15)



 


 



Conducting Behavioral Research on Amazon's Mechanical Turk


Winter Mason


Facebook; Stevens Institute of Technology - Wesley J. Howe School of Technology Management

Siddharth Suri


Yahoo! Research Labs

October 12, 2010

Behavior Research Methods, Forthcoming

Abstract:     
Amazon’s Mechanical Turk is an online labor market where requesters post jobs and workers choose which jobs to do for pay. The central purpose of this paper is to demonstrate how to use this website for conducting behavioral research and lower the barrier to entry for researchers who could benefit from this platform. We describe general techniques that apply to a variety of types of research and experiments across disciplines. We begin by discussing some of the advantages of doing experiments on Mechanical Turk, such as easy access to a large, stable, and diverse subject pool, the low cost of doing experiments and faster iteration between developing theory and executing experiments. We will discuss how the behavior of workers compares to experts and to laboratory subjects. Then, we illustrate the mechanics of putting a task on Mechanical Turk including recruiting subjects, executing the task, and reviewing the work that was submitted. We also provide solutions to common problems that a researcher might face when executing their research on this platform including techniques for conducting synchronous experiments, methods to ensure high quality work, how to keep data private, and how to maintain code security.

Number of Pages in PDF File: 21

Keywords: crowdsourcing, mechanical turk, methods, online

Accepted Paper Series


Download This Paper

Date posted: October 13, 2010 ; Last revised: June 19, 2014

Suggested Citation

Mason, Winter and Suri, Siddharth, Conducting Behavioral Research on Amazon's Mechanical Turk (October 12, 2010). Behavior Research Methods, Forthcoming. Available at SSRN: http://ssrn.com/abstract=1691163

Contact Information

Winter Mason (Contact Author)
Facebook ( email )
1601 S. California Ave.
Palo Alto, CA 94304
United States
Stevens Institute of Technology - Wesley J. Howe School of Technology Management ( email )
Hoboken, NJ 07030
United States

Siddharth Suri
Yahoo! Research Labs ( email )
Pasadena, CA 91103
United States
Feedback to SSRN


Paper statistics
Abstract Views: 12,596
Downloads: 2,787
Download Rank: 1,929
Citations:  16
Footnotes:  15
Paper comments
No comments have been made on this paper

© 2014 Social Science Electronic Publishing, Inc. All Rights Reserved.  FAQ   Terms of Use   Privacy Policy   Copyright   Contact Us
This page was processed by apollo3 in 0.359 seconds