OpenMTurk: An Open-Source Administration Tool for Designing Robust MTurk Studies

16 Pages Posted: 7 Nov 2018

See all articles by Justin Feeney

Justin Feeney

University of Regina

Gordon Pennycook

University of Regina

Matthew Van Boxtel

Acerta Analytics Solutions

Date Written: October 12, 2018

Abstract

We present a free and open-source administration tool for managing research studies using Amazon’s Mechanical Turk (MTurk). We call this tool OpenMTurk and it builds upon existing tools such as MTurkR and PsiTurk by sidestepping the need for computer programming and command line code. OpenMTurk allows even novice researchers to leverage MTurk’s application programming interface to increase efficiency and research design. OpenMTurk is an easy to use graphic user interface that can run on Windows, MacOS, and Linux. It helps researchers launch studies using small batches, which can improve the representatives of samples and reduce fees from 40% to 20% of worker compensation. OpenMTurk also allows researchers to efficiently communicate with workers, administer worker bonuses, and ban/unban workers. These features can help researchers run follow-up or longitudinal studies or efficiently administer studies with monetary incentives. OpenMTurk also solves a few potential concerns with TurkPrime: The source code is available for everyone, which means there are no fees, no future possibility of fees for any feature, and no unnecessary third-party data collection. Additionally, users are free to suggest new features, and technically inclined users are free to learn and contribute new source code.

Keywords: Amazon Mechanical Turk, Behavioral Science, Methodology

Suggested Citation

Feeney, Justin and Pennycook, Gordon and Van Boxtel, Matthew, OpenMTurk: An Open-Source Administration Tool for Designing Robust MTurk Studies (October 12, 2018). Available at SSRN: https://ssrn.com/abstract=3265409 or http://dx.doi.org/10.2139/ssrn.3265409

Justin Feeney (Contact Author)

University of Regina ( email )

3737 Wascana Parkway
Regina, Saskatchewan S4S OA2 S4S 0A1
Canada

Gordon Pennycook

University of Regina ( email )

3737 Wascana Parkway
Regina, Saskatchewan S4S OA2 S4S 0A1
Canada

Matthew Van Boxtel

Acerta Analytics Solutions ( email )

Ontario
Canada

Register to save articles to
your library

Register

Paper statistics

Downloads
111
rank
232,728
Abstract Views
1,276
PlumX Metrics