Beyond the Bat and the Ball: Overcoming Familiarity Effects in the Cognitive Reflection Test by Rewording Its Questions

11 Pages Posted: 6 Sep 2019

See all articles by Dylan Manfredi

Dylan Manfredi

University of Pennsylvania - The Wharton School

Gideon Nave

University of Pennsylvania - The Wharton School

Date Written: August 29, 2019

Abstract

The cognitive reflection test (CRT) is a task that is commonly used for measuring one’s tendency to form judgments and make decisions by relying on her intuition, as opposed to deliberate thinking. The popularity of the CRT as a research instrument has led to concerns that participant familiarity might inflate scores in the task. Here, we explore the possibility of overcoming this limitation by rewording the questions used in the original 7-item CRT. We generated three new versions of the test and administered them, as well as the original test, to 1006 participants from Amazon Mechanical Turk. Consistent with a familiarity effect, we find that participants who took the original CRT had higher scores (d=.2 ) and took less time (30-55 seconds) to complete the test than participants who took the new versions. The across subject correlations between scores on the new versions and the original version were high (around r=.9), suggesting that scores of the new versions can be used to approximate scores on the original version while overcoming the familiarity bias.

Suggested Citation

Manfredi, Dylan and Nave, Gideon, Beyond the Bat and the Ball: Overcoming Familiarity Effects in the Cognitive Reflection Test by Rewording Its Questions (August 29, 2019). Available at SSRN: https://ssrn.com/abstract=3445138 or http://dx.doi.org/10.2139/ssrn.3445138

Dylan Manfredi

University of Pennsylvania - The Wharton School ( email )

3641 Locust Walk
Philadelphia, PA 19104-6365
United States

Gideon Nave (Contact Author)

University of Pennsylvania - The Wharton School ( email )

3730 Walnut St
JMHH Suite 700
Philadelphia, PA 19104-6365
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
130
Abstract Views
884
Rank
477,217
PlumX Metrics