What Color are the Lilies? Forced Reflection Boosts Performance in the Cognitive Reflection Test.

Abstract

The Cognitive Reflection Test (CRT) measures the ability to override intuitive, belief-based responses, high scoring individuals showing better performance on many cognitive tasks (e.g., reasoning, decision making). Two methods of improving CRT score are presently identified: forced content reflection and numerical reflection. Encouraging individuals to answer additional questions loosely related to considered problems increases the likelihood of overriding incorrect belief-based responses. Solving simple equations before responding to problems has a similar positive effect on reflection. Experiment 2 showed, that only questions that had correct answers (contrary to mere opinions) had the ability to increase the CRT score. Presented data suggest that cognitive reflection is not an ability to reflect, but has rather a motivational character.

Keywords: cognitive reflection test, debiasing, reflection