Instructional Manipulation Checks: Detecting Satisficing to Increase Statistical Power
Journal of Experimental Social Psychology, Vol. 45, pp. 867-872, 2009
6 Pages Posted: 27 Jul 2007 Last revised: 17 Aug 2009
Date Written: 2009
Participants are not always as diligent in reading and following instructions as experimenters would like them to be. When participants fail to follow instructions, this increases noise and decreases the validity of their data. This paper presents and validates a new tool for detecting participants who are not following instructions – the Instructional manipulation check (IMC). We demonstrate how the inclusion of an IMC can increase statistical power and reliability of a dataset.
Keywords: survey construction, experimental methodology, participant motivation
JEL Classification: C90, C9, C81
Suggested Citation: Suggested Citation