The Devil in the Details? Thinking Generically and Specifically in IR Survey Experiments

Abstract

Does treatment abstraction affect treatment effects in International Relations survey experiments in countries outside of the U.S.? We assess whether the treatment effects are conditional on the anonymity of country actors among respondents in Brazil, China, Sweden, Japan, and Ukraine. We examine whether the effects of the United Nations’ approval of military force and regime type of the target country on support for war is moderated by respondents’ compliance with our abstraction encouragement. We find that around 20% of the respondents across all samples think of specific countries and do not comply with our abstraction encouragement. However, we fail to find evidence of a change in the average treatment effects by non-compliance, implying that the treatments are not likely to be conditional on compliance.

Keywords: Public opinion; survey experiment; Brazil; China; Japan; Sweden; Ukraine; war support