Measurement Equivalence in Replications of Experiments: When and Why it Matters and Guidance on How to Determine Equivalence

Public Management Review, 19(9): 1293-1310, 2017

17 Pages Posted: 23 Jun 2016 Last revised: 23 Mar 2018

See all articles by Sebastian Jilke

Sebastian Jilke

McCourt School of Public Policy; Georgetown University

Nick Petrovsky

City University of Hong Kong

Bart Meuleman

KU Leuven

Oliver James

University of Exeter - Department of Politics

Date Written: June 1, 2016

Abstract

Replications of experiments are typically conducted to verify initial findings, increase their external validity, or to study the boundary conditions of treatment effects. A crucial and implicitly made assumption is that outcome measures in experiments are sufficiently comparable (i.e., equivalent) across experimental settings. We argue that there are good reasons to believe that this equivalence assumption may not always be met and should therefore be tested empirically. Integrating the literatures on experimental replication and survey measurement equivalence, we provide guidance when and how experimental replicators need to determine cross-replication equivalence.

Keywords: Replication, experiment, measurement equivalence, measurement invariance, cross-replication equivalence, blame, blame shifting, responsibility attribution, political accountability; measurement

JEL Classification: D12, D18, D4, D63, D8

Suggested Citation

Jilke, Sebastian and Petrovsky, Nick and Meuleman, Bart and James, Oliver, Measurement Equivalence in Replications of Experiments: When and Why it Matters and Guidance on How to Determine Equivalence (June 1, 2016). Public Management Review, 19(9): 1293-1310, 2017, Available at SSRN: https://ssrn.com/abstract=2798610

Sebastian Jilke (Contact Author)

McCourt School of Public Policy; Georgetown University ( email )

Washington, DC 20057
United States

Nick Petrovsky

City University of Hong Kong ( email )

Rm6346 6F Li Dak Sum Yip Yio Chin Bldg
Tat Chee Avenue
Kowloon
Hong Kong

Bart Meuleman

KU Leuven ( email )

Oude Markt 13
Leuven, Vlaams-Brabant 3000
Belgium

Oliver James

University of Exeter - Department of Politics ( email )

Northcote House
The Queen's Drive
Exeter, Devon EX4 4QJ
United Kingdom

HOME PAGE: http://www.huss.ex.ac.uk/politics/staff/james/index.php

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
57
Abstract Views
637
Rank
693,317
PlumX Metrics