At What Level Should One Cluster Standard Errors in Paired Experiments, and in Stratified Experiments with Small Strata?
49 Pages Posted: 10 Feb 2020 Last revised: 16 Sep 2020
Date Written: September 15, 2020
In paired experiments, units are matched into pairs, and one unit of each pair is randomly assigned to treatment. To estimate the treatment effect, researchers often regress their outcome on a treatment indicator and pair fixed effects, clustering standard errors at the unit-of-randomization level. We show that the variance estimator in this regression may be severely downward biased: under constant treatment effect, its expectation equals 1/2 of the true variance. Instead, we show that researchers should cluster their standard errors at the pair level. Using simulations, we show that those results extend to stratified experiments with few units per strata.
Keywords: clustered standard errors, clustering, paired experiments, stratified experiments, randomized experiments, RCT
JEL Classification: C01, C12, C21, C9
Suggested Citation: Suggested Citation