Characterizing Interference Heterogeneity and Improving Estimation for Experiments in Networks

34 Pages Posted: 20 Sep 2022

See all articles by Yuan Yuan

Yuan Yuan

Purdue University - Krannert School of Management

Kristen M. Altenburger

Facebook

Date Written: September 6, 2022

Abstract

Randomized control trials, or “A/B tests”, have been crucial to understanding the impact of an intervention. Traditional causal inference methods rely on a critical assumption called the “stable unit treatment value assumption” (SUTVA) (Fisher, 1937; Splawa-Neyman et al., 1990), which means that a unit’s treatment response only depends on their own treatment assignment. However, SUTVA is an unrealistic assumption in settings such as networks, where a unit’s response may be affected by other units. This violation of SUTVA is referred to as network interference. The current literature on network interference has two major limitations — failing to account for social theories of interference (e.g. structural diversity or social contagion) and relying on human experts to model interference patterns. To tackle these issues, we propose a two-part machine learning approach to automatically characterize network interference conditions based on both the local network structures and the treatment assignments among users in the network neighborhood. Specifically, we first construct network motifs with treatment assignment information, referred to as causal network motifs, to characterize the network interference conditions for each unit. We then develop machine learning methods based on decision trees and nearest neighbors to map these causal network motif representations to an “exposure condition” under the framework proposed by Aronow and Samii (2017). We demonstrate the validity of our approach through reanalysis of prior experimental study data. Our results show that causal network motifs are able to more accurately account for complex interference patterns and reduce bias in treatment effect estimation even with the presence of interference.

Keywords: causal inference, network motif, interference, spillover effect, social network, A/B testing

Suggested Citation

Yuan, Yuan and Altenburger, Kristen M., Characterizing Interference Heterogeneity and Improving Estimation for Experiments in Networks (September 6, 2022). Available at SSRN: https://ssrn.com/abstract=4212172 or http://dx.doi.org/10.2139/ssrn.4212172

Yuan Yuan (Contact Author)

Purdue University - Krannert School of Management ( email )

1310 Krannert Building
West Lafayette, IN 47907-1310
United States

HOME PAGE: http://yuan-yy.com/

Kristen M. Altenburger

Facebook ( email )

1601 S. California Ave.
Palo Alto, CA 94304
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
30
Abstract Views
204
PlumX Metrics