The Impact of Temporally Turning off TV Ad on Search: A Generalized Synthetic Control Estimator under Interference

37 Pages Posted: 8 Jul 2021

See all articles by Jia Liu

Jia Liu

HKUST Business School

Shawndra Hill

Microsoft Corporation - Microsoft Research, New York City

David M. Rothschild

Microsoft Research

Date Written: July 2, 2021

Abstract

We measure the effects of major TV advertisers’ temporary discontinuation of TV advertising on consumer keyword search over time, by leveraging a field experiment in the U.S. wireless industry in which the focal brand stopped its TV advertising for one randomly chosen week. The identification challenge lies in the spillover effects of the intervention on other control brands, that are used to eliminate unobserved confounding factors over time: this is complicated because the presence of interference violates the fundamental assumption required for existing causal inference methods. We address this identification issue, by developing a generalized synthetic control method that can debiase interfering “treated” and “control” units when conducting counterfactual analysis. Through a simulation study, we first show that under interference, our proposed method can significantly reduce bias in estimating the true intervention effect compared with existing methods. Applying the proposed method in our empirical context, we find that the focal brand’s intervention resulted in a significant 5% reduction of its daily search volume. This effect initially occurred after two days, but once regular TV advertising was resumed, it took two weeks for search volume to return to the prior level. In addition, we find large treatment heterogeneity across topical search categories. For instance, while search traffic was more likely to be reduced (up to 30% per day) for searches that are relevant to the content of TV ads, this effect wore off quickly. Lastly, we find a positive spillover effect of the intervention on the focal brand’s competitors, which, however, is usually very short-lived.

Keywords: TV advertising, keyword search, policy evaluation, synthetic control estimation, spillover effect, quasi-experiment

JEL Classification: M3,M2

Suggested Citation

Liu, Jia and Hill, Shawndra and Rothschild, David M., The Impact of Temporally Turning off TV Ad on Search: A Generalized Synthetic Control Estimator under Interference (July 2, 2021). Available at SSRN: https://ssrn.com/abstract=3880164 or http://dx.doi.org/10.2139/ssrn.3880164

Jia Liu (Contact Author)

HKUST Business School ( email )

Clear Water Bay
Hong Kong

Shawndra Hill

Microsoft Corporation - Microsoft Research, New York City ( email )

641 Avenue of Americas
New York, NY 10011
United States

David M. Rothschild

Microsoft Research ( email )

641 6th Ave., 7th Floor
New York, NY 10011
United States

HOME PAGE: http://researchdmr.com/

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
37
Abstract Views
168
PlumX Metrics