When Less is More: Using Short-Term Signals to Overcome Systematic Bias in Long-Run Targeting

55 Pages Posted: 24 Oct 2022

See all articles by Ta-Wei Huang

Ta-Wei Huang

Harvard University - Business School (HBS)

Eva Ascarza

Harvard Business School

Date Written: October 19, 2022

Abstract

Firms are increasingly interested in developing targeted interventions for customers with the best response. Doing so requires firms to identify differences in customer sensitivity, which they often obtain using uplift modeling (i.e., heterogeneous treatment effect estimation). To optimize the long-run business performance, firms should, in theory, construct such models for a long-term outcome. However, we show that targeting using such models fails to improve (even hurts) firms' long-run profitability when the outcome of interest accumulates noisy customer behaviors over time. We identify two causes of this problem. First, most state-of-the-art uplift models misattribute noise to the treatment effect, making firms fail to identify customers with the highest long-run sensitivity. Second, customer attrition, present in most marketing contexts, exacerbates the problem by creating an identification issue. To overcome this problem, we argue that firms should only use less-noisy short-term signals to estimate heterogeneity in the long-term treatment effect. In particular, we propose a novel imputation technique that reduces noise in attrition and transaction processes. Using simulation and a real-world experiment, we show that (i) using short-term signals instead of the actual long-term outcome in targeting can significantly improve the long-run profitability, and (ii) the proposed technique outperforms the existing imputation approaches.

Keywords: Long-run Targeting, Heterogeneous Treatment effect, Statistical Surrogacy, Customer Churn, Field Experiments

JEL Classification: C51, C52, C53, C54, M31

Suggested Citation

Huang, Ta-Wei and Ascarza, Eva, When Less is More: Using Short-Term Signals to Overcome Systematic Bias in Long-Run Targeting (October 19, 2022). Available at SSRN: https://ssrn.com/abstract=4254202 or http://dx.doi.org/10.2139/ssrn.4254202

Ta-Wei Huang (Contact Author)

Harvard University - Business School (HBS) ( email )

Boston, MA 02163
United States

Eva Ascarza

Harvard Business School ( email )

Soldiers Field
Boston, MA 02163
United States

HOME PAGE: http://evaascarza.com

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
60
Abstract Views
186
rank
506,469
PlumX Metrics