Regression Adjustment for Estimating Distributional Treatment Effects in Randomized Controlled Trials 

54 Pages Posted: 22 Jul 2024 Last revised: 14 Jan 2025

Date Written: July 01, 2023

Abstract

In this paper, we address the issue of estimating and inferring distributional treatment effects in randomized experiments. The distributional treatment effect provides a more comprehensive understanding of treatment heterogeneity compared to average treatment effects. We propose a regression adjustment method that utilizes distributional regression and pre-treatment information, establishing theoretical efficiency gains without imposing restrictive distributional assumptions. We develop a practical inferential framework and demonstrate its advantages through extensive simulations. Analyzing water conservation policies, our method reveals that behavioral nudges systematically shift consumption from high to moderate levels. Examining health insurance coverage, we show the treatment reduces the probability of zero doctor visits by 6.6 percentage points while increasing the likelihood of 3-6 visits. In both applications, our regression adjustment method substantially improves precision and identifies treatment effects that were statistically insignificant under conventional approaches.

Keywords: Randomized experiment, A/B testing, Distributional treatment effect, Heterogeneous treatment effect, Regression adjustment, covariate adjustment

JEL Classification: C32, C53, E17, E44

Suggested Citation

Oka, Tatsushi and Yasui, Shota and Hayakawa, Yuta and Byambadalai, Undral, Regression Adjustment for Estimating Distributional Treatment Effects in Randomized Controlled Trials  (July 01, 2023). Available at SSRN: https://ssrn.com/abstract=4899404 or http://dx.doi.org/10.2139/ssrn.4899404

Tatsushi Oka (Contact Author)

Keio University ( email )

2 Chome-15-45 Mita
Minato, Tokyo 108-0073
Japan

HOME PAGE: http://oka-econ.github.io/

Yuta Hayakawa

CyberAgent, Inc ( email )

Undral Byambadalai

CyberAgent, Inc ( email )

Tokyo
Japan

HOME PAGE: http://undara.github.io

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
97
Abstract Views
344
Rank
590,235
PlumX Metrics