Propensity Score Matching and Variations on the Balancing Test

48 Pages Posted: 19 Oct 2006  

Wang-Sheng Lee

Deakin University

Date Written: August 11, 2006

Abstract

This paper focuses on the role of balancing tests when employing propensity score matching methods. The idea behind these tests are to check to see if observations with the same propensity score have the same distribution of observable covariates independent of treatment status. Currently, multiple versions of the balancing test exist in the literature. One troubling aspect is that different balancing tests sometimes yield different answers. This paper highlights the importance of distinguishing between balancing tests that are conducted before matching and after matching, and provides a Monte Carlo examination of four commonly employed balancing tests. We highlight the poor size properties of these commonly employed balancing tests and demonstrate how non-parametric versions of before and after matching tests provide much better test sizes. Finally, we illustrate how balancing tests are of little utility if the conditional independence assumption underlying matching estimators is not fulfilled.

Keywords: Matching, Propensity score, Monte Carlo simulation

JEL Classification: C21

Suggested Citation

Lee, Wang-Sheng, Propensity Score Matching and Variations on the Balancing Test (August 11, 2006). Available at SSRN: https://ssrn.com/abstract=936782 or http://dx.doi.org/10.2139/ssrn.936782

Wang-Sheng Lee (Contact Author)

Deakin University ( email )

Burwood, Victoria 3215
Australia
+61392446669 (Phone)

HOME PAGE: http://www.deakin.edu.au/buslaw/aef/staff/profiles/lee.php

Paper statistics

Downloads
507
Rank
43,839
Abstract Views
2,309