Identifying and Evaluating Sample Selection Bias in Consumer Payment Surveys

Abstract

Making meaningful inferences based on survey data depends on the ability to recognize and adjust for discrepancies between the survey respondents and the target population; this partly involves understanding how survey samples differ with respect to heterogeneous clusters of the population. Ex post adjustments for unbiased population parameter estimates are usually based on easily measured variables with known distributions in the target population, like age, gender, or income. This paper focuses on identifying and assessing the effect of an overlooked source of heterogeneity and potential selection bias related to household structure and dynamics. In household economies, tasks are often concentrated among a subset of the household members, so individual differences in behavior are related to performing different roles within the household. When the sampling involves selecting individuals from within households, a tendency to choose certain types of members for participation in a survey can result in unrepresentative samples and biased estimates for any variable relating to the respondent's household duties. The Boston Fed's Survey of Consumer Payment Choice (SCPC) seeks to estimate parameters, such as the average number of monthly payments, for the entire U.S. population. This data report exploits the fact that in the 2012 SCPC some respondents come from the same household, a unique feature that enables a study of the presence and ramifications of this type of selection bias when asking about household financial decisionmaking and payment choice. Using a two-stage statistical analysis, the survey answers are adjusted for a response error to estimate a latent variable that represents each respondent's share of financial responsibility for the household.

Keywords: survey error, household economics, Dirichlet regression, Survey of Consumer Payment Choice

JEL Classification: C11, C42, D12, D13