Non-Random Sampling and Association Tests on Realized Returns and Risk Proxies

Review of Accounting Studies, forthcoming

61 Pages Posted: 8 Jun 2020 Last revised: 8 Jan 2021

See all articles by Frank Ecker

Frank Ecker

Frankfurt School of Finance & Management

Jennifer Francis

Duke University

Per Olsson

ESMT European School of Management and Technology

Katherine Schipper

Duke University - Fuqua School of Business

Date Written: Jan 2, 2021

Abstract

This paper investigates how data requirements often encountered in archival accounting research can produce a data-restricted sample that is a non-random selection of observations from the reference sample to which the researcher wishes to generalize results. We illustrate the effects of non-random sampling on results of association tests in a setting with data on one variable of interest for all observations and frequently-missing data on another variable of interest. We develop and validate a resampling approach that uses only observations from the data-restricted sample to construct distribution-matched samples that approximate randomly-drawn samples from the reference sample. Our simulation tests provide evidence that distribution-matched samples yield generalizable results. We demonstrate the effects of non-random sampling in tests of the association between realized returns and five implied cost of equity metrics. In this setting, the reference sample has full information on realized returns, while on average only 16% of reference sample observations have data on cost of equity metrics. Consistent with prior research (e.g., Easton and Monahan 2005), analysis using the unadjusted (non-random) cost of equity sample reveals weak or negative associations between realized returns and cost of equity metrics. In contrast, using distribution-matched samples, we find reliable evidence of the theoretically-predicted positive association. We also conceptually and empirically compare distribution-matching with multiple imputation and selection models, two other approaches to dealing with non-random samples.

Suggested Citation

Ecker, Frank and Francis, Jennifer and Olsson, Per and Schipper, Katherine, Non-Random Sampling and Association Tests on Realized Returns and Risk Proxies (Jan 2, 2021). Review of Accounting Studies, forthcoming, Available at SSRN: https://ssrn.com/abstract=3599957 or http://dx.doi.org/10.2139/ssrn.3599957

Frank Ecker (Contact Author)

Frankfurt School of Finance & Management ( email )

Adickesallee 32-34
Frankfurt, 60322
Germany

Jennifer Francis

Duke University ( email )

220 Allen Building
Durham, NC 27705
United States

Per Olsson

ESMT European School of Management and Technology ( email )

Schlossplatz 1
10117 Berlin
Germany

Katherine Schipper

Duke University - Fuqua School of Business ( email )

Box 90120
Durham, NC 27708-0120
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
160
Abstract Views
1,503
Rank
334,612
PlumX Metrics