External Validity

Posted: 22 Jun 2021

See all articles by Michael Findley

Michael Findley

University of Texas at Austin

Kyosuke Kikuta

Institute of Developing Economies

Michael Denly

The University of Texas at Austin

Date Written: May 1, 2021

Abstract

External validity captures the extent to which inferences drawn from a given study's sample apply to a broader population or other target populations. Social scientists frequently invoke external validity as an ideal, but they rarely attempt to make rigorous, credible external validity inferences. In recent years, methodologically oriented scholars have advanced a flurry of work on various components of external validity, and this article reviews and systematizes many of those insights. We first clarify the core conceptual dimensions of external validity and introduce a simple formalization that demonstrates why external validity matters so critically. We then organize disparate arguments about how to address external validity by advancing three evaluative criteria: model utility, scope plausibility, and specification credibility. We conclude with a practical aspiration that scholars supplement existing reporting standards to include routine discussion of external validity. It is our hope that these evaluation and reporting standards help rebalance scientific inquiry, such that the current obsession with causal inference is complemented with an equal interest in generalized knowledge.

Suggested Citation

Findley, Michael and Kikuta, Kyosuke and Denly, Michael, External Validity (May 1, 2021). Annual Review of Political Science, Vol. 24, pp. 365-393, 2021, Available at SSRN: https://ssrn.com/abstract=3865531 or http://dx.doi.org/10.1146/annurev-polisci-041719-102556

Michael Findley (Contact Author)

University of Texas at Austin ( email )

2317 Speedway
Austin, TX 78712
United States

Kyosuke Kikuta

Institute of Developing Economies ( email )

3-2-2 Wakaba
Mihama-ku
Chiba, Chiba 261-8545
Japan

Michael Denly

The University of Texas at Austin

United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Abstract Views
79
PlumX Metrics