Neglect of Multiplicity When Testing Families of Related Hypotheses*

46 Pages Posted: 3 Sep 2009

See all articles by Burt Holland

Burt Holland

Temple University - Department of Accounting

sun wei fang

affiliation not provided to SSRN

Sudipta Basu

Temple University - Department of Accounting

Date Written: September 1, 2009

Abstract

Many accounting research papers report statistical results involving families of related tests of hypotheses. Unlike many scientific disciplines, accounting researchers rarely attend to a familywise Type I error concept; for example, control of the probability of incorrectly declaring at least one significant result in the family. Neglecting this principle can lead to an excessive number of false declarations of significance, and therefore, spurious inferences. We review some simple established methods for controlling for multiplicity. A few examples from the “Top 3” accounting journals illustrate that inattention to familywise control can affect primary study conclusions. A compromise approach is suggested for those who choose to present results either with or without recognition of familywise Type I error control.

Keywords: multiple comparisons, Bonferroni, Holm, publication bias, journal policies

Suggested Citation

Holland, Burt and fang, sun wei and Basu, Sudipta, Neglect of Multiplicity When Testing Families of Related Hypotheses* (September 1, 2009). Available at SSRN: https://ssrn.com/abstract=1466343 or http://dx.doi.org/10.2139/ssrn.1466343

Burt Holland

Temple University - Department of Accounting ( email )

Philadelphia, PA 19122
United States

Sun wei Fang

affiliation not provided to SSRN ( email )

Sudipta Basu (Contact Author)

Temple University - Department of Accounting ( email )

Philadelphia, PA 19122
United States
215.204.0489 (Phone)
215.204.5587 (Fax)

Register to save articles to
your library

Register

Paper statistics

Downloads
21
Abstract Views
460
PlumX Metrics