Reexamining Relative Bar Performance as a Function of Non-Linearity, Heteroscedasticity, and a New Independent Variable 52 N.M. L. Rev. 1119 2022

95 Pages Posted: 20 Mar 2021 Last revised: 28 Jan 2022

See all articles by Rory D. Bahadur

Rory D. Bahadur

Washburn University - School of Law

Dr. Kevin Ruth

Independent

Katie Tolliver Jones

Lincoln Memorial University

Date Written: February 12, 2021

Abstract

One might think that if a law school’s graduates do better on the bar exam than their credentials on entering law school would have predicted, the law school’s faculty must have done a good job. Indeed, some scholarship makes that claim. But it is empirically untrue. What actually yields such superficially impressive results is not pedagogy but rather prestidigitation. When law schools manipulate their matriculant pools via academic attrition and transfer, that sleight of hand improves their bar performance rates. This article reveals the math behind the magic.

We challenge the assertion that effective pedagogy is the primary driver of a school’s overperformance on the bar examination by demonstrating the model misspecification of the linear regressions in support of that assertion. Our analyses, based on original code written for the program Mathematica, generate regression equations that clearly illustrate the error of applying linear regression to heteroscedastic, non-linear data, and the bias in favor of schools with mid-range LSAT and UGPA matriculants this misapplication causes.

Over and under performance on the bar examination, relative to the entering credentials of a school’s matriculants, can be explained in large part by combining the institutions’ academic attrition and net transfer rates into a single independent variable. We demonstrate the marked difference in the value of this variable between schools identified as overperforming and those identified as underperforming their matriculation credentials on the bar examination.

The article concludes by emphasizing the harm to legal education that stems from the unwarranted attribution of bar success to pedagogy and especially the harm this causes to untenured academic support faculty. We also raise the question of whether ABA standard 316-mandating a certain level of bar passage by law schools’ graduates-is ethically and morally supportable given the ability of schools to manipulate bar passage rates by modulating academic attrition and transfer rates.

Suggested Citation

Bahadur, Rory D. and Ruth, Kevin and Tolliver Jones, Katie, Reexamining Relative Bar Performance as a Function of Non-Linearity, Heteroscedasticity, and a New Independent Variable 52 N.M. L. Rev. 1119 2022 (February 12, 2021). New Mexico Law Review, Vol. 52, 2021, Available at SSRN: https://ssrn.com/abstract=3784863 or http://dx.doi.org/10.2139/ssrn.3784863

Rory D. Bahadur (Contact Author)

Washburn University - School of Law ( email )

1700 College Avenue
Topeka, KS 66621
United States

Kevin Ruth

Independent ( email )

Katie Tolliver Jones

Lincoln Memorial University ( email )

Harrogate, TN 37752
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
559
Abstract Views
2,140
Rank
90,156
PlumX Metrics