JD-Next: A Valid and Reliable Tool to Predict Diverse Students’ Success in Law School

Abstract

Admissions tests have increasingly come under attack by those seeking to broaden access and
reduce disparities in higher education. Meanwhile, in other sectors there is a movement towards
“work-sample” or “proximal” testing. Especially for underrepresented students, the goal is to
measure not just the accumulated knowledge and skills that they would bring to a new academic
program, but also their ability to grow and learn through the program.

The JD-Next is a fully-online, non-credit, 7-10 week course to train potential JD students in case
reading and analysis skills, prior to their first year of law school. This study tests the validity and
reliability of the JD-Next exam as a potential admissions tool for juris doctor programs of
education. (In a companion article, we report on the efficacy of the course for preparing students
for law school.)

In 2019, we recruited a national sample of potential JD students, enriched for racial/ethnic
diversity, along with a sample of volunteers at one university (N=62). In 2020, we partnered with
17 law schools around the country to recruit a cohort of their incoming law students (N=238). At
the end of the course, students were incentivized to take and perform well on an exam that we
graded with a standardized methodology. We collected first-semester grades as an outcome
variable, and compared JD-Next exam properties to legacy exams now used by law schools (the
LSAT, including converted GRE scores).

We found that the JD-Next exam was a valid and reliable predictor of law school performance,
comparable to legacy exams. For schools ranked outside the top-50 we found that the legacy
exams lacked significant incremental validity in our sample, but the JD-Next exam provided a
significant advantage. We also replicated known, substantial racial and ethnic disparities on the
legacy exam scores, but estimate smaller, non-significant score disparities on the JD-Next exam.
Together this research suggests that, as an admissions tool, the JD-Next exam may reduce the risk
that capable students will be excluded from legal education and the legal profession.

The companion paper testing efficacy of the JD-Next program for improving law school grades is available at https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3845577.

Note:

Keywords: legal education, academic success, bridge program, pipeline program, case briefing, case analysis, legal analysis, law school GPA, online curriculum, admissions, student confidence, standardized testing, admissions testing, validity, reliability, standard 503, diversity and inclusion, disparities