The Hidden Daubert Factor: How Judges Use Error Rates in Assessing Scientific Evidence

72 Pages Posted: 7 Mar 2014 Last revised: 13 Apr 2015

Date Written: March 7, 2014

Abstract

In Daubert v. Merrell Dow Pharmaceuticals, the United States Supreme Court provided a framework under which trial judges must assess the evidentiary reliability of scientific evidence whose admissibility is challenged. One factor of the Daubert test, the “known or potential rate of error” of the expert’s method, has received considerably less scholarly attention than the other factors, and past empirical study has indicated that judges have a difficult time understanding the factor and use it less frequently in their analyses as compared to other factors. In this paper, we examine one possible interpretation of the “known or potential rate of error” standard that would treat the factor more broadly, considering direct assessments of a method’s validity as assessments of the method’s potential rate of error, even when numerical error rates are not mentioned. To assess the extent to which judges use the error rate factor in this “implicit” sense, we examined 208 federal district court cases, coding for the number of words judges spent analyzing expert evidence in light of the Daubert factors and other evidentiary considerations. We found that judges faced with a Daubert challenge often undertake a detailed analysis of the quality of the methodology used by the expert rather than simply relying on proxies for the quality of the method such as peer review and general acceptance. Analysis of a method’s potential rate of error was significantly more common and longer than analysis using any of the other Daubert factors. This implicit error rate analysis also predicted the final admissibility ruling of the evidence and varied across expert disciplines. Our data support the notion that judges engage in substantial efforts to directly assess the validity of the scientific method before them when responding to a Daubert challenge. That is, they engage substantially in central processing in making methodological evaluations rather than merely relying on the peripheral cues of peer review and general acceptance. This finding lays the groundwork for future assessments of the obstacles judges face in these more demanding evaluations.

Suggested Citation

Meixner, John B. and Seidman Diamond, Shari, The Hidden Daubert Factor: How Judges Use Error Rates in Assessing Scientific Evidence (March 7, 2014). Wisconsin Law Review, December 2014. Available at SSRN: https://ssrn.com/abstract=2406073

John B. Meixner (Contact Author)

Northwestern University - Pritzker School of Law ( email )

375 E. Chicago Ave
Chicago, IL 60611
United States

Northwestern University - Department of Psychology

Evanston, IL
United States

Shari Seidman Diamond

Northwestern University, School of Law & American Bar Foundation ( email )

375 E. Chicago Ave
Chicago, IL 60611
United States
312-503-2040 (Phone)

Register to save articles to
your library

Register

Paper statistics

Downloads
116
rank
234,745
Abstract Views
592
PlumX Metrics
!

Under construction: SSRN citations while be offline until July when we will launch a brand new and improved citations service, check here for more details.

For more information