Abstract

http://ssrn.com/abstract=2477081
 


 



An Empirical Method for Harmless Error


D. Alex Winkelman


University of Arizona - James E. Rogers College of Law

David V. Yokum


University of Arizona - James E. Rogers College of Law; University of Arizona - College of Science

Lisette C. Cole


second year law student at Arizona State University Sandra Day O'Connor College of Law

Shelby C. Thompson


Independent

Christopher T. Robertson


University of Arizona - James E. Rogers College of Law; Harvard University - Edmond J. Safra Center for Ethics; Harvard University - Petrie-Flom Center for Health Law Policy, Biotechnology, and Bioethics

September 16, 2014

Arizona State Law Journal, 2015, Forthcoming
Arizona Legal Studies Discussion Paper No. 14-19
USC CLASS Research Paper No. CLASS14-31

Abstract:     
Trials are often imperfect. When inadmissible evidence is introduced or the jury is incorrectly instructed, judges must determine whether the error was prejudicial or merely harmless. In making that assessment, judges resort to speculation about the counterfactual question of whether the error changed the outcome, compared to the decision of a properly informed and instructed jury. These decisions are likely colored by confirmation and status quo biases, along with “mental contamination” of the error itself. Even when appellate judges perform these analyses accurately, their decisions appear conclusory. Scholars and judges have roundly criticized this doctrine, but no solution has emerged.

We developed and piloted an unbiased and transparent method for making harmless error determinations, using randomized experiments with simulated jurors. To pilot this method on three real cases, we recruited 489 human subjects to participate as mock jurors reviewing trial vignettes that we manipulated into conditions with and without the errors. Subjects were blinded to the purpose of the study and to the first trial’s outcome. By comparing verdict rates in the error and no-error conditions, we estimated whether the error was harmful.

We found a high degree of correspondence between the assessments of real judges and our experimental method, which could be taken as a validation of the method and reassurance that it would not cause a radical change in the rates at which new trials are granted. Still, across the thousands of cases in which harmless error determinations are made each year, the empirical method may be more reliable since it avoids known biases. The transparency of our method may also lend greater legitimacy to harmlessness determinations. If such a method is used as a tool for litigants in real cases, courts will be called upon to establish procedures for taking such evidence and then draw lines to specify how much prejudice is too much, while also being sensitive to the limitations of statistical power. Our study is most useful as proof of concept for a new method to improve harmless error analyses.

Number of Pages in PDF File: 31

Keywords: harmless error, randomized experimentation, confirmation bias, appellate review, harmless error analyses

Accepted Paper Series





Download This Paper

Date posted: August 7, 2014 ; Last revised: September 17, 2014

Suggested Citation

Winkelman, D. Alex and Yokum, David V. and Cole, Lisette C. and Thompson, Shelby C. and Robertson, Christopher T., An Empirical Method for Harmless Error (September 16, 2014). Arizona State Law Journal, 2015, Forthcoming; Arizona Legal Studies Discussion Paper No. 14-19; USC CLASS Research Paper No. CLASS14-31. Available at SSRN: http://ssrn.com/abstract=2477081

Contact Information

D. Alex Winkelman
University of Arizona - James E. Rogers College of Law ( email )
P.O. Box 210176
Tucson, AZ 85721-0176
United States
David V. Yokum
University of Arizona - James E. Rogers College of Law ( email )
P.O. Box 210176
Tucson, AZ 85721-0176
United States
University of Arizona - College of Science ( email )
1040 E. Fourth Street
Tucson, AZ 85721-0077
United States
Lisette C. Cole
second year law student at Arizona State University Sandra Day O'Connor College of Law ( email )
Box 877906
Tempe, AZ 85287-7906
United States
Shelby C. Thompson
Independent ( email )
No Address Available
Christopher T. Robertson (Contact Author)
University of Arizona - James E. Rogers College of Law ( email )
P.O. Box 210176
Tucson, AZ 85721-0176
United States
HOME PAGE: http://www.law.arizona.edu/faculty/getprofile.cfm?facultyid=714

Harvard University - Edmond J. Safra Center for Ethics ( email )
124 Mount Auburn Street
Suite 520N
Cambridge, MA 02138
United States

Harvard University - Petrie-Flom Center for Health Law Policy, Biotechnology, and Bioethics ( email )
23 Everett Street
Cambridge, MA 02155
United States
Feedback to SSRN


Paper statistics
Abstract Views: 231
Downloads: 58
Download Rank: 222,005

© 2014 Social Science Electronic Publishing, Inc. All Rights Reserved.  FAQ   Terms of Use   Privacy Policy   Copyright   Contact Us
This page was processed by apollo3 in 0.750 seconds