The Public Safety Assessment: A Re-Validation and Assessment of Predictive Utility and Differential Prediction by Race and Gender in Kentucky

61 Pages Posted: 30 Apr 2018 Last revised: 7 May 2018

See all articles by Matthew DeMichele

Matthew DeMichele

RTI International

Peter Baumgartner

RTI International

Michael Wenger

RTI International

Kelle Barrick

RTI International

Megan Comfort

RTI International; University of California, San Francisco (UCSF)

Shilpi Misra

RTI International

Date Written: April 25, 2018

Abstract

In this paper, we assess the predictive validity and differential prediction by race and gender of one pretrial risk assessment, the Public Safety Assessment (PSA). The PSA was developed with support from the Laura and John Arnold Foundation (LJAF) to reduce the burden placed on vulnerable populations at the frontend of the criminal justice system. The growing and disparate use of incarceration is one of the most pressing social issues facing the U.S. Although it has received less attention, pretrial populations are a large and growing contributor of mass incarceration. The pretrial phase is often said to be the most consequential in the criminalizing process because it is related a higher likelihood of conviction, longer terms of incarceration, and has the potential to destabilize families. Recognizing the inherent challenges in pretrial release decisions, there has been increased development and use of pretrial risk assessments. Pretrial risk assessments are developed to identify the likelihood that defendants will remain crime free and that they will return to court. There have been several critiques of risk assessments, but none have assessed differential validity or prediction using pretrial outcomes. Using a statewide dataset from Kentucky (n = 164,597) we found the PSA to have predictive validity measures in line with what are generally accepted within the criminal justice field. We applied a regression modeling approach commonly used to assess bias in test instruments (e.g., cognitive and employment testing), and found some instances of differential prediction by race. These differences suggest that the PSA scores to predict failure to appear (FTA) are moderated by race, with no significant differences found for new crimes and new violent crimes between black and white defendants. The findings show differential prediction for new violent criminal arrests between male and female defendants, similar to what was found by Skeem et al. (2016). In the end, we point to data limitations that weaken external validity, point to areas for future research, and suggest that risk assessments are not silver bullets, but rather decision-making tools that require ongoing refinement.

Suggested Citation

DeMichele, Matthew and Baumgartner, Peter and Wenger, Michael and Barrick, Kelle and Comfort, Megan and Misra, Shilpi, The Public Safety Assessment: A Re-Validation and Assessment of Predictive Utility and Differential Prediction by Race and Gender in Kentucky (April 25, 2018). Available at SSRN: https://ssrn.com/abstract=3168452 or http://dx.doi.org/10.2139/ssrn.3168452

Matthew DeMichele (Contact Author)

RTI International ( email )

PO Box 12194
Research Triangle Park, 27709
United States

Peter Baumgartner

RTI International ( email )

PO Box 12194
Research Triangle Park, 27709
United States

Michael Wenger

RTI International ( email )

PO Box 12194
Washington, DC 20036-3209
United States

Kelle Barrick

RTI International ( email )

PO Box 12194
Research Triangle Park, 27709
United States

Megan Comfort

RTI International

351 California St.
Ste. 500
San Francisco, CA 94104
United States
415-848-1375 (Phone)

University of California, San Francisco (UCSF) ( email )

Third Avenue and Parnassus
San Francisco, CA CA 94143
United States

Shilpi Misra

RTI International ( email )

PO Box 12194
Research Triangle Park, 27709
United States

Do you have negative results from your research you’d like to share?

Paper statistics

Downloads
984
Abstract Views
5,396
Rank
43,023
PlumX Metrics