Is Blinded Review Enough? How Gendered Outcomes Arise Even Under Anonymous Evaluation

42 Pages Posted: 24 Apr 2019 Last revised: 25 Apr 2019

See all articles by Julian Kolev

Julian Kolev

Southern Methodist University (SMU) - Strategy & Entrepreneurship Department

Yuly Fuentes-Medel

Independent

Fiona Murray

Massachusetts Institute of Technology (MIT) - Entrepreneurship Center

Date Written: April 2019

Abstract

For organizations focused on scientific research and innovation, workforce diversity is a key driver of success. Blinded review is an increasingly popular approach to reducing bias and increasing diversity in the selection of people and projects, yet its effectiveness is not fully understood. We explore the impact of blinded review on gender inclusion in a unique setting: innovative research grant proposals submitted to the Gates Foundation from 2008-2017. Despite blinded review, female applicants receive significantly lower scores, which cannot be explained by reviewer characteristics, proposal topics, or ex-ante measures of applicant quality. By contrast, the gender score gap is no longer significant after controlling for text-based measures of proposals’ titles and descriptions. Specifically, we find strong gender differences in the usage of broad and narrow words, suggesting that differing communication styles are a key driver of the gender score gap. Importantly, the text-based measures that predict higher reviewer scores do not also predict higher ex-post innovative performance. Instead, female applicants exhibit a greater response in follow-on scientific output after an accepted proposal, relative to male applicants. Our results reveal that gender differences in writing and communication are a significant contributor to gender disparities in the evaluation of science and innovation.

Institutional subscribers to the NBER working paper series, and residents of developing countries may download this paper without additional charge at www.nber.org.

Suggested Citation

Kolev, Julian and Fuentes-Medel, Yuly and Murray, Fiona E., Is Blinded Review Enough? How Gendered Outcomes Arise Even Under Anonymous Evaluation (April 2019). NBER Working Paper No. w25759, Available at SSRN: https://ssrn.com/abstract=3377055

Julian Kolev (Contact Author)

Southern Methodist University (SMU) - Strategy & Entrepreneurship Department ( email )

United States

Yuly Fuentes-Medel

Independent ( email )

No Address Available
United States

Fiona E. Murray

Massachusetts Institute of Technology (MIT) - Entrepreneurship Center ( email )

United States

Here is the Coronavirus
related research on SSRN

Paper statistics

Downloads
34
Abstract Views
308
PlumX Metrics