Bias in expert product reviews

Tinbergen Institute Discussion Paper 2021-042/V

46 Pages Posted: 18 May 2021

See all articles by Ben Vollaard

Ben Vollaard

CentER, Tilburg University

Jan C. van Ours

Tinbergen Institute

Multiple version iconThere are 2 versions of this paper

Date Written: May 12, 2021

Abstract

Hard evidence on bias in expert reviews and its consequences for ratings is rare. This holds particularly true for conflicts of interest that are thought to be common in non-blind product reviews but are not readily observable: ad hoc relationships between reviewers and producers. We present a textbook case of a long-running expert product review in the food service industry for which we happen to know the reviewer's conflict of interest: being affiliated to one particular producer. As is typical, only insiders were aware of the possible source of bias in the review. The review resembles other non-blind tests of product quality. We obtained detailed data to map the consequences of the conflict of interest. We find evidence of a sizable bias in the reviewers' ratings. Our findings suggest that reviewers' ad hoc relationships with producers, often dismissed as `coming with the job', can be very harmful.

Suggested Citation

Vollaard, Ben and van Ours, Jan C., Bias in expert product reviews (May 12, 2021). Tinbergen Institute Discussion Paper 2021-042/V, Available at SSRN: https://ssrn.com/abstract=3847682 or http://dx.doi.org/10.2139/ssrn.3847682

Ben Vollaard (Contact Author)

CentER, Tilburg University ( email )

P.O. Box 90153
Tilburg, 5000 LE
Netherlands

Jan C. Van Ours

Tinbergen Institute ( email )

Burg. Oudlaan 50
Rotterdam, 3062 PA
Netherlands

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
21
Abstract Views
184
PlumX Metrics