Social Structures and Reputation in Expert Review Systems

Abstract

We model an expert review system where two producers competing for market share each are evaluated by two raters. Employing economics experiments, the paper examines how the rater’s incentive to provide objective feedback can be distorted in the presence of social ties and different penalty structures for assigning unobjective ratings. The results reject the self-interested model. We find that raters assign more biased ratings to help the producer they know compete and this distortion is exacerbated when the reputation cost for rating unobjectively is lowered. Counterintuitively, when both the raters know the same producer, the likelihood of biased ratings drops significantly.

To explain the empirical regularities, we develop a behavioral economics model and show that the rater’s utility function should account not only for social preferences towards the producer, but also the rater’s psychological aversion towards favoring a producer more than the other rater. Our findings demonstrate that it is critical for policymakers to be cognizant of the non-pecuniary factors that can influence behavior in expert review systems.

Keywords: Review and Feedback Mechanism, Expert Reviews, Behavioral Economics, Experimental Economics