Download this Paper Open PDF in Browser

The Value of Multi-Dimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments

Management Science, Forthcoming

41 Pages Posted: 11 May 2017 Last revised: 13 May 2017

Pei-Yu Chen

Arizona State University (ASU) - Department of Information Systems

Yili Hong

Arizona State University (ASU) - W.P. Carey School of Business

Ying Liu

Arizona State University (ASU) - Department of Information Systems

Date Written: May 10, 2017

Abstract

Online product ratings offer information on product quality. Scholars have recently proposed the potential of designing multi-dimensional rating systems to better convey information on multiple dimensions of products. This study investigates whether and how multi-dimensional rating systems affect consumer satisfaction (measured by product ratings), based on both observational data and two randomized experiments. Our identification strategy of the observational study hinges on a natural experiment on TripAdvisor when the website started to allow consumers to rate multiple dimensions of the restaurants as opposed to only provide an overall rating in January 2009. We further obtain rating data on the same set of restaurants from Yelp, which controls for the unobserved restaurant quality over time and allows us to identify the causal effect using a difference-in-difference approach. Results from the econometric analyses show that ratings in a single-dimensional rating system have a downward trend and a higher dispersion, whereas ratings in a multi-dimensional rating system are significantly higher and convergent. Findings from two randomized experiments suggest that the multi-dimensional rating system helps consumers find products that better fit their preferences and increases the confidence of their choices. We also show that the observed results cannot be explained by the priming effect due to rating system interface or a list of other alternative explanations. The combined evidence from the natural experiment and randomized experiments support the view that the multi-dimensional rating system enhances rating informativeness and provide implications for designing online rating systems that help consumers match their preferences with product attributes.

Keywords: multi-dimensional rating systems, natural experiment, difference-in-difference, multi-method research, product quality, consumer preference, rating informativeness, priming effect

Suggested Citation

Chen, Pei-Yu and Hong, Yili and Liu, Ying, The Value of Multi-Dimensional Rating Systems: Evidence from a Natural Experiment and Randomized Experiments (May 10, 2017). Management Science, Forthcoming. Available at SSRN: https://ssrn.com/abstract=2966269

Pei-Yu Chen

Arizona State University (ASU) - Department of Information Systems ( email )

Tempe, AZ
United States

Yili Hong (Contact Author)

Arizona State University (ASU) - W.P. Carey School of Business ( email )

Tempe, AZ 85287-3706
United States

HOME PAGE: http://my.wpcarey.asu.edu/directory/people/profile.cfm?person=2255148

Ying Liu

Arizona State University (ASU) - Department of Information Systems ( email )

Tempe, AZ
United States

Paper statistics

Downloads
164
Rank
155,311
Abstract Views
857