Why Do Online Product Reviews Have a J-Shaped Distribution? Overcoming Biases in Online Word-of-Mouth Communication

Communications of the ACM (2009), 52 (10), 144-147

35 Pages Posted: 18 Jan 2014 Last revised: 31 Dec 2016

See all articles by Nan Hu

Nan Hu

Stevens Institute of Technology - School of Business

Paul A. Pavlou

Temple University - Department of Management Information Systems; Temple University - Department of Strategic Management

Jie (Jennifer) Zhang

University of Texas at Arlington

Date Written: March 1, 2007

Abstract

Online word-of-mouth communication in the form of product reviews is a major information source for consumers and marketers about product quality. The literature has used the mean of online reviews to predict product sales, assuming that the mean reflects product quality. However, using a combination of econometric, experimental, and analytical results, we show that the mean is a biased estimator of product quality due to two self-selection biases (purchasing and under-reporting bias). First, econometric results with secondary data from Amazon.com show that almost all products have an asymmetric bimodal (J-shaped) distribution with more positive than negative reviews. Second, experimental results where all respondents wrote reviews show that their reviews have an approximately normal distribution with roughly equal number of positive and negative reviews. This implies two biases: (1) purchasing bias - only consumers with favorable disposition towards a product purchase the product and have the opportunity to write a product review, and (2) under-reporting bias - consumers with polarized (either positive or negative) reviews are more likely to report their reviews than consumers with moderate reviews. This results in a J-shaped distribution of online product reviews that renders the mean a biased estimator of product quality. Third, we develop an analytical model to derive the conditions for the mean to become an unbiased estimator of product quality. Based on these conditions, we build a new model that integrates three distributional parameters - mean, standard deviation, and the two modes of the online product reviews (to overcome under-reporting bias) and product price (to overcome purchasing bias). This model is shown to be a superior predictive model of future product sales compared to competing models.

Keywords: Product Quality, Word-of-Mouth Communication, Online Product Reviews, Bi-Modal Distribution, Unimodal Distribution, Online Consumer Behavior, Internet Marketing, E-commerce, Sales Forecasting, Econometric Models, Experimental Economics, Regression and other Statistical Techniques

Suggested Citation

Hu, Nan and Pavlou, Paul A. and Zhang, Jie (Jennifer), Why Do Online Product Reviews Have a J-Shaped Distribution? Overcoming Biases in Online Word-of-Mouth Communication (March 1, 2007). Communications of the ACM (2009), 52 (10), 144-147. Available at SSRN: https://ssrn.com/abstract=2380298 or http://dx.doi.org/10.2139/ssrn.2380298

Nan Hu

Stevens Institute of Technology - School of Business ( email )

Hoboken, NJ 07030
United States

Paul A. Pavlou (Contact Author)

Temple University - Department of Management Information Systems ( email )

1810 N. 13th Street
Floor 2
Philadelphia, PA 19128
United States

Temple University - Department of Strategic Management ( email )

Fox School of Business and Management
Philadelphia, PA 19122
United States

Jie (Jennifer) Zhang

University of Texas at Arlington ( email )

701 S. West St.
Arlington, TX 76019
United States

Register to save articles to
your library

Register

Paper statistics

Downloads
538
rank
49,478
Abstract Views
2,750
PlumX Metrics
!

Under construction: SSRN citations while be offline until July when we will launch a brand new and improved citations service, check here for more details.

For more information