Crowd-judging

66 Pages Posted: 27 Jan 2021 Last revised: 26 Sep 2022

See all articles by Alan Kwan

Alan Kwan

The University of Hong Kong

S. Alex Yang

London Business School

Angela Huyue Zhang

The University of Hong Kong - Faculty of Law

Date Written: September 25, 2022

Abstract

Disputes over transactions on two-sided platforms are common and usually arbitrated through platforms’ customer service departments or third-party service providers. This paper studies {\em crowd-judging}, a novel crowd-sourcing mechanism whereby users (buyers and sellers) volunteer as jurors to decide disputes arising from the platform. Using a rich dataset from the dispute resolution center at Taobao, a leading Chinese e-commerce platform, we aim to understand this innovation and propose and analyze potential operational improvements, with a focus on in-group bias (buyer jurors favor the buyer, likewise for sellers). Platform users, especially sellers, share the perception that in-group bias is prevalent and systematically sways case outcomes as the majority of users on such platforms are buyers, undermining the legitimacy of crowd-judging. Our empirical findings suggest that such concern is not completely unfounded: on average, a seller juror is approximately 10% likelier (than a buyer juror) to vote for a seller. Such bias is aggravated among cases that are decided by a thin margin, and when jurors perceive that their in-group's interests are threatened. However, the bias diminishes as jurors gain experience: a user's bias reduces by 95% as their experience grows from zero to the sample-median level. Incorporating these findings and juror participation dynamics in a simulation study, the paper delivers three managerial insights. First, under the existing voting policy, in-group bias influences the outcomes of no more than 2% of cases. Second, simply increasing crowd size, either through a larger case panel or aggressively recruiting new jurors, may not be efficient in reducing the adverse effect of in-group bias. Finally, policies that allocate cases dynamically could simultaneously mitigate the impact of in-group bias and nurture a more sustainable juror pool.

Keywords: Crowd-sourcing, crowd-judging, platform governance, platform operations, two-sided marketplace, bias, experience, learning

Suggested Citation

Kwan, Alan and Yang, S. Alex and Zhang, Angela Huyue, Crowd-judging (September 25, 2022). Available at SSRN: https://ssrn.com/abstract=3758359 or http://dx.doi.org/10.2139/ssrn.3758359

Alan Kwan

The University of Hong Kong ( email )

Pokfulam Road
Hong Kong, Pokfulam HK
China

S. Alex Yang (Contact Author)

London Business School ( email )

Sussex Place
Regent's Park
London, London NW1 4SA
United Kingdom

HOME PAGE: http://salexyang.com

Angela Huyue Zhang

The University of Hong Kong - Faculty of Law ( email )

Pokfulam Road
Hong Kong, Hong Kong
China

HOME PAGE: http://www.angelazhang.net

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
293
Abstract Views
1,661
rank
148,613
PlumX Metrics