Why Does Collaborative Filtering Work? Recommendation Model Validation and Selection By Analyzing Bipartite Random Graphs

6 Pages Posted: 3 Apr 2006 Last revised: 2 Jul 2010

See all articles by Zan Huang

Zan Huang

Pennsylvania State University

Daniel D. Zeng

University of Arizona - Department of Management Information Systems

Date Written: October 17, 2005

Abstract

A large number of collaborative filtering (CF) algorithms have been proposed in the literature as the core of automated recommender systems. However, the underlying justification for these algorithms is lacking and their relative performances are typically domain- and data-dependent. In this paper, we aim to develop initial understanding of the validation and model/algorithm selection issues based on the graph topological modeling methodology. By representing the input data in the form of consumer-product interactions such as purchases and ratings as a bipartite graph, we develop bipartite graph topological measures to capture patterns that exist in the input data relevant to recommendation. Using a simulation approach, we observe the deviations of these topological measures for given recommendation datasets from the expected values for simulated random datasets. These deviations help explain why certain CF algorithms work for the given datasets. They can also serve as the basis for a comprehensive model selection framework that chooses appropriate CF algorithms given the characteristics of the dataset under study. We validate our approach using two real-world e-commerce datasets.

Keywords: Recommender systems, collaborative fitlering, random graphs

Suggested Citation

Huang, Zan and Zeng, Daniel D., Why Does Collaborative Filtering Work? Recommendation Model Validation and Selection By Analyzing Bipartite Random Graphs (October 17, 2005). Annual Workshop on Information Technolgies & Systems (WITS), Forthcoming, Available at SSRN: https://ssrn.com/abstract=894029 or http://dx.doi.org/10.2139/ssrn.894029

Zan Huang (Contact Author)

Pennsylvania State University ( email )

University Park
State College, PA 16802
United States

Daniel D. Zeng

University of Arizona - Department of Management Information Systems ( email )

AZ
United States

Do you have a job opening that you would like to promote on SSRN?

Paper statistics

Downloads
269
Abstract Views
2,000
rank
142,060
PlumX Metrics