Why does collaborative filtering work? - Recommendation model validation and selection by analyzing bipartite random graphs

Zan Huang, Daniel D. Zeng

Research output: Contribution to conferencePaper

7 Scopus citations

Abstract

A large number of collaborative filtering (CF) algorithms have been proposed in the literature as the core of automated recommender systems. However, the underlying justification for these algorithms is lacking and their relative performances are typically domain- And data-dependent. In this paper, we aim to develop initial understanding of the validation and model/algorithm selection issues based on the graph topological modeling methodology. By representing the input data in the form of consumer-product interactions such as purchases and ratings as a bipartite graph, we develop bipartite graph topological measures to capture patterns that exist in the input data relevant to recommendation. Using a simulation approach, we observe the deviations of these topological measures for given recommendation datasets from the expected values for simulated random datasets. These deviations help explain why certain CF algorithms work for the given datasets. They can also serve as the basis for a comprehensive model selection framework that chooses appropriate CF algorithms given the characteristics of the dataset under study. We validate our approach using two real-world e-commerce datasets.

Original languageEnglish (US)
Pages33-38
Number of pages6
DOIs
StatePublished - Jan 1 2005
Event15th Workshop on Information Technology and Systems, WITS 2005 - Las Vegas, NV, United States
Duration: Dec 10 2005Dec 11 2005

Other

Other15th Workshop on Information Technology and Systems, WITS 2005
CountryUnited States
CityLas Vegas, NV
Period12/10/0512/11/05

ASJC Scopus subject areas

  • Information Systems
  • Control and Systems Engineering

Fingerprint Dive into the research topics of 'Why does collaborative filtering work? - Recommendation model validation and selection by analyzing bipartite random graphs'. Together they form a unique fingerprint.

  • Cite this

    Huang, Z., & Zeng, D. D. (2005). Why does collaborative filtering work? - Recommendation model validation and selection by analyzing bipartite random graphs. 33-38. Paper presented at 15th Workshop on Information Technology and Systems, WITS 2005, Las Vegas, NV, United States. https://doi.org/10.2139/ssrn.894029