Understanding effects of personalized vs. aggregate ratings on user preferences

Gediminas Adomavicius, Jesse C Bockstedt, Shawn Curley, Jingjing Zhang

Research output: Contribution to journalArticle

6 Citations (Scopus)

Abstract

Prior research has shown that online recommendations have significant influence on consumers' preference ratings and their economic behavior. However, research has not examined the anchoring effects of aggregate user ratings, which are also commonly displayed in online retail settings. This research compares and contrasts the anchoring biases introduced by aggregate ratings on consumers' preferences ratings to those produced by personalized recommendations. Through multiple laboratory experiments, we show that the user preferences can be affected (i.e., distorted) by the displayed average online user ratings in a similar manner as has been shown with personalized recommendations. We further compare the magnitude of anchoring biases by personalized recommendations and aggregate ratings. Our results show that when shown separately, aggregate ratings and personalized recommendations create similar effects on user preferences. When shown together, there is no cumulative increase in the effect, and personalized recommendations tend to dominate the effect on user preferences. We also test these effects using an alternative top-N presentation format. Our results here suggest that top-N lists may be an effective presentation solution that maintains key information provided by recommendations while reducing or eliminating decision biases.

Original languageEnglish (US)
Pages (from-to)14-21
Number of pages8
JournalCEUR Workshop Proceedings
Volume1679
StatePublished - 2016
Externally publishedYes

Fingerprint

Economics
Experiments

Keywords

  • Aggregate ratings
  • Anchoring effects
  • Laboratory experiments
  • Personalized ratings
  • Preference bias
  • Recommender systems

ASJC Scopus subject areas

  • Computer Science(all)

Cite this

Understanding effects of personalized vs. aggregate ratings on user preferences. / Adomavicius, Gediminas; Bockstedt, Jesse C; Curley, Shawn; Zhang, Jingjing.

In: CEUR Workshop Proceedings, Vol. 1679, 2016, p. 14-21.

Research output: Contribution to journalArticle

Adomavicius, Gediminas ; Bockstedt, Jesse C ; Curley, Shawn ; Zhang, Jingjing. / Understanding effects of personalized vs. aggregate ratings on user preferences. In: CEUR Workshop Proceedings. 2016 ; Vol. 1679. pp. 14-21.
@article{ec50e2c9eff9457c935db9ea69766bc7,
title = "Understanding effects of personalized vs. aggregate ratings on user preferences",
abstract = "Prior research has shown that online recommendations have significant influence on consumers' preference ratings and their economic behavior. However, research has not examined the anchoring effects of aggregate user ratings, which are also commonly displayed in online retail settings. This research compares and contrasts the anchoring biases introduced by aggregate ratings on consumers' preferences ratings to those produced by personalized recommendations. Through multiple laboratory experiments, we show that the user preferences can be affected (i.e., distorted) by the displayed average online user ratings in a similar manner as has been shown with personalized recommendations. We further compare the magnitude of anchoring biases by personalized recommendations and aggregate ratings. Our results show that when shown separately, aggregate ratings and personalized recommendations create similar effects on user preferences. When shown together, there is no cumulative increase in the effect, and personalized recommendations tend to dominate the effect on user preferences. We also test these effects using an alternative top-N presentation format. Our results here suggest that top-N lists may be an effective presentation solution that maintains key information provided by recommendations while reducing or eliminating decision biases.",
keywords = "Aggregate ratings, Anchoring effects, Laboratory experiments, Personalized ratings, Preference bias, Recommender systems",
author = "Gediminas Adomavicius and Bockstedt, {Jesse C} and Shawn Curley and Jingjing Zhang",
year = "2016",
language = "English (US)",
volume = "1679",
pages = "14--21",
journal = "CEUR Workshop Proceedings",
issn = "1613-0073",
publisher = "CEUR-WS",

}

TY - JOUR

T1 - Understanding effects of personalized vs. aggregate ratings on user preferences

AU - Adomavicius, Gediminas

AU - Bockstedt, Jesse C

AU - Curley, Shawn

AU - Zhang, Jingjing

PY - 2016

Y1 - 2016

N2 - Prior research has shown that online recommendations have significant influence on consumers' preference ratings and their economic behavior. However, research has not examined the anchoring effects of aggregate user ratings, which are also commonly displayed in online retail settings. This research compares and contrasts the anchoring biases introduced by aggregate ratings on consumers' preferences ratings to those produced by personalized recommendations. Through multiple laboratory experiments, we show that the user preferences can be affected (i.e., distorted) by the displayed average online user ratings in a similar manner as has been shown with personalized recommendations. We further compare the magnitude of anchoring biases by personalized recommendations and aggregate ratings. Our results show that when shown separately, aggregate ratings and personalized recommendations create similar effects on user preferences. When shown together, there is no cumulative increase in the effect, and personalized recommendations tend to dominate the effect on user preferences. We also test these effects using an alternative top-N presentation format. Our results here suggest that top-N lists may be an effective presentation solution that maintains key information provided by recommendations while reducing or eliminating decision biases.

AB - Prior research has shown that online recommendations have significant influence on consumers' preference ratings and their economic behavior. However, research has not examined the anchoring effects of aggregate user ratings, which are also commonly displayed in online retail settings. This research compares and contrasts the anchoring biases introduced by aggregate ratings on consumers' preferences ratings to those produced by personalized recommendations. Through multiple laboratory experiments, we show that the user preferences can be affected (i.e., distorted) by the displayed average online user ratings in a similar manner as has been shown with personalized recommendations. We further compare the magnitude of anchoring biases by personalized recommendations and aggregate ratings. Our results show that when shown separately, aggregate ratings and personalized recommendations create similar effects on user preferences. When shown together, there is no cumulative increase in the effect, and personalized recommendations tend to dominate the effect on user preferences. We also test these effects using an alternative top-N presentation format. Our results here suggest that top-N lists may be an effective presentation solution that maintains key information provided by recommendations while reducing or eliminating decision biases.

KW - Aggregate ratings

KW - Anchoring effects

KW - Laboratory experiments

KW - Personalized ratings

KW - Preference bias

KW - Recommender systems

UR - http://www.scopus.com/inward/record.url?scp=84988807084&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84988807084&partnerID=8YFLogxK

M3 - Article

AN - SCOPUS:84988807084

VL - 1679

SP - 14

EP - 21

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

SN - 1613-0073

ER -