Experiments on user experiences with recommender interfaces

Li CHEN*, Pearl Pu

*Corresponding author for this work

Research output: Contribution to journalJournal articlepeer-review

23 Citations (Scopus)


Recommender systems have been increasingly adopted as personalisation services in e-commerce. They facilitate users to locate items which they would be interested in viewing or purchasing. However, most studies have emphasised on the algorithm's performance, rather than on in-depth analysis of user experiences with the recommender interface. In this article, we report the results of two studies that compared two recommender interfaces: the organisation-based interface (where recommendations are presented in a category structure via the preference-based organisation method) and the standard ranked list (where recommendations are listed one after the other as ordered by their prediction scores).The first study focuses on evaluating users' eye-movement behaviour in these interfaces. With the help of an eye tracker, we found that the organisation interface (ORG) can significantly attract users' attentions to more recommended items. As a result, more users made product choices in that interface. The second, larger-scale, cross-cultural user survey further shows that the ORG performed significantly better in terms of enhancing users' perceived recommendation quality, perceived ease of use and perceived usefulness of the system. Hence, these empirical findings suggest that the change of recommender interface design can not only alter users' attention distribution, but also influence their subjective attitudes towards the system.

Original languageEnglish
Pages (from-to)372-394
Number of pages23
JournalBehaviour and Information Technology
Issue number4
Publication statusPublished - 3 Apr 2014

Scopus Subject Areas

  • Developmental and Educational Psychology
  • Arts and Humanities (miscellaneous)
  • Social Sciences(all)
  • Human-Computer Interaction

User-Defined Keywords

  • cross-cultural validation
  • e-commerce
  • evaluation methodology
  • eye-tracking experiment
  • organisation interface
  • Product recommender systems
  • ranked list
  • subjective perceptions
  • user study


Dive into the research topics of 'Experiments on user experiences with recommender interfaces'. Together they form a unique fingerprint.

Cite this