EUVIMEDDescoperă EUVIMED
Open access · CC BY-NC 4.0

Human Variability and the Explore–Exploit Trade‐Off in Recommendation

Scott Cheng-Hsin Yang, Chirag Rank, Jake A Whritner, Olfa Nasraoui, Patrick Shafto

Cognitive Science · 2023-04 · 47 (4)

DOI: 10.1111/cogs.13279 ↗

At a glance

Journal article in Cognitive Science, published online on 2023-04-13. Written by Scott Cheng-Hsin Yang and 4 co-authors. Institution: Department of Mathematics and Computer Science, Rutgers University. Major MEDLINE topics: Algorithms, Exploratory Behavior. Cited 1 times so far (Crossref); 58 references. The full text is freely available (open access, CC BY-NC 4.0).

RezumatSubjectsDate bibliograficeCiteRelated studies

Abstract (original language)

The enormous scale of the available information and products on the Internet has necessitated the development of algorithms that intermediate between options and human users. These algorithms attempt to provide the user with relevant information. In doing so, the algorithms may incur potential negative consequences stemming from the need to select items about which it is uncertain to obtain information about users versus the need to select items about which it is certain to secure high ratings. This tension is an instance of the exploration–exploitation trade‐off in the context of recommender systems. Because humans are in this interaction loop, the long‐term trade‐off behavior depends on human variability. Our goal is to characterize the trade‐off behavior as a function of human variability fundamental to such human–algorithm interaction. To tackle the characterization, we first introduce a unifying model that smoothly transitions between active learning and recommending relevant information. The unifying model gives us access to a continuum of algorithms along the exploration–exploitation trade‐off. We then present two experiments to measure the trade‐off behavior under two very different levels of human variability. The experimental results inform a thorough simulation study in which we modeled and varied human variability systematically over a wide rage. The main result is that exploration–exploitation trade‐off grows in severity as human variability increases, but there exists a regime of low variability where algorithms balanced in exploration and exploitation can largely overcome the trade‐off.

Subjects

MeSH terms (MEDLINE)

AlgorithmsExploratory BehaviorHumansUncertaintyComputer SimulationInternet

Author keywords

Active learningExploration-exploitation trade-offHuman variabilityRecommender system

Authors and institutions

  • Department of Mathematics and Computer Science, Rutgers University.
  • Center for Perceptual Systems, University of Texas at Austin.
  • Department of Computer Engineering and Computer Science, University of Louisville.
  • School of Mathematics, Institute for Advanced Study.

Cite

APA

Yang, S. C., Rank, C., Whritner, J. A., Nasraoui, O., & Shafto, P. (2023). Human Variability and the Explore–Exploit Trade‐Off in Recommendation. Cognitive Science, 47(4). https://doi.org/10.1111/cogs.13279

Vancouver

Yang SC, Rank C, Whritner JA, Nasraoui O, Shafto P. Human Variability and the Explore–Exploit Trade‐Off in Recommendation. Cognitive Science. 2023;47(4). doi:10.1111/cogs.13279

BibTeX
@article{Yang2023,
  author = {Yang, Scott Cheng-Hsin and Rank, Chirag and Whritner, Jake A and Nasraoui, Olfa and Shafto, Patrick},
  title = {Human Variability and the Explore–Exploit Trade‐Off in Recommendation},
  journal = {Cognitive Science},
  year = {2023},
  volume = {47},
  number = {4},
  doi = {10.1111/cogs.13279}
}
Start for free →