Human Variability and the Explore–Exploit Trade‐Off in Recommendation
Cognitive Science · 2023-04 · 47 (4)
DOI: 10.1111/cogs.13279 ↗At a glance
Journal article in Cognitive Science, published online on 2023-04-13. Written by Scott Cheng-Hsin Yang and 4 co-authors. Institution: Department of Mathematics and Computer Science, Rutgers University. Major MEDLINE topics: Algorithms, Exploratory Behavior. Cited 1 times so far (Crossref); 58 references. The full text is freely available (open access, CC BY-NC 4.0).
Abstract (original language)
The enormous scale of the available information and products on the Internet has necessitated the development of algorithms that intermediate between options and human users. These algorithms attempt to provide the user with relevant information. In doing so, the algorithms may incur potential negative consequences stemming from the need to select items about which it is uncertain to obtain information about users versus the need to select items about which it is certain to secure high ratings. This tension is an instance of the exploration–exploitation trade‐off in the context of recommender systems. Because humans are in this interaction loop, the long‐term trade‐off behavior depends on human variability. Our goal is to characterize the trade‐off behavior as a function of human variability fundamental to such human–algorithm interaction. To tackle the characterization, we first introduce a unifying model that smoothly transitions between active learning and recommending relevant information. The unifying model gives us access to a continuum of algorithms along the exploration–exploitation trade‐off. We then present two experiments to measure the trade‐off behavior under two very different levels of human variability. The experimental results inform a thorough simulation study in which we modeled and varied human variability systematically over a wide rage. The main result is that exploration–exploitation trade‐off grows in severity as human variability increases, but there exists a regime of low variability where algorithms balanced in exploration and exploitation can largely overcome the trade‐off.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Department of Mathematics and Computer Science, Rutgers University.
- Center for Perceptual Systems, University of Texas at Austin.
- Department of Computer Engineering and Computer Science, University of Louisville.
- School of Mathematics, Institute for Advanced Study.
Cite
APA
Yang, S. C., Rank, C., Whritner, J. A., Nasraoui, O., & Shafto, P. (2023). Human Variability and the Explore–Exploit Trade‐Off in Recommendation. Cognitive Science, 47(4). https://doi.org/10.1111/cogs.13279
Vancouver
Yang SC, Rank C, Whritner JA, Nasraoui O, Shafto P. Human Variability and the Explore–Exploit Trade‐Off in Recommendation. Cognitive Science. 2023;47(4). doi:10.1111/cogs.13279
BibTeX
@article{Yang2023,
author = {Yang, Scott Cheng-Hsin and Rank, Chirag and Whritner, Jake A and Nasraoui, Olfa and Shafto, Patrick},
title = {Human Variability and the Explore–Exploit Trade‐Off in Recommendation},
journal = {Cognitive Science},
year = {2023},
volume = {47},
number = {4},
doi = {10.1111/cogs.13279}
}
EUVIMED