Modeling human activity comprehension at human scale: Prediction, segmentation, and categorization
PNAS Nexus · 01.10.2024 · 3 (10)
DOI: 10.1093/pnasnexus/pgae459 ↗Kurz gefasst
Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 11.10.2024. Verfasst von Tan T Nguyen und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130, USA. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Office of Naval Research.
Abstract (Originalsprache)
Humans form sequences of event models—representations of the current situation—to predict how activity will unfold. Multiple mechanisms have been proposed for how the cognitive system determines when to segment the stream of behavior and switch from one active event model to another. Here, we constructed a computational model that learns knowledge about event classes (event schemas), by combining recurrent neural networks for short-term dynamics with Bayesian inference over event classes for event-to-event transitions. This architecture represents event schemas and uses them to construct a series of event models. This architecture was trained on one pass through 18 h of naturalistic human activities. Another 3.5 h of activities were used to test each variant for agreement with human segmentation and categorization. The architecture was able to learn to predict human activity, and it developed segmentation and categorization approaching human-like performance. We then compared two variants of this architecture designed to better emulate human event segmentation: one transitioned when the active event model produced high uncertainty in its prediction and the other transitioned when the active event model produced a large prediction error. The two variants learned to segment and categorize events, and the prediction uncertainty variant provided a somewhat closer match to human segmentation and categorization—despite being given no feedback about segmentation or categorization. These results suggest that event model transitioning based on prediction uncertainty or prediction error can reproduce two important features of human event comprehension.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130, USA.
- Department of Psychology and Center for Brain Science, Harvard University, Cambridge, MA 02138, USA.
- Computer Science and Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA.
ORCID-Profile: Tan T Nguyen, Samuel J Gershman, Todd S Braver, Jeffrey M Zacks
Förderung
- Office of Naval Research
Zitieren
APA
Nguyen, T. T., Bezdek, M. A., Gershman, S. J., Bobick, A. F., Braver, T. S., & Zacks, J. M. (2024). Modeling human activity comprehension at human scale: Prediction, segmentation, and categorization. PNAS Nexus, 3(10). https://doi.org/10.1093/pnasnexus/pgae459
Vancouver
Nguyen TT, Bezdek MA, Gershman SJ, Bobick AF, Braver TS, Zacks JM. Modeling human activity comprehension at human scale: Prediction, segmentation, and categorization. PNAS Nexus. 2024;3(10). doi:10.1093/pnasnexus/pgae459
BibTeX
@article{Nguyen2024,
author = {Nguyen, Tan T and Bezdek, Matthew A and Gershman, Samuel J and Bobick, Aaron F and Braver, Todd S and Zacks, Jeffrey M},
title = {Modeling human activity comprehension at human scale: Prediction, segmentation, and categorization},
journal = {PNAS Nexus},
year = {2024},
volume = {3},
number = {10},
doi = {10.1093/pnasnexus/pgae459}
}
EUVIMED