EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Modeling human activity comprehension at human scale: Prediction, segmentation, and categorization

Tan T Nguyen iD, Matthew A Bezdek, Samuel J Gershman iD, Aaron F Bobick, Todd S Braver iD, Jeffrey M Zacks iD

PNAS Nexus · 01.10.2024 · 3 (10)

DOI: 10.1093/pnasnexus/pgae459 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PNAS Nexus, online erschienen am 11.10.2024. Verfasst von Tan T Nguyen und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130, USA. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 68 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Office of Naval Research.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Humans form sequences of event models—representations of the current situation—to predict how activity will unfold. Multiple mechanisms have been proposed for how the cognitive system determines when to segment the stream of behavior and switch from one active event model to another. Here, we constructed a computational model that learns knowledge about event classes (event schemas), by combining recurrent neural networks for short-term dynamics with Bayesian inference over event classes for event-to-event transitions. This architecture represents event schemas and uses them to construct a series of event models. This architecture was trained on one pass through 18 h of naturalistic human activities. Another 3.5 h of activities were used to test each variant for agreement with human segmentation and categorization. The architecture was able to learn to predict human activity, and it developed segmentation and categorization approaching human-like performance. We then compared two variants of this architecture designed to better emulate human event segmentation: one transitioned when the active event model produced high uncertainty in its prediction and the other transitioned when the active event model produced a large prediction error. The two variants learned to segment and categorize events, and the prediction uncertainty variant provided a somewhat closer match to human segmentation and categorization—despite being given no feedback about segmentation or categorization. These results suggest that event model transitioning based on prediction uncertainty or prediction error can reproduce two important features of human event comprehension.

Schlagwörter

Stichwörter der Autor:innen

action perceptioncomputational modelingevent cognitionsegmentation

Autor:innen und Institutionen

  • Department of Psychological and Brain Sciences, Washington University in St. Louis, St. Louis, MO 63130, USA.
  • Department of Psychology and Center for Brain Science, Harvard University, Cambridge, MA 02138, USA.
  • Computer Science and Engineering, Washington University in St. Louis, St. Louis, MO 63130, USA.

ORCID-Profile: Tan T Nguyen, Samuel J Gershman, Todd S Braver, Jeffrey M Zacks

Förderung

  • Office of Naval Research

Zitieren

APA

Nguyen, T. T., Bezdek, M. A., Gershman, S. J., Bobick, A. F., Braver, T. S., & Zacks, J. M. (2024). Modeling human activity comprehension at human scale: Prediction, segmentation, and categorization. PNAS Nexus, 3(10). https://doi.org/10.1093/pnasnexus/pgae459

Vancouver

Nguyen TT, Bezdek MA, Gershman SJ, Bobick AF, Braver TS, Zacks JM. Modeling human activity comprehension at human scale: Prediction, segmentation, and categorization. PNAS Nexus. 2024;3(10). doi:10.1093/pnasnexus/pgae459

BibTeX
@article{Nguyen2024,
  author = {Nguyen, Tan T and Bezdek, Matthew A and Gershman, Samuel J and Bobick, Aaron F and Braver, Todd S and Zacks, Jeffrey M},
  title = {Modeling human activity comprehension at human scale: Prediction, segmentation, and categorization},
  journal = {PNAS Nexus},
  year = {2024},
  volume = {3},
  number = {10},
  doi = {10.1093/pnasnexus/pgae459}
}
Kostenlos starten →