Mechanisms of human dynamic object recognition revealed by sequential deep neural networks
PLOS Computational Biology · 09.06.2023 · 19 (6) · e1011169
DOI: 10.1371/journal.pcbi.1011169 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 09.06.2023. Verfasst von Lynn K A Sörensen und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Amsterdam, Amsterdam, Netherlands. Hauptthemen laut MEDLINE: Pattern Recognition, Visual, Visual Perception. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 77 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nederlandse Organisatie voor Wetenschappelijk Onderzoek.
Abstract (Originalsprache)
Humans can quickly recognize objects in a dynamically changing world. This ability is showcased by the fact that observers succeed at recognizing objects in rapidly changing image sequences, at up to 13 ms/image. To date, the mechanisms that govern dynamic object recognition remain poorly understood. Here, we developed deep learning models for dynamic recognition and compared different computational mechanisms, contrasting feedforward and recurrent, single-image and sequential processing as well as different forms of adaptation. We found that only models that integrate images sequentially via lateral recurrence mirrored human performance (N = 36) and were predictive of trial-by-trial responses across image durations (13-80 ms/image). Importantly, models with sequential lateral-recurrent integration also captured how human performance changes as a function of image presentation durations, with models processing images for a few time steps capturing human object recognition at shorter presentation durations and models processing images for more time steps capturing human object recognition at longer presentation durations. Furthermore, augmenting such a recurrent model with adaptation markedly improved dynamic recognition performance and accelerated its representational dynamics, thereby predicting human trial-by-trial responses using fewer processing resources. Together, these findings provide new insights into the mechanisms rendering object recognition so fast and effective in a dynamic visual world.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Department of Psychology, University of Amsterdam, Amsterdam, Netherlands.
- Amsterdam Brain & Cognition (ABC), University of Amsterdam, Amsterdam, Netherlands.
- Machine Learning Group, Centrum Wiskunde & Informatica, Amsterdam, Netherlands.
- Swammerdam Institute of Life Sciences (SILS), University of Amsterdam, Amsterdam, Netherlands.
- Bernoulli Institute, Rijksuniversiteit Groningen, Groningen, Netherlands.
- Istituto Italiano di Tecnologia, Center for Translational Neurophysiology of Speech and Communication (CTNSC), Ferrara, Italy.
ORCID-Profile: Lynn K A Sörensen, H Steven Scholte
Förderung
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek
Zitieren
APA
Sörensen, L. K. A., Bohté, S. M., de Jong, D., Slagter, H. A., & Scholte, H. S. (2023). Mechanisms of human dynamic object recognition revealed by sequential deep neural networks. PLOS Computational Biology, 19(6), e1011169. https://doi.org/10.1371/journal.pcbi.1011169
Vancouver
Sörensen LKA, Bohté SM, de Jong D, Slagter HA, Scholte HS. Mechanisms of human dynamic object recognition revealed by sequential deep neural networks. PLOS Computational Biology. 2023;19(6):e1011169. doi:10.1371/journal.pcbi.1011169
BibTeX
@article{Srensen2023,
author = {Sörensen, Lynn K A and Bohté, Sander M and de Jong, Dorina and Slagter, Heleen A and Scholte, H Steven},
title = {Mechanisms of human dynamic object recognition revealed by sequential deep neural networks},
journal = {PLOS Computational Biology},
year = {2023},
volume = {19},
number = {6},
pages = {e1011169},
doi = {10.1371/journal.pcbi.1011169}
}
EUVIMED