EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Mechanisms of human dynamic object recognition revealed by sequential deep neural networks

Lynn K A Sörensen iD, Sander M Bohté, Dorina de Jong, Heleen A Slagter, H Steven Scholte iD

PLOS Computational Biology · 09.06.2023 · 19 (6) · e1011169

DOI: 10.1371/journal.pcbi.1011169 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS Computational Biology, online erschienen am 09.06.2023. Verfasst von Lynn K A Sörensen und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, University of Amsterdam, Amsterdam, Netherlands. Hauptthemen laut MEDLINE: Pattern Recognition, Visual, Visual Perception. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 77 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Nederlandse Organisatie voor Wetenschappelijk Onderzoek.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Humans can quickly recognize objects in a dynamically changing world. This ability is showcased by the fact that observers succeed at recognizing objects in rapidly changing image sequences, at up to 13 ms/image. To date, the mechanisms that govern dynamic object recognition remain poorly understood. Here, we developed deep learning models for dynamic recognition and compared different computational mechanisms, contrasting feedforward and recurrent, single-image and sequential processing as well as different forms of adaptation. We found that only models that integrate images sequentially via lateral recurrence mirrored human performance (N = 36) and were predictive of trial-by-trial responses across image durations (13-80 ms/image). Importantly, models with sequential lateral-recurrent integration also captured how human performance changes as a function of image presentation durations, with models processing images for a few time steps capturing human object recognition at shorter presentation durations and models processing images for more time steps capturing human object recognition at longer presentation durations. Furthermore, augmenting such a recurrent model with adaptation markedly improved dynamic recognition performance and accelerated its representational dynamics, thereby predicting human trial-by-trial responses using fewer processing resources. Together, these findings provide new insights into the mechanisms rendering object recognition so fast and effective in a dynamic visual world.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Pattern Recognition, VisualVisual PerceptionHumansNeural Networks, ComputerRecognition, PsychologyAcclimatization

Autor:innen und Institutionen

  • Department of Psychology, University of Amsterdam, Amsterdam, Netherlands.
  • Amsterdam Brain & Cognition (ABC), University of Amsterdam, Amsterdam, Netherlands.
  • Machine Learning Group, Centrum Wiskunde & Informatica, Amsterdam, Netherlands.
  • Swammerdam Institute of Life Sciences (SILS), University of Amsterdam, Amsterdam, Netherlands.
  • Bernoulli Institute, Rijksuniversiteit Groningen, Groningen, Netherlands.
  • Istituto Italiano di Tecnologia, Center for Translational Neurophysiology of Speech and Communication (CTNSC), Ferrara, Italy.

ORCID-Profile: Lynn K A Sörensen, H Steven Scholte

Förderung

  • Nederlandse Organisatie voor Wetenschappelijk Onderzoek

Zitieren

APA

Sörensen, L. K. A., Bohté, S. M., de Jong, D., Slagter, H. A., & Scholte, H. S. (2023). Mechanisms of human dynamic object recognition revealed by sequential deep neural networks. PLOS Computational Biology, 19(6), e1011169. https://doi.org/10.1371/journal.pcbi.1011169

Vancouver

Sörensen LKA, Bohté SM, de Jong D, Slagter HA, Scholte HS. Mechanisms of human dynamic object recognition revealed by sequential deep neural networks. PLOS Computational Biology. 2023;19(6):e1011169. doi:10.1371/journal.pcbi.1011169

BibTeX
@article{Srensen2023,
  author = {Sörensen, Lynn K A and Bohté, Sander M and de Jong, Dorina and Slagter, Heleen A and Scholte, H Steven},
  title = {Mechanisms of human dynamic object recognition revealed by sequential deep neural networks},
  journal = {PLOS Computational Biology},
  year = {2023},
  volume = {19},
  number = {6},
  pages = {e1011169},
  doi = {10.1371/journal.pcbi.1011169}
}
Kostenlos starten →