Grounded language acquisition through the eyes and ears of a single child
Science · 02.02.2024 · 383 (6682) · 504-511
DOI: 10.1126/science.adi1374 ↗Kurz gefasst
Fachartikel in der Zeitschrift Science, erschienen am 02.02.2024. Verfasst von Wai Keen Vong und 3 weiteren Autor:innen. Beteiligte Einrichtung: Center for Data Science, New York University, New York, NY, USA. Hauptthemen laut MEDLINE: Language Development, Linguistics, Supervised Machine Learning, Eye. Die Arbeit wurde bisher 111-mal zitiert (Crossref) und nennt 75 Literaturangaben.
Abstract (Originalsprache)
Starting around 6 to 9 months of age, children begin acquiring their first words, linking spoken words to their visual counterparts. How much of this knowledge is learnable from sensory input with relatively generic learning mechanisms, and how much requires stronger inductive biases? Using longitudinal head-mounted camera recordings from one child aged 6 to 25 months, we trained a relatively generic neural network on 61 hours of correlated visual-linguistic data streams, learning feature-based representations and cross-modal associations. Our model acquires many word-referent mappings present in the child’s everyday experience, enables zero-shot generalization to new visual referents, and aligns its visual and linguistic conceptual systems. These results show how critical aspects of grounded word meaning are learnable through joint representation and associative learning from one child’s input.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Center for Data Science, New York University, New York, NY, USA.
- Department of Psychology, New York University, New York, NY, USA.
ORCID-Profile: Wai Keen Vong, Wentao Wang, Brenden M Lake
Zitieren
APA
Vong, W. K., Wang, W., Orhan, A. E., & Lake, B. M. (2024). Grounded language acquisition through the eyes and ears of a single child. Science, 383(6682), 504-511. https://doi.org/10.1126/science.adi1374
Vancouver
Vong WK, Wang W, Orhan AE, Lake BM. Grounded language acquisition through the eyes and ears of a single child. Science. 2024;383(6682):504-511. doi:10.1126/science.adi1374
BibTeX
@article{Vong2024,
author = {Vong, Wai Keen and Wang, Wentao and Orhan, A Emin and Lake, Brenden M},
title = {Grounded language acquisition through the eyes and ears of a single child},
journal = {Science},
year = {2024},
volume = {383},
number = {6682},
pages = {504--511},
doi = {10.1126/science.adi1374}
}
EUVIMED