EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Visual Heuristics for Verb Production: Testing a Deep‐Learning Model With Experiments in Japanese

Franklin Chang iD, Tomoko Tatsumi iD, Yuna Hiranuma, Colin Bannard iD

Cognitive Science · 2023

DOI: 10.1111/cogs.13324 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cognitive Science, 2023. Verfasst von Franklin Chang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of English Studies, Kobe City University of Foreign Studies. Hauptthemen laut MEDLINE: Language, Deep Learning, Heuristics, Visual Perception. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Tense/aspect morphology on verbs is often thought to depend on event features like telicity, but it is not known how speakers identify these features in visual scenes. To examine this question, we asked Japanese speakers to describe computer‐generated animations of simple actions with variation in visual features related to telicity. Experiments with adults and children found that they could use goal information in the animations to select appropriate past and progressive verb forms. They also produced a large number of different verb forms. To explain these findings, a deep‐learning model of verb production from visual input was created that could produce a human‐like distribution of verb forms. It was able to use visual cues to select appropriate tense/aspect morphology. The model predicted that video duration would be related to verb complexity, and past tense production would increase when it received the endpoint as input. These predictions were confirmed in a third study with Japanese adults. This work suggests that verb production could be tightly linked to visual heuristics that support the understanding of events.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LanguageDeep LearningHeuristicsVisual PerceptionHumansAdultFemaleMaleJapanYoung AdultChildPsycholinguisticsEast Asian People

Stichwörter der Autor:innen

AspectDeep learningDevelopmentJapaneseMorphologyTelicityTense

Autor:innen und Institutionen

  • Department of English Studies, Kobe City University of Foreign Studies.
  • Graduate School of Intercultural Studies, Kobe University.
  • Language Development Department, Max Planck Institute for Psycholinguistics.
  • Department of Linguistics and English Language, University of Manchester.

ORCID-Profile: Franklin Chang, Tomoko Tatsumi, Colin Bannard

Zitieren

APA

Chang, F., Tatsumi, T., Hiranuma, Y., & Bannard, C. (2023). Visual Heuristics for Verb Production: Testing a Deep‐Learning Model With Experiments in Japanese. Cognitive Science. https://doi.org/10.1111/cogs.13324

Vancouver

Chang F, Tatsumi T, Hiranuma Y, Bannard C. Visual Heuristics for Verb Production: Testing a Deep‐Learning Model With Experiments in Japanese. Cognitive Science. 2023. doi:10.1111/cogs.13324

BibTeX
@article{Chang2023,
  author = {Chang, Franklin and Tatsumi, Tomoko and Hiranuma, Yuna and Bannard, Colin},
  title = {Visual Heuristics for Verb Production: Testing a Deep‐Learning Model With Experiments in Japanese},
  journal = {Cognitive Science},
  year = {2023},
  doi = {10.1111/cogs.13324}
}
Kostenlos starten →