EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

The Cross‐Linguistic Coordination of Overt Attention and Speech Production as Evidence for a Language of Vision

Moreno I Coco, Eunice G Fernandes, Manabu Arai, Frank Keller

Cognitive Science · 2026-02 · 50 (2)

DOI: 10.1111/cogs.70185 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Cognitive Science, online erschienen am 23.02.2026. Verfasst von Moreno I Coco und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Psychology, Sapienza University of Rome. Hauptthemen laut MEDLINE: Language, Speech, Attention. Die Arbeit nennt 135 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union, Synchronous Linguistic and Visual Processing, European Commission.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

A central question in cognition is how representations are integrated across different modalities, such as language and vision. One prominent hypothesis posits the existence of an abstract, prelinguistic “language of vision” as a representational system that organizes meaning compositionally, enabling cross‐modal integration. This hypothesis predicts that the language of vision operates universally, independent of linguistic surface features such as word order. We conducted eye‐tracking experiments where participants described visual scenes in English, Portuguese, and Japanese. By analyzing spoken descriptions alongside eye‐movement sequences divided into planning and articulation phases, we demonstrate that semantic similarity between sentences strongly predicts the similarity of associated scan patterns in all three languages, even across scenes and between sentences in different languages. In contrast, the effect of syntactic constraints was secondary and transient: it was restricted to within‐language and within‐scene comparisons, and temporally confined to the early planning phase of the utterance. Our findings support an interactive account of cross‐modal coordination in which a universal language of vision provides stable semantic scaffolding, while syntax serves as a local constraint, primarily active during message linearization.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

LanguageSpeechAttentionHumansEye MovementsSemanticsEye-Tracking TechnologyFemaleMaleAdultYoung Adult

Stichwörter der Autor:innen

Cross‐linguistic differencesCross‐modal coordinationEye‐trackingLanguage of visionScene descriptionScene grammarSemantic and syntactic similarity

Autor:innen und Institutionen

  • Department of Psychology, Sapienza University of Rome.
  • I.R.C.S.S Fondazione Santa Lucia.
  • School of Psychology, University of Minho.
  • Faculty of Economics, Seijo University.
  • School of Informatics, University of Edinburgh.

Förderung

  • European Union
  • Synchronous Linguistic and Visual Processing
  • European Commission

Zitieren

APA

Coco, M. I., Fernandes, E. G., Arai, M., & Keller, F. (2026). The Cross‐Linguistic Coordination of Overt Attention and Speech Production as Evidence for a Language of Vision. Cognitive Science, 50(2). https://doi.org/10.1111/cogs.70185

Vancouver

Coco MI, Fernandes EG, Arai M, Keller F. The Cross‐Linguistic Coordination of Overt Attention and Speech Production as Evidence for a Language of Vision. Cognitive Science. 2026;50(2). doi:10.1111/cogs.70185

BibTeX
@article{Coco2026,
  author = {Coco, Moreno I and Fernandes, Eunice G and Arai, Manabu and Keller, Frank},
  title = {The Cross‐Linguistic Coordination of Overt Attention and Speech Production as Evidence for a Language of Vision},
  journal = {Cognitive Science},
  year = {2026},
  volume = {50},
  number = {2},
  doi = {10.1111/cogs.70185}
}
Kostenlos starten →