EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Compositional Complexity in Text and Images

Helena Balabin iD, Antonietta Gabriella Liuzzi iD, Kevin Statz iD, Marie-Francine Moens iD, Patrick Dupont iD, Rik Vandenberghe iD

Neurobiology of Language · 09.07.2026 · 7

DOI: 10.1162/nol.a.271 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Neurobiology of Language, online erschienen am 09.07.2026. Verfasst von Helena Balabin und 5 weiteren Autor:innen. Beteiligte Einrichtung: Laboratory for Cognitive Neurology, Department of Neurosciences, Leuven Brain Institute, KU Leuven, Leuven, Belgium. Die Arbeit nennt 78 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fonds Wetenschappelijk Onderzoek, KU Leuven.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Compositionality enables us to derive the meaning of a complex whole from the syntax and semantics of its individual parts. While compositional processing has primarily been studied in language, similar principles apply to visual scenes, in which meaning can be derived from their individual parts and the relationships between them. In this study, we therefore aimed to explore whether there is a shared neural basis for compositional processing in text and images. Based on abstract meaning representation graphs for text, commonly used to capture “who is doing what to whom”, and action graph annotations for visual scenes, we defined an analogous graph depth-based notion of compositional complexity. By conducting a functional magnetic resonance imaging experiment in which participants view text-image pairs from the Common Objects in Context-Actions data set, we aimed to identify brain activity patterns related to compositional processing through a combination of univariate and multivariate pattern analysis. Specifically, we hypothesized that there are shared brain regions—such as the pars opercularis, pars triangularis or anterior temporal lobe—involved in processing compositional complexity across text and images. Alternatively, there might exist distinct regions for processing compositional complexity in text and images, without any substantial cross-modal overlap. Our results provided no evidence in support of either hypothesis: no significant neural responses to compositional complexity were observed, in either a shared or modality-specific manner. Given the rigorous control of confounds in our study design, the operationalization of compositional complexity itself may underlie the null result.

Schlagwörter

Stichwörter der Autor:innen

compositionalityfunctional magnetic resonance imagingmultivariate pattern analysis

Autor:innen und Institutionen

  • Laboratory for Cognitive Neurology, Department of Neurosciences, Leuven Brain Institute, KU Leuven, Leuven, Belgium.
  • Language Intelligence and Information Retrieval Lab, Department of Computer Science, KU Leuven, Leuven, Belgium.

ORCID-Profile: Helena Balabin, Antonietta Gabriella Liuzzi, Kevin Statz, Marie-Francine Moens, Patrick Dupont, Rik Vandenberghe

Förderung

  • Fonds Wetenschappelijk Onderzoek
  • KU Leuven

Zitieren

APA

Balabin, H., Liuzzi, A. G., Statz, K., Moens, M. F., Dupont, P., & Vandenberghe, R. (2026). Compositional Complexity in Text and Images. Neurobiology of Language, 7. https://doi.org/10.1162/nol.a.271

Vancouver

Balabin H, Liuzzi AG, Statz K, Moens MF, Dupont P, Vandenberghe R. Compositional Complexity in Text and Images. Neurobiology of Language. 2026;7. doi:10.1162/nol.a.271

BibTeX
@article{Balabin2026,
  author = {Balabin, Helena and Liuzzi, Antonietta Gabriella and Statz, Kevin and Moens, Marie-Francine and Dupont, Patrick and Vandenberghe, Rik},
  title = {Compositional Complexity in Text and Images},
  journal = {Neurobiology of Language},
  year = {2026},
  volume = {7},
  doi = {10.1162/nol.a.271}
}
Kostenlos starten →