Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories
Cognitive Science · 2026-11 · 50 (11)
DOI: 10.1111/cogs.70276 ↗At a glance
Journal article in Cognitive Science, published online on 2026-10-30. Written by Ayşe Candan Şimşek and 4 co-authors. Institution: Foundation for Media in Education, Leibniz-Institut für Wissensmedien, Germany. Major MEDLINE topics: Comprehension, Narration. 80 references. The full text is freely available (open access, CC BY 4.0).
Abstract (original language)
Despite the prevalence of multi‐codal narratives—such as comics consisting of pictures and text—in everyday life, little is understood about how individuals integrate information across different codalities to form cohesive mental representations. In the present study, we explored when processing costs emerged during cross‐codal integration of bridging event information in multi‐codal narratives. Participants were presented with uni‐codal (i.e., consisting only of pictures or of text) and multi‐codal stories in which the bridging event information was presented in the other codality. We measured viewing times for the bridging event and end‐state panels to reflect the cognitive costs associated with integration. The results showed a significant interaction between codality switch and panel position. While the presence of a codality switch increased viewing times for both panel positions, there was a much larger increase for the bridging event panel than the end‐state panel. This result supports a hypothesis suggesting that during narrative understanding, information of a different codality is integrated into the mental representation of the narrative upon encountering it. Our results underscore the influence of codality on narrative integration, indicating that understanding may be affected by the format in which information is presented. Future models of event cognition should incorporate codality as a factor in narrative comprehension.
Subjects
MeSH terms (MEDLINE)
Author keywords
Authors and institutions
- Foundation for Media in Education, Leibniz-Institut für Wissensmedien, Germany.
- Department of Psychology, Eberhard Karls Universität, Tübingen, Germany.
ORCID profiles: Ayşe Candan Şimşek, Frank Papenmeier, Irina R Brich, Markus Huff
Cite
APA
Candan Şimşek, A., Papenmeier, F., Henner, J., Brich, I. R., & Huff, M. (2026). Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories. Cognitive Science, 50(11). https://doi.org/10.1111/cogs.70276
Vancouver
Candan Şimşek A, Papenmeier F, Henner J, Brich IR, Huff M. Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories. Cognitive Science. 2026;50(11). doi:10.1111/cogs.70276
BibTeX
@article{Candanimek2026,
author = {Candan Şimşek, Ayşe and Papenmeier, Frank and Henner, Julia and Brich, Irina R and Huff, Markus},
title = {Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories},
journal = {Cognitive Science},
year = {2026},
volume = {50},
number = {11},
doi = {10.1111/cogs.70276}
}
EUVIMED