EUVIMEDSkopri EUVIMED
Open access · CC BY 4.0

Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories

Ayşe Candan Şimşek iD, Frank Papenmeier iD, Julia Henner, Irina R Brich iD, Markus Huff iD

Cognitive Science · 2026-11 · 50 (11)

DOI: 10.1111/cogs.70276 ↗

At a glance

Journal article in Cognitive Science, published online on 2026-10-30. Written by Ayşe Candan Şimşek and 4 co-authors. Institution: Foundation for Media in Education, Leibniz-Institut für Wissensmedien, Germany. Major MEDLINE topics: Comprehension, Narration. 80 references. The full text is freely available (open access, CC BY 4.0).

AstrattSubjectsDettalji biblijografiċiCiteRelated studies

Abstract (original language)

Despite the prevalence of multi‐codal narratives—such as comics consisting of pictures and text—in everyday life, little is understood about how individuals integrate information across different codalities to form cohesive mental representations. In the present study, we explored when processing costs emerged during cross‐codal integration of bridging event information in multi‐codal narratives. Participants were presented with uni‐codal (i.e., consisting only of pictures or of text) and multi‐codal stories in which the bridging event information was presented in the other codality. We measured viewing times for the bridging event and end‐state panels to reflect the cognitive costs associated with integration. The results showed a significant interaction between codality switch and panel position. While the presence of a codality switch increased viewing times for both panel positions, there was a much larger increase for the bridging event panel than the end‐state panel. This result supports a hypothesis suggesting that during narrative understanding, information of a different codality is integrated into the mental representation of the narrative upon encountering it. Our results underscore the influence of codality on narrative integration, indicating that understanding may be affected by the format in which information is presented. Future models of event cognition should incorporate codality as a factor in narrative comprehension.

Subjects

MeSH terms (MEDLINE)

ComprehensionNarrationHumansFemaleMaleYoung AdultAdultTime Factors

Author keywords

Bridging inferencesCross‐codal integrationNarrative comprehensionPicture stories

Authors and institutions

  • Foundation for Media in Education, Leibniz-Institut für Wissensmedien, Germany.
  • Department of Psychology, Eberhard Karls Universität, Tübingen, Germany.

ORCID profiles: Ayşe Candan Şimşek, Frank Papenmeier, Irina R Brich, Markus Huff

Cite

APA

Candan Şimşek, A., Papenmeier, F., Henner, J., Brich, I. R., & Huff, M. (2026). Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories. Cognitive Science, 50(11). https://doi.org/10.1111/cogs.70276

Vancouver

Candan Şimşek A, Papenmeier F, Henner J, Brich IR, Huff M. Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories. Cognitive Science. 2026;50(11). doi:10.1111/cogs.70276

BibTeX
@article{Candanimek2026,
  author = {Candan Şimşek, Ayşe and Papenmeier, Frank and Henner, Julia and Brich, Irina R and Huff, Markus},
  title = {Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories},
  journal = {Cognitive Science},
  year = {2026},
  volume = {50},
  number = {11},
  doi = {10.1111/cogs.70276}
}
Start for free →