Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories
Cognitive Science · 2026-11 · 50 (11)
DOI: 10.1111/cogs.70276 ↗Kurz gefasst
Fachartikel in der Zeitschrift Cognitive Science, online erschienen am 30.10.2026. Verfasst von Ayşe Candan Şimşek und 4 weiteren Autor:innen. Beteiligte Einrichtung: Foundation for Media in Education, Leibniz-Institut für Wissensmedien, Germany. Hauptthemen laut MEDLINE: Comprehension, Narration. Die Arbeit nennt 80 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Despite the prevalence of multi‐codal narratives—such as comics consisting of pictures and text—in everyday life, little is understood about how individuals integrate information across different codalities to form cohesive mental representations. In the present study, we explored when processing costs emerged during cross‐codal integration of bridging event information in multi‐codal narratives. Participants were presented with uni‐codal (i.e., consisting only of pictures or of text) and multi‐codal stories in which the bridging event information was presented in the other codality. We measured viewing times for the bridging event and end‐state panels to reflect the cognitive costs associated with integration. The results showed a significant interaction between codality switch and panel position. While the presence of a codality switch increased viewing times for both panel positions, there was a much larger increase for the bridging event panel than the end‐state panel. This result supports a hypothesis suggesting that during narrative understanding, information of a different codality is integrated into the mental representation of the narrative upon encountering it. Our results underscore the influence of codality on narrative integration, indicating that understanding may be affected by the format in which information is presented. Future models of event cognition should incorporate codality as a factor in narrative comprehension.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Foundation for Media in Education, Leibniz-Institut für Wissensmedien, Germany.
- Department of Psychology, Eberhard Karls Universität, Tübingen, Germany.
ORCID-Profile: Ayşe Candan Şimşek, Frank Papenmeier, Irina R Brich, Markus Huff
Zitieren
APA
Candan Şimşek, A., Papenmeier, F., Henner, J., Brich, I. R., & Huff, M. (2026). Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories. Cognitive Science, 50(11). https://doi.org/10.1111/cogs.70276
Vancouver
Candan Şimşek A, Papenmeier F, Henner J, Brich IR, Huff M. Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories. Cognitive Science. 2026;50(11). doi:10.1111/cogs.70276
BibTeX
@article{Candanimek2026,
author = {Candan Şimşek, Ayşe and Papenmeier, Frank and Henner, Julia and Brich, Irina R and Huff, Markus},
title = {Timing Matters: Cross‐Codal Integration of Bridging Event Information Happens While Viewing Picture Stories},
journal = {Cognitive Science},
year = {2026},
volume = {50},
number = {11},
doi = {10.1111/cogs.70276}
}
EUVIMED