EUVIMEDEUVIMED entdecken
Crossref

Finding Moments Worth Remembering: Multimodal Evidence and Multi-Stage Reasoning for Illustrating Actual-Play TTRPG Sessions

Gianlucca Lodron Zuin, Túlio Corrêa Loures, Eduardo de Moura, Adriano Alonso Veloso, Marcelo Coelho

Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment · 08.11.2026 · 22 (1) · 138-148

DOI: 10.1609/aiide.v22i1.43572 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, online erschienen am 08.11.2026. Verfasst von Gianlucca Lodron Zuin und 4 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Tabletop role-playing games present a challenging domain for artificial intelligence, particularly for reasoning about emotional shifts and narrative significance in long-form actual-play sessions. Players improvise shared stories over hours of dialogue, performance, rules negotiation, and social reaction, while the significance of memorable moments may depend on context beyond the local passage. We propose a hierarchical multimodal architecture for selecting emotionally and narratively significant moments as candidates for visual representation. The approach extracts speech, speaker, affective, conversational, and table-response evidence, contextualizes these signals through short-, medium-, and long-term narrative memory, and uses a multi-stage LLM-based judge to evaluate local, scene, and memory relevance before visualization. We evaluate moment selection using silver labels derived from viewer signals, and assess generated visual memories through human judgments of image--audio alignment. The system recovers referenced timestamps above a chance baseline at exact-window resolution, indicating mild alignment with viewer-perceived salience. Human evaluation indicates that the pipeline produces grounded images for well-chosen moments and that these images are preferred over those generated directly from transcripts. Together, these results represent a first step toward memory-supported visual externalization in long-form collaborative storytelling.

Zitieren

APA

Zuin, G. L., Loures, T. C., Moura, E. D., Veloso, A. A., & Coelho, M. (2026). Finding Moments Worth Remembering: Multimodal Evidence and Multi-Stage Reasoning for Illustrating Actual-Play TTRPG Sessions. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment, 22(1), 138-148. https://doi.org/10.1609/aiide.v22i1.43572

Vancouver

Zuin GL, Loures TC, Moura ED, Veloso AA, Coelho M. Finding Moments Worth Remembering: Multimodal Evidence and Multi-Stage Reasoning for Illustrating Actual-Play TTRPG Sessions. Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment. 2026;22(1):138-148. doi:10.1609/aiide.v22i1.43572

BibTeX
@article{Zuin2026,
  author = {Zuin, Gianlucca Lodron and Loures, Túlio Corrêa and Moura, Eduardo de and Veloso, Adriano Alonso and Coelho, Marcelo},
  title = {Finding Moments Worth Remembering: Multimodal Evidence and Multi-Stage Reasoning for Illustrating Actual-Play TTRPG Sessions},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence and Interactive Digital Entertainment},
  year = {2026},
  volume = {22},
  number = {1},
  pages = {138--148},
  doi = {10.1609/aiide.v22i1.43572}
}
Kostenlos starten →