Multimodal instruction with AI-generated images for noun retention: Exploring semantic scene and materiality effects
PLOS One · 2026
DOI: 10.1371/journal.pone.0334778 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Gaojie Ye und 1 weiteren Autor:innen. Beteiligte Einrichtung: Public Course Teaching Department, Anhui Vocational College of Defense Technology, Lu'an, China. Hauptthemen laut MEDLINE: Semantics, Artificial Intelligence. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
This study explores the effectiveness of integrating multimodal instruction with artificial intelligence (AI)-generated visual content into English noun vocabulary instruction, as compared to text-only instruction. Rather than treating visual instruction as an end in itself, the approach leverages generative image technology to create contextually relevant stimuli that align with cognitive principles of memory formation. A controlled experiment (text-only vs. text + AI-generated images) was conducted with 40 English learners recruited from China. Participants completed immediate and delayed recall tests, definition selection, image-to-word matching (available only in the multimodal condition), and semantic rating tasks. Results revealed that the multimodal group significantly outperformed the text-only group across all measures, with large effect sizes for memory retention and semantic understanding. However, the study design does not allow us to attribute this advantage to the AI-generated nature of the images, as no condition with traditional images was included. These findings indicate that multimodal presentation can support durable and meaningful vocabulary learning when visual materials are designed to reflect perceptual and contextual features that facilitate memory. The study highlights the pedagogical potential of combining multimodal materials with memory-informed instructional design in language education.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Public Course Teaching Department, Anhui Vocational College of Defense Technology, Lu'an, China.
- Department Of Information Technology, Anhui Vocational College of Defense Technology, Lu'an, China.
- Faculty of Engineering, Science and Technology, Kuala Lumpur University of Science and Technology, Kuala Lumpur, Malaysia.
ORCID-Profile: Shibo Yan
Zitieren
APA
Ye, G., & Yan, S. (2026). Multimodal instruction with AI-generated images for noun retention: Exploring semantic scene and materiality effects. PLOS One. https://doi.org/10.1371/journal.pone.0334778
Vancouver
Ye G, Yan S. Multimodal instruction with AI-generated images for noun retention: Exploring semantic scene and materiality effects. PLOS One. 2026. doi:10.1371/journal.pone.0334778
BibTeX
@article{Ye2026,
author = {Ye, Gaojie and Yan, Shibo},
title = {Multimodal instruction with AI-generated images for noun retention: Exploring semantic scene and materiality effects},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0334778}
}
EUVIMED