Research on the application of LLaVA model based on QLoRA fine-tuning in medical teaching
PLOS One · 14.07.2026 · 21 (7) · e0328408
DOI: 10.1371/journal.pone.0328408 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, online erschienen am 14.07.2026. Verfasst von Shiling Zhou und 1 weiteren Autor:innen. Beteiligte Einrichtung: School of Big Data and Information Industry, Chongqing Vocational College of Light Industry, Chongqing, China. Hauptthemen laut MEDLINE: Education, Medical, Augmented Reality. Die Arbeit nennt 54 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: the General Project of the 2024 Special Education Reform Research of the Chongqing Education Science Planning Project.
Abstract (Originalsprache)
The augmented reality large language model medical teaching system (ARLMT) integrates augmented reality (AR)with a medical multimodal large language model (LLaVA) based on specifically designed for biomedical applications(LLaVA-Med), employing Quantized Low-Rank Adaptation (QLoRA) to advance medical education. Deployed on resource-constrained AR devices, such as INMO Air2 AR glasses, ARLMT overlays real-time visual annotations and textual feedback on medical scenarios to create an immersive and interactive learning environment. Key advancements include a 66% reduction in memory footprint (from 15.2 GB to 5.1 GB) through QLoRA, enabling efficient operation without compromising performance, and an average response time of 1.009 seconds across various medical imaging categories, surpassing the GPT-4 baseline in both speed and accuracy. The system achieves 98.3% diagnostic accuracy, demonstrating its reliability in real-time applications. By combining visual and textual elements, ARLMT enhances comprehension of complex medical concepts, providing a scalable, real-time solution that bridges technological innovation and pedagogical needs in medical training.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- School of Big Data and Information Industry, Chongqing Vocational College of Light Industry, Chongqing, China.
- School of Big Data and Information Industry, Chongqing City Management College, Chongqing, China.
ORCID-Profile: Shiling Zhou
Förderung
- the General Project of the 2024 Special Education Reform Research of the Chongqing Education Science Planning Project
Zitieren
APA
Zhou, S., & Qin, F. (2026). Research on the application of LLaVA model based on QLoRA fine-tuning in medical teaching. PLOS One, 21(7), e0328408. https://doi.org/10.1371/journal.pone.0328408
Vancouver
Zhou S, Qin F. Research on the application of LLaVA model based on QLoRA fine-tuning in medical teaching. PLOS One. 2026;21(7):e0328408. doi:10.1371/journal.pone.0328408
BibTeX
@article{Zhou2026,
author = {Zhou, Shiling and Qin, Fengmei},
title = {Research on the application of LLaVA model based on QLoRA fine-tuning in medical teaching},
journal = {PLOS One},
year = {2026},
volume = {21},
number = {7},
pages = {e0328408},
doi = {10.1371/journal.pone.0328408}
}
EUVIMED