Evaluation of the Construction and Accuracy of a Local LLM Based on Clinical Engineering
Studies in Health Technology and Informatics · 21.05.2026
DOI: 10.3233/shti260355 ↗Kurz gefasst
Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Kai Ishida. Beteiligte Einrichtung: Faculty of Engineering, Shonan Institute of Technology. Hauptthemen laut MEDLINE: Biomedical Engineering. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
This study aimed to develop a local large language model (LLM) specialized in clinical engineering and to evaluate its performance on the Japanese National Clinical Engineer Licensing Examination. Three local LLMs (Cogito-32b-think, GPT-4o-mini, and Qwen3-14B) and Gemini-2.5 Pro were tested. Among the local models, Qwen3-14B achieved the highest accuracy and was further improved through supervised fine-tuning (SFT) using reasoning data generated by Gemini-2.5 Pro. After SFT, the overall accuracy of Qwen3-14B increased from 77% to 82%, with improvements in image (39% to 52%) and calculation (58% to 68%) questions. Although Gemini-2.5 Pro outperformed Qwen3-14B with 94% accuracy, the results demonstrate that SFT effectively enhances local LLMs, offering a promising, secure, and cost-efficient approach for specialized clinical engineering applications.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Faculty of Engineering, Shonan Institute of Technology.
Zitieren
APA
Ishida, K. (2026). Evaluation of the Construction and Accuracy of a Local LLM Based on Clinical Engineering. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260355
Vancouver
Ishida K. Evaluation of the Construction and Accuracy of a Local LLM Based on Clinical Engineering. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260355
BibTeX
@article{Ishida2026,
author = {Ishida, Kai},
title = {Evaluation of the Construction and Accuracy of a Local LLM Based on Clinical Engineering},
journal = {Studies in Health Technology and Informatics},
year = {2026},
doi = {10.3233/shti260355}
}
EUVIMED