EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Evaluation of the Construction and Accuracy of a Local LLM Based on Clinical Engineering

Kai Ishida

Studies in Health Technology and Informatics · 21.05.2026

DOI: 10.3233/shti260355 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Studies in Health Technology and Informatics, erschienen am 21.05.2026. Verfasst von Kai Ishida. Beteiligte Einrichtung: Faculty of Engineering, Shonan Institute of Technology. Hauptthemen laut MEDLINE: Biomedical Engineering. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study aimed to develop a local large language model (LLM) specialized in clinical engineering and to evaluate its performance on the Japanese National Clinical Engineer Licensing Examination. Three local LLMs (Cogito-32b-think, GPT-4o-mini, and Qwen3-14B) and Gemini-2.5 Pro were tested. Among the local models, Qwen3-14B achieved the highest accuracy and was further improved through supervised fine-tuning (SFT) using reasoning data generated by Gemini-2.5 Pro. After SFT, the overall accuracy of Qwen3-14B increased from 77% to 82%, with improvements in image (39% to 52%) and calculation (58% to 68%) questions. Although Gemini-2.5 Pro outperformed Qwen3-14B with 94% accuracy, the results demonstrate that SFT effectively enhances local LLMs, offering a promising, secure, and cost-efficient approach for specialized clinical engineering applications.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Biomedical EngineeringHumansJapanLarge Language Models

Stichwörter der Autor:innen

Clinical EngineerLicensing ExaminationLocal Large Language Model

Autor:innen und Institutionen

  • Faculty of Engineering, Shonan Institute of Technology.

Zitieren

APA

Ishida, K. (2026). Evaluation of the Construction and Accuracy of a Local LLM Based on Clinical Engineering. Studies in Health Technology and Informatics. https://doi.org/10.3233/shti260355

Vancouver

Ishida K. Evaluation of the Construction and Accuracy of a Local LLM Based on Clinical Engineering. Studies in Health Technology and Informatics. 2026. doi:10.3233/shti260355

BibTeX
@article{Ishida2026,
  author = {Ishida, Kai},
  title = {Evaluation of the Construction and Accuracy of a Local LLM Based on Clinical Engineering},
  journal = {Studies in Health Technology and Informatics},
  year = {2026},
  doi = {10.3233/shti260355}
}
Kostenlos starten →