Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System
Telemedicine and e-Health · 2024
DOI: 10.1089/tmj.2023.0715 ↗Kurz gefasst
Evaluationsstudie in der Zeitschrift Telemedicine and e-Health, 2024. Verfasst von Chun-Chia Chen und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan, ROC. Hauptthemen laut MEDLINE: Large Language Models, Telemedicine, Pressure Ulcer, Detection Algorithms. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 15 Literaturangaben.
Abstract (Originalsprache)
Background
The scarcity of medical resources and personnel has worsened due to COVID-19. Telemedicine faces challenges in assessing wounds without physical examination. Evaluating pressure injuries is time consuming, energy intensive, and inconsistent. Most of today's telemedicine platforms utilize graphical user interfaces with complex operational procedures and limited channels for information dissemination. The study aims to establish a smart telemedicine diagnosis system based on YOLOv7 and large language model.
Methods
The YOLOv7 model is trained using a clinical data set, with data augmentation techniques employed to enhance the data set to identify six types of pressure injury images. The established system features a front-end interface that includes responsive web design and a chatbot with ChatGPT, and it is integrated with a database for personal information management.
Results
This research provides a practical pressure injury staging classification model with an average F1 score of 0.9238. The system remotely provides real-time accurate diagnoses and prescriptions, guiding patients to seek various medical help levels based on symptom severity.
Conclusions
This study establishes a smart telemedicine auxiliary diagnosis system based on the YOLOv7 model, which possesses capabilities for classification and real-time detection. During teleconsultations, it provides immediate and accurate diagnostic information and prescription recommendations and seeks various medical assistance based on the severity of symptoms. Through the setup of a chatbot with ChatGPT, different users can quickly achieve their respective objectives.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan, ROC.
- Department of Plastic Surgery, Chi Mei Medical Center, Tainan, Taiwan, ROC.
- Department of Industrial Engineering and Engineering Management, National Tsing Hua University, Hsinchu, Taiwan, ROC.
- Department of Medical Informatics, Chung Shan Medical University Hospital, Taichung, Taiwan, ROC.
- IT Office, Chung Shan Medical University Hospital, Taichung, Taiwan, ROC.
- Department of Information Management, Ming Chuan University, Taoyuan, Taiwan, ROC.
ORCID-Profile: Chun-Chia Chen, Ming-Chuan Chiu
Zitieren
APA
Chen, C. C., Wei, C. J., Tseng, T. Y., Chiu, M. C., & Chang, C. C. (2024). Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System. Telemedicine and e-Health. https://doi.org/10.1089/tmj.2023.0715
Vancouver
Chen CC, Wei CJ, Tseng TY, Chiu MC, Chang CC. Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System. Telemedicine and e-Health. 2024. doi:10.1089/tmj.2023.0715
BibTeX
@article{Chen2024,
author = {Chen, Chun-Chia and Wei, Chia-Jung and Tseng, Tsung-Yu and Chiu, Ming-Chuan and Chang, Chi-Chang},
title = {Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System},
journal = {Telemedicine and e-Health},
year = {2024},
doi = {10.1089/tmj.2023.0715}
}
EUVIMED