EUVIMEDEUVIMED entdecken
EvaluationsstudieValidierungsstudie

Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System

Chun-Chia Chen iD, Chia-Jung Wei, Tsung-Yu Tseng, Ming-Chuan Chiu iD, Chi-Chang Chang

Telemedicine and e-Health · 2024

DOI: 10.1089/tmj.2023.0715 ↗

Kurz gefasst

Evaluationsstudie in der Zeitschrift Telemedicine and e-Health, 2024. Verfasst von Chun-Chia Chen und 4 weiteren Autor:innen. Beteiligte Einrichtung: Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan, ROC. Hauptthemen laut MEDLINE: Large Language Models, Telemedicine, Pressure Ulcer, Detection Algorithms. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 15 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background

The scarcity of medical resources and personnel has worsened due to COVID-19. Telemedicine faces challenges in assessing wounds without physical examination. Evaluating pressure injuries is time consuming, energy intensive, and inconsistent. Most of today's telemedicine platforms utilize graphical user interfaces with complex operational procedures and limited channels for information dissemination. The study aims to establish a smart telemedicine diagnosis system based on YOLOv7 and large language model.

Methods

The YOLOv7 model is trained using a clinical data set, with data augmentation techniques employed to enhance the data set to identify six types of pressure injury images. The established system features a front-end interface that includes responsive web design and a chatbot with ChatGPT, and it is integrated with a database for personal information management.

Results

This research provides a practical pressure injury staging classification model with an average F1 score of 0.9238. The system remotely provides real-time accurate diagnoses and prescriptions, guiding patients to seek various medical help levels based on symptom severity.

Conclusions

This study establishes a smart telemedicine auxiliary diagnosis system based on the YOLOv7 model, which possesses capabilities for classification and real-time detection. During teleconsultations, it provides immediate and accurate diagnostic information and prescription recommendations and seeks various medical assistance based on the severity of symptoms. Through the setup of a chatbot with ChatGPT, different users can quickly achieve their respective objectives.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Large Language ModelsTelemedicinePressure UlcerDetection AlgorithmsGenerative Artificial IntelligenceImage Processing, Computer-AssistedDigital HealthSensitivity and SpecificityHumansPhotographyVideo Recording

Stichwörter der Autor:innen

ChatGPTdeep learninglarge language modelobject detectionpressure injuries identificationsmart telemedicine diagnosis systemtelemedicine

Autor:innen und Institutionen

  • Institute of Medicine, Chung Shan Medical University, Taichung, Taiwan, ROC.
  • Department of Plastic Surgery, Chi Mei Medical Center, Tainan, Taiwan, ROC.
  • Department of Industrial Engineering and Engineering Management, National Tsing Hua University, Hsinchu, Taiwan, ROC.
  • Department of Medical Informatics, Chung Shan Medical University Hospital, Taichung, Taiwan, ROC.
  • IT Office, Chung Shan Medical University Hospital, Taichung, Taiwan, ROC.
  • Department of Information Management, Ming Chuan University, Taoyuan, Taiwan, ROC.

ORCID-Profile: Chun-Chia Chen, Ming-Chuan Chiu

Zitieren

APA

Chen, C. C., Wei, C. J., Tseng, T. Y., Chiu, M. C., & Chang, C. C. (2024). Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System. Telemedicine and e-Health. https://doi.org/10.1089/tmj.2023.0715

Vancouver

Chen CC, Wei CJ, Tseng TY, Chiu MC, Chang CC. Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System. Telemedicine and e-Health. 2024. doi:10.1089/tmj.2023.0715

BibTeX
@article{Chen2024,
  author = {Chen, Chun-Chia and Wei, Chia-Jung and Tseng, Tsung-Yu and Chiu, Ming-Chuan and Chang, Chi-Chang},
  title = {Applying Object Detection and Large Language Model to Establish a Smart Telemedicine Diagnosis System with Chatbot: A Case Study of Pressure Injuries Diagnosis System},
  journal = {Telemedicine and e-Health},
  year = {2024},
  doi = {10.1089/tmj.2023.0715}
}
Kostenlos starten →