EUVIMEDEUVIMED entdecken
Open Access

Developing an Artificial Intelligence Chatbot for Snake Image Classification and Accuracy Improvement

Po-Chun Chuang, Ye-In Chang, Tein-Shun Tsai, Chih-Hsiang Hung, Chia-En Li

The American Journal of Tropical Medicine and Hygiene · 2025

DOI: 10.4269/ajtmh.25-0101 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The American Journal of Tropical Medicine and Hygiene, 2025. Verfasst von Po-Chun Chuang und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science and Engineering, National Sun Yat-sen University, Kaohsiung, Taiwan. Hauptthemen laut MEDLINE: Snakes, Artificial Intelligence, Image Processing, Computer-Assisted, Deep Learning. Die Arbeit nennt 42 Literaturangaben. Der Volltext ist frei in PubMed Central verfügbar.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Snakebites pose a significant global health challenge. The timely and accurate identification of snake species is essential for guiding antivenom administration. Our goal was to evaluate the effectiveness of a machine learning model for classifying snake species using images collected from the external environment and a preprocessing method to enhance accuracy. In this study, we developed a deep learning model for snake species identification in Taiwan based on the Swin Transformer v2 architecture, applying transfer learning to 12,000 images sampled from a dataset of 30,573 labeled images collected by the authors from sources such as Flickr, iNaturalist, and local databases before October 2023. An external test set of 2,400 images, collected through the LINE chatbot and Facebook groups between November 2023 and April 2024, was used to evaluate real-world performance. To address challenges in external test set images, we introduced a preprocessing method called test-time object detection and cropping (TT-ODC). Without preprocessing, the model achieved 95.6% accuracy on the validation set but dropped to 83.3% on the external test set. Applying TT-ODC improved external test accuracy to 89.8%, closely matching human annotation performance (90.3%). These findings revealed that integrating a Swin Transformer v2-based model into the LINE chatbot enhances snake species identification and improves real-world accuracy. The TT-ODC method effectively bridges the gap between experimental (validation set) and real-world (external test set) performance, providing a practical tool for clinical snakebite management.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SnakesArtificial IntelligenceImage Processing, Computer-AssistedDeep LearningAnimalsSnake BitesHumansTaiwanGenerative Artificial Intelligence

Autor:innen und Institutionen

  • Department of Computer Science and Engineering, National Sun Yat-sen University, Kaohsiung, Taiwan.
  • Department of Emergency Medicine, Kaohsiung Chang Gung Memorial Hospital, Kaohsiung, Taiwan.
  • Department of Biological Science and Technology, National Pingtung University of Science and Technology, Pingtung, Taiwan.
  • Institute of Wildlife Conservation, National Pingtung University of Science and Technology, Pingtung, Taiwan.
  • Department of Information Management, Cheng Shiu University, Kaohsiung, Taiwan.

Zitieren

APA

Chuang, P. C., Chang, Y. I., Tsai, T. S., Hung, C. H., & Li, C. E. (2025). Developing an Artificial Intelligence Chatbot for Snake Image Classification and Accuracy Improvement. The American Journal of Tropical Medicine and Hygiene. https://doi.org/10.4269/ajtmh.25-0101

Vancouver

Chuang PC, Chang YI, Tsai TS, Hung CH, Li CE. Developing an Artificial Intelligence Chatbot for Snake Image Classification and Accuracy Improvement. The American Journal of Tropical Medicine and Hygiene. 2025. doi:10.4269/ajtmh.25-0101

BibTeX
@article{Chuang2025,
  author = {Chuang, Po-Chun and Chang, Ye-In and Tsai, Tein-Shun and Hung, Chih-Hsiang and Li, Chia-En},
  title = {Developing an Artificial Intelligence Chatbot for Snake Image Classification and Accuracy Improvement},
  journal = {The American Journal of Tropical Medicine and Hygiene},
  year = {2025},
  doi = {10.4269/ajtmh.25-0101}
}
Kostenlos starten →