EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cleft Lip and Palate Classification Through Vision Transformers and Siamese Neural Networks

Oraphan Nantha, Benjaporn Sathanarugsawait, Prasong Praneetpolgrang

Journal of Imaging · 25.10.2024 · 10 (11) · 271

DOI: 10.3390/jimaging10110271 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 25.10.2024. Verfasst von Oraphan Nantha und 2 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Technology, Sripatum University, Bangkok 10900, Thailand. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study introduces a novel approach for the diagnosis of Cleft Lip and/or Palate (CL/P) by integrating Vision Transformers (ViTs) and Siamese Neural Networks. Our study is the first to employ this integration specifically for CL/P classification, leveraging the strengths of both models to handle complex, multimodal data and few-shot learning scenarios. Unlike previous studies that rely on single-modality data or traditional machine learning models, we uniquely fuse anatomical data from ultrasound images with functional data from speech spectrograms. This multimodal approach captures both structural and acoustic features critical for accurate CL/P classification. Employing Siamese Neural Networks enables effective learning from a small number of labeled examples, enhancing the model’s generalization capabilities in medical imaging contexts where data scarcity is a significant challenge. The models were tested on the UltraSuite CLEFT dataset, which includes ultrasound video sequences and synchronized speech data, across three cleft types: Bilateral, Unilateral, and Palate-only clefts. The two-stage model demonstrated superior performance in classification accuracy (82.76%), F1-score (80.00–86.00%), precision, and recall, particularly distinguishing Bilateral and Unilateral Cleft Lip and Palate with high efficacy. This research underscores the significant potential of advanced AI techniques in medical diagnostics, offering valuable insights into their application for improving clinical outcomes in patients with CL/P.

Schlagwörter

Stichwörter der Autor:innen

cleft lip and palatefew-shot learningmedical assessmentsiamese neural networksvision transformers

Autor:innen und Institutionen

  • School of Information Technology, Sripatum University, Bangkok 10900, Thailand.

Zitieren

APA

Nantha, O., Sathanarugsawait, B., & Praneetpolgrang, P. (2024). Cleft Lip and Palate Classification Through Vision Transformers and Siamese Neural Networks. Journal of Imaging, 10(11), 271. https://doi.org/10.3390/jimaging10110271

Vancouver

Nantha O, Sathanarugsawait B, Praneetpolgrang P. Cleft Lip and Palate Classification Through Vision Transformers and Siamese Neural Networks. Journal of Imaging. 2024;10(11):271. doi:10.3390/jimaging10110271

BibTeX
@article{Nantha2024,
  author = {Nantha, Oraphan and Sathanarugsawait, Benjaporn and Praneetpolgrang, Prasong},
  title = {Cleft Lip and Palate Classification Through Vision Transformers and Siamese Neural Networks},
  journal = {Journal of Imaging},
  year = {2024},
  volume = {10},
  number = {11},
  pages = {271},
  doi = {10.3390/jimaging10110271}
}
Kostenlos starten →