EUVIMEDEUVIMED entdecken
Crossref

Multi-modality multi-label ocular abnormalities detection with transformer-based semantic dictionary learning

Anneke Annassia Putri Siswadi, Stéphanie Bricq, Fabrice Meriaudeau

Medical & Biological Engineering & Computing · 2024

DOI: 10.1007/s11517-024-03140-w ↗

Kurz gefasst

Fachartikel in der Zeitschrift Medical & Biological Engineering & Computing, 2024. Verfasst von Anneke Annassia Putri Siswadi und 2 weiteren Autor:innen. Beteiligte Einrichtung: Laboratoire Imagerie et Vision Artificielle, ImViA, UR 7535, Université de Bourgogne, Dijon, France. nekkeps@gmail.com. Hauptthemen laut MEDLINE: Semantics. Die Arbeit nennt 25 Literaturangaben.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Blindness is preventable by early detection of ocular abnormalities. Computer-aided diagnosis for ocular abnormalities is built by analyzing retinal imaging modalities, for instance, Color Fundus Photography (CFP). This research aims to propose a multi-label detection of 28 ocular abnormalities consisting of frequent and rare abnormalities from a single CFP by using transformer-based semantic dictionary learning. Rare labels are usually ignored because of a lack of features. We tackle this condition by adding the co-occurrence dependency factor to the model from the linguistic features of the labels. The model learns the relation between spatial features and linguistic features represented as a semantic dictionary. The proposed method treats the semantic dictionary as one of the main important parts of the model. It acts as the query while the spatial features are the key and value. The experiments are conducted on the RFMiD dataset. The results show that the proposed method achieves the top 30% in Evaluation Set on the RFMiD dataset challenge. It also shows that treating the semantic dictionary as one of the strong factors in model detection increases the performance when compared with the method that treats the semantic dictionary as a weak factor.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

SemanticsHumansAlgorithmsMachine LearningImage Interpretation, Computer-AssistedDatabases, FactualDiagnosis, Computer-AssistedEye AbnormalitiesFundus Oculi

Stichwörter der Autor:innen

Multi-labelOcular abnormalitySemantic dictionary learning

Autor:innen und Institutionen

  • Laboratoire Imagerie et Vision Artificielle, ImViA, UR 7535, Université de Bourgogne, Dijon, France. nekkeps@gmail.com.
  • Department of Information Technology, Gunadarma University, Depok, Indonesia. nekkeps@gmail.com.
  • Laboratoire Imagerie et Vision Artificielle, ImViA, UR 7535, Université de Bourgogne, Dijon, France.
  • Institut de Chimie Moléculaire de l'Université de Bourgogne, ICMUB UMR CNRS 6302, Université de Bourgogne, Dijon, France.

Zitieren

APA

Siswadi, A. A. P., Bricq, S., & Meriaudeau, F. (2024). Multi-modality multi-label ocular abnormalities detection with transformer-based semantic dictionary learning. Medical & Biological Engineering & Computing. https://doi.org/10.1007/s11517-024-03140-w

Vancouver

Siswadi AAP, Bricq S, Meriaudeau F. Multi-modality multi-label ocular abnormalities detection with transformer-based semantic dictionary learning. Medical & Biological Engineering & Computing. 2024. doi:10.1007/s11517-024-03140-w

BibTeX
@article{Siswadi2024,
  author = {Siswadi, Anneke Annassia Putri and Bricq, Stéphanie and Meriaudeau, Fabrice},
  title = {Multi-modality multi-label ocular abnormalities detection with transformer-based semantic dictionary learning},
  journal = {Medical & Biological Engineering & Computing},
  year = {2024},
  doi = {10.1007/s11517-024-03140-w}
}
Kostenlos starten →