Multi-modality multi-label ocular abnormalities detection with transformer-based semantic dictionary learning
Medical & Biological Engineering & Computing · 2024
DOI: 10.1007/s11517-024-03140-w ↗Kurz gefasst
Fachartikel in der Zeitschrift Medical & Biological Engineering & Computing, 2024. Verfasst von Anneke Annassia Putri Siswadi und 2 weiteren Autor:innen. Beteiligte Einrichtung: Laboratoire Imagerie et Vision Artificielle, ImViA, UR 7535, Université de Bourgogne, Dijon, France. nekkeps@gmail.com. Hauptthemen laut MEDLINE: Semantics. Die Arbeit nennt 25 Literaturangaben.
Abstract (Originalsprache)
Blindness is preventable by early detection of ocular abnormalities. Computer-aided diagnosis for ocular abnormalities is built by analyzing retinal imaging modalities, for instance, Color Fundus Photography (CFP). This research aims to propose a multi-label detection of 28 ocular abnormalities consisting of frequent and rare abnormalities from a single CFP by using transformer-based semantic dictionary learning. Rare labels are usually ignored because of a lack of features. We tackle this condition by adding the co-occurrence dependency factor to the model from the linguistic features of the labels. The model learns the relation between spatial features and linguistic features represented as a semantic dictionary. The proposed method treats the semantic dictionary as one of the main important parts of the model. It acts as the query while the spatial features are the key and value. The experiments are conducted on the RFMiD dataset. The results show that the proposed method achieves the top 30% in Evaluation Set on the RFMiD dataset challenge. It also shows that treating the semantic dictionary as one of the strong factors in model detection increases the performance when compared with the method that treats the semantic dictionary as a weak factor.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Laboratoire Imagerie et Vision Artificielle, ImViA, UR 7535, Université de Bourgogne, Dijon, France. nekkeps@gmail.com.
- Department of Information Technology, Gunadarma University, Depok, Indonesia. nekkeps@gmail.com.
- Laboratoire Imagerie et Vision Artificielle, ImViA, UR 7535, Université de Bourgogne, Dijon, France.
- Institut de Chimie Moléculaire de l'Université de Bourgogne, ICMUB UMR CNRS 6302, Université de Bourgogne, Dijon, France.
Zitieren
APA
Siswadi, A. A. P., Bricq, S., & Meriaudeau, F. (2024). Multi-modality multi-label ocular abnormalities detection with transformer-based semantic dictionary learning. Medical & Biological Engineering & Computing. https://doi.org/10.1007/s11517-024-03140-w
Vancouver
Siswadi AAP, Bricq S, Meriaudeau F. Multi-modality multi-label ocular abnormalities detection with transformer-based semantic dictionary learning. Medical & Biological Engineering & Computing. 2024. doi:10.1007/s11517-024-03140-w
BibTeX
@article{Siswadi2024,
author = {Siswadi, Anneke Annassia Putri and Bricq, Stéphanie and Meriaudeau, Fabrice},
title = {Multi-modality multi-label ocular abnormalities detection with transformer-based semantic dictionary learning},
journal = {Medical & Biological Engineering & Computing},
year = {2024},
doi = {10.1007/s11517-024-03140-w}
}
EUVIMED