A Hybrid Multimodal Cancer Diagnostic Framework Integrating Deep Learning of Histopathology and Whispering Gallery Mode Optical Sensors
Diagnostics · 12.03.2026 · 16 (6) · 848
DOI: 10.3390/diagnostics16060848 ↗Kurz gefasst
Fachartikel in der Zeitschrift Diagnostics, online erschienen am 12.03.2026. Verfasst von Shereen Afifi und 8 weiteren Autor:innen. Beteiligte Einrichtung: Computer Science and Engineering Department, Faculty of Media Engineering and Technology (MET), German University in Cairo (GUC), New Cairo 11835, Eg…. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 46 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: DAAD, the German Academic Exchange Service.
Abstract (Originalsprache)
Background/Objectives: Biopsy examination remains the gold standard for cancer diagnosis, relying on histopathological assessment of tissue samples to identify malignant changes. However, manual interpretation of histopathological slides is time-consuming, subjective, and susceptible to inter-observer variability. The digitization of histopathological images enables automated analysis and offers opportunities to support clinicians with more consistent and objective diagnostic tools. This study aims to enhance cancer diagnosis by proposing a hybrid framework that integrates deep-learning-based histopathological image analysis with Whispering Gallery Mode (WGM) optical sensing for complementary tissue characterization.
Methods
The proposed framework combines automated tumor classification from histopathological images with biochemical signal analysis obtained from WGM optical sensors. Deep learning models, including EfficientNet-B0, InceptionV3, and Vision Transformer (ViT), were employed for binary and multi-class tumor classification using the BreakHis dataset. To address class imbalance, a Deep Convolutional Generative Adversarial Network (DCGAN) was utilized to generate synthetic histopathological images alongside conventional data augmentation techniques. In parallel, WGM optical sensors were incorporated to capture subtle tissue-specific signatures, with machine learning algorithms enabling automated feature extraction and classification of the acquired signals.
Results
In multi-class classification, InceptionV3 combined with DCGAN-based augmentation achieved an accuracy of 94.45%, while binary classification reached 96.49%. Fine-tuned Vision Transformer models achieved a higher classification accuracy of 98% on the BreakHis dataset. The integration of WGM optical sensing provided additional biochemical information, offering complementary insights to image-based analysis and supporting more robust diagnostic decision-making.
Conclusions
The proposed hybrid framework demonstrates the potential of combining deep-learning-based histopathological image analysis with WGM optical sensing to improve the accuracy and reliability of cancer classification. By integrating morphological and biochemical information, the framework offers a promising approach for enhanced, objective, and supportive cancer diagnostic systems.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Computer Science and Engineering Department, Faculty of Media Engineering and Technology (MET), German University in Cairo (GUC), New Cairo 11835, Egypt.
- Mechatronics Engineering Department, Faculty of Engineering and Materials Science (EMS), German University in Cairo (GUC), New Cairo 11835, Egypt.
- ARAtronics Laboratory, Mechatronics Engineering Department (MCTR), German University in Cairo (GUC), New Cairo 11835, Egypt.
- Product Design, Faculty of Applied Sciences and Arts (FASA), German University in Cairo (GUC), New Cairo 11835, Egypt.
- Rostock University Medical Center, 18057 Rostock, Germany.
ORCID-Profile: Shereen Afifi, Amir R Ali, Yasmin Yousry, Hatem S Abdullah, Miral Y Selim, Mohamed Hamed
Förderung
- DAAD, the German Academic Exchange Service
Zitieren
APA
Afifi, S., Ali, A. R., Abdelbasset, N. H., Poulis, Y., Yousry, Y., Zinal, M., Abdullah, H. S., Selim, M. Y., & Hamed, M. (2026). A Hybrid Multimodal Cancer Diagnostic Framework Integrating Deep Learning of Histopathology and Whispering Gallery Mode Optical Sensors. Diagnostics, 16(6), 848. https://doi.org/10.3390/diagnostics16060848
Vancouver
Afifi S, Ali AR, Abdelbasset NH, Poulis Y, Yousry Y, Zinal M, et al. A Hybrid Multimodal Cancer Diagnostic Framework Integrating Deep Learning of Histopathology and Whispering Gallery Mode Optical Sensors. Diagnostics. 2026;16(6):848. doi:10.3390/diagnostics16060848
BibTeX
@article{Afifi2026,
author = {Afifi, Shereen and Ali, Amir R and Abdelbasset, Nada Haytham and Poulis, Youssef and Yousry, Yasmin and Zinal, Mohamed and Abdullah, Hatem S and Selim, Miral Y and Hamed, Mohamed},
title = {A Hybrid Multimodal Cancer Diagnostic Framework Integrating Deep Learning of Histopathology and Whispering Gallery Mode Optical Sensors},
journal = {Diagnostics},
year = {2026},
volume = {16},
number = {6},
pages = {848},
doi = {10.3390/diagnostics16060848}
}
EUVIMED