A Sensor-Oriented Multimodal Medical Data Acquisition and Modeling Framework for Tumor Grading and Treatment Response Analysis
Sensors · 2026
DOI: 10.3390/s26020737 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2026. Verfasst von Linfeng Xie und 6 weiteren Autor:innen. Beteiligte Einrichtung: Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China. Hauptthemen laut MEDLINE: Multimodal Imaging, Neoplasms. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 82 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China.
Abstract (Originalsprache)
In precision oncology research, achieving joint modeling of tumor grading and treatment response, together with interpretable mechanism analysis, based on multimodal medical imaging and clinical data remains a challenging and critical problem. From a sensing perspective, these imaging and clinical data can be regarded as heterogeneous sensor-derived signals acquired by medical imaging sensors and clinical monitoring systems, providing continuous and structured observations of tumor characteristics and patient states. Existing approaches typically rely on invasive pathological grading, while grading prediction and treatment response modeling are often conducted independently. Moreover, multimodal fusion procedures generally lack explicit structural constraints, which limits their practical utility in clinical decision-making. To address these issues, a grade-guided multimodal collaborative modeling framework was proposed. Built upon mature deep learning models, including 3D ResNet-18, MLP, and CNN–Transformer, tumor grading was incorporated as a weakly supervised prior into the processes of multimodal feature fusion and treatment response modeling, thereby enabling an integrated solution for non-invasive grading prediction, treatment response subtype discovery, and intrinsic mechanism interpretation. Through a grade-guided feature fusion mechanism, discriminative information that is highly correlated with tumor malignancy and treatment sensitivity is emphasized in the multimodal joint representation, while irrelevant features are suppressed to prevent interference with model learning. Within a unified framework, grading prediction and grade-conditioned treatment response modeling are jointly realized. Experimental results on real-world clinical datasets demonstrate that the proposed method achieved an accuracy of 84.6% and a kappa coefficient of 0.81 in the tumor-grading prediction task, indicating a high level of consistency with pathological grading. In the treatment response prediction task, the proposed model attained an AUC of 0.85, a precision of 0.81, and a recall of 0.79, significantly outperforming single-modality models, conventional early-fusion models, and multimodal CNN–Transformer models without grading constraints. In addition, treatment-sensitive and treatment-resistant subtypes identified under grading conditions exhibited stable and significant stratification differences in clustering consistency and survival analysis, validating the potential value of the proposed approach for clinical risk assessment and individualized treatment decision-making.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Biomedical Engineering, Faculty of Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China.
- National School of Development, Peking University, Beijing 100871, China.
- College of Biological Sciences, China Agricultural University, Beijing 100083, China.
- Artificial Intelligence Research Institute, Tsinghua University, Beijing 100084, China.
Förderung
- National Natural Science Foundation of China
Zitieren
APA
Xie, L., Xiao, S., Ming, B., Xiang, Z., Rui, Z., Liu, X., & Zhan, Y. (2026). A Sensor-Oriented Multimodal Medical Data Acquisition and Modeling Framework for Tumor Grading and Treatment Response Analysis. Sensors. https://doi.org/10.3390/s26020737
Vancouver
Xie L, Xiao S, Ming B, Xiang Z, Rui Z, Liu X, et al. A Sensor-Oriented Multimodal Medical Data Acquisition and Modeling Framework for Tumor Grading and Treatment Response Analysis. Sensors. 2026. doi:10.3390/s26020737
BibTeX
@article{Xie2026,
author = {Xie, Linfeng and Xiao, Shanhe and Ming, Bihong and Xiang, Zhe and Rui, Zibo and Liu, Xinyi and Zhan, Yan},
title = {A Sensor-Oriented Multimodal Medical Data Acquisition and Modeling Framework for Tumor Grading and Treatment Response Analysis},
journal = {Sensors},
year = {2026},
doi = {10.3390/s26020737}
}
EUVIMED