EUVIMEDEUVIMED entdecken
Crossref

The knowledge distillation-assisted multimodal model for osteoporosis screening

Teng Su, Qing Yang, Meng Si, Yuanyuan Sun, Xinyu Ji, Yuyan Zhang, Bing Ji

Computer Methods and Programs in Biomedicine · 2025

DOI: 10.1016/j.cmpb.2025.108848 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Methods and Programs in Biomedicine, 2025. Verfasst von Teng Su und 6 weiteren Autor:innen. Beteiligte Einrichtung: School of Control Science and Engineering, Shandong University, Jinan, Shandong, China, 250061. Hauptthemen laut MEDLINE: Osteoporosis, Mass Screening. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 51 Literaturangaben. Gefördert von: Natural Science Foundation of Shandong Province, National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND AND OBJECTIVE: Osteoporosis is characterized by reduced bone mass and deterioration of bone structure, yet screening rates prior to fractures remain low. Given its high prevalence and severe consequences, developing an effective osteoporosis screening model is highly significant. However, constructing these screening models presents two main challenges. First, selecting representative slices from CT image sequences is challenging, making it crucial to filter the most indicative slices. Second, samples lacking complete modal data cannot be directly used in multimodal fusion, resulting in underutilization of available data and limiting the performance of the multimodal osteoporosis screening model. METHODS: In this paper, we propose a reinforcement learning-driven knowledge distillation-assisted multimodal model for osteoporosis screening. The model integrates demographic characteristics, routine laboratory indicators, and CT images. Specifically, our framework includes two novel components: 1) a deep reinforcement learning-based image selection module (DRLIS) designed to select representative image slices from CT sequences; and 2) a knowledge distillation-assisted multimodal model (KDAMM) that transfers information from single-modal teacher networks to the multimodal model, effectively utilizing samples with incomplete modalities. The codes are published on: https://github.com/AImedcinesdu212/Osteoporosis-Predictionhttps://github.com/Hidden-neurosis/osreoporosis.git. RESULTS: The proposed multimodal osteoporosis screening model achieves an accuracy of 88.65 % and an AUC of 0.9542, surpassing existing models by 2.85 % in accuracy and 0.0212 in AUC. Additionally, we demonstrate the effectiveness of each novelty within our framework. The SHAP values are calculated to assess the importance of demographic characteristics and routine laboratory test data. CONCLUSION: This paper presents a knowledge distillation-assisted multimodal model for opportunistic osteoporosis screening. The model incorporates demographic characteristics, routine laboratory indicators (including blood tests and urinalysis), and CT images. Extensive experiments, conducted on self-collected datasets, validate that the proposed framework achieves state-of-the-art performance.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

OsteoporosisMass ScreeningHumansTomography, X-Ray ComputedFemaleDeep LearningMiddle AgedAgedMaleBone DensityAlgorithms

Stichwörter der Autor:innen

Deep learningKnowledge distillationMultimodal fusionOsteoporosis screening model

Autor:innen und Institutionen

  • School of Control Science and Engineering, Shandong University, Jinan, Shandong, China, 250061.
  • Department of Breast and Thyroid Surgery, Shandong Provincial Hospital Affiliated to Shandong First Medical University, Jinan, Shandong, China, 250021.
  • Department of Orthopedics, Qilu Hospital of Shandong University, Jinan, Shandong, China, 250000.
  • School of Control Science and Engineering, Shandong University, Jinan, Shandong, China, 250061. Electronic address: b.ji@sdu.edu.cn.

Förderung

  • Natural Science Foundation of Shandong Province
  • National Natural Science Foundation of China

Zitieren

APA

Su, T., Yang, Q., Si, M., Sun, Y., Ji, X., Zhang, Y., & Ji, B. (2025). The knowledge distillation-assisted multimodal model for osteoporosis screening. Computer Methods and Programs in Biomedicine. https://doi.org/10.1016/j.cmpb.2025.108848

Vancouver

Su T, Yang Q, Si M, Sun Y, Ji X, Zhang Y, et al. The knowledge distillation-assisted multimodal model for osteoporosis screening. Computer Methods and Programs in Biomedicine. 2025. doi:10.1016/j.cmpb.2025.108848

BibTeX
@article{Su2025,
  author = {Su, Teng and Yang, Qing and Si, Meng and Sun, Yuanyuan and Ji, Xinyu and Zhang, Yuyan and Ji, Bing},
  title = {The knowledge distillation-assisted multimodal model for osteoporosis screening},
  journal = {Computer Methods and Programs in Biomedicine},
  year = {2025},
  doi = {10.1016/j.cmpb.2025.108848}
}
Kostenlos starten →