EUVIMEDEUVIMED entdecken
Crossref

Dual modal data-driven virtual reality-based mild cognitive Impairment assessment using MCIformer

Yanjie Zhang, Yang Pan, Shanshan Feng, Hongliang Qiao, Lingguo Bu, Fan Li

Computer Methods and Programs in Biomedicine · 2026-05 · 279 · 109312

DOI: 10.1016/j.cmpb.2026.109312 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Computer Methods and Programs in Biomedicine, 2026-05. Verfasst von Yanjie Zhang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, 999077, Hong Kong Special Administrative Region. Hauptthemen laut MEDLINE: Cognitive Dysfunction, Virtual Reality. Die Arbeit nennt 49 Literaturangaben. Gefördert von: Natural Science Foundation of Shandong Province, National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

BACKGROUND Mild Cognitive Impairment (MCI) assessment is critical for identifying cognitive decline and enabling early intervention to reduce the risk of Alzheimer's disease (AD). Virtual Reality (VR)-based cognitive assessments offer enhanced engagement, ecological validity, and user-friendliness. However, most existing VR-based systems rely primarily on task performance metrics, overlooking subtle changes in motor behaviour and underlying neural activity patterns that are indicative of early cognitive decline. METHODS We developed a dual-modal, data-driven VR-based MCI assessment method integrating kinematic and functional near-infrared spectroscopy (fNIRS) data. A VR-based experiment involving healthy and MCI participants was conducted to collect synchronised kinematic and neural data. Kinematic features-smoothness, coordination, and stability-were extracted from segmented movement trajectories and structured as time series to capture subtle motor deficits. Simultaneously, multichannel fNIRS data were represented as functional brain networks to assess interregional connectivity changes associated with cognitive impairment. We proposed MCIformer, a dual-modal fusion model that applies a Transformer to kinematic sequences to capture dynamic motor patterns and a Graph Transformer to fNIRS networks to detect connectivity alterations. RESULTS Experimental results show that the proposed system achieved 90% accuracy, significantly outperforming models using only kinematic data (80%) or only fNIRS data (85%). The findings demonstrate that integrating temporal motor patterns and spatial brain connectivity patterns enhances classification performance by capturing complementary brain-behaviour information. CONCLUSIONS The proposed VR-based dual-modal MCI assessment approach demonstrates strong potential for scalable, accurate early diagnosis in community settings, supporting the development of more comprehensive brain-behaviour monitoring systems for cognitive health.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Cognitive DysfunctionVirtual RealityHumansFemaleSpectroscopy, Near-InfraredMaleBiomechanical PhenomenaAgedBrain

Stichwörter der Autor:innen

KinectMCIMachine LearningVRfNIRS

Autor:innen und Institutionen

  • Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, 999077, Hong Kong Special Administrative Region.
  • Department of Neurology, Zhongnan Hospital of Wuhan University, No. 169, Donghu Road, Wuhan 430071, Hubei, China.
  • School of Computer Science, Wuhan University.
  • Joint SDU-NTU Centre for Artificial Intelligence Research (C-FAIR), Shandong University, Jinan, 250101, China.
  • Department of Aeronautical and Aviation Engineering, The Hong Kong Polytechnic University, 999077, Hong Kong Special Administrative Region. Electronic address: fan-5.li@polyu.edu.hk.

Förderung

  • Natural Science Foundation of Shandong Province
  • National Natural Science Foundation of China

Zitieren

APA

Zhang, Y., Pan, Y., Feng, S., Qiao, H., Bu, L., & Li, F. (2026). Dual modal data-driven virtual reality-based mild cognitive Impairment assessment using MCIformer. Computer Methods and Programs in Biomedicine, 279, 109312. https://doi.org/10.1016/j.cmpb.2026.109312

Vancouver

Zhang Y, Pan Y, Feng S, Qiao H, Bu L, Li F. Dual modal data-driven virtual reality-based mild cognitive Impairment assessment using MCIformer. Computer Methods and Programs in Biomedicine. 2026;279:109312. doi:10.1016/j.cmpb.2026.109312

BibTeX
@article{Zhang2026,
  author = {Zhang, Yanjie and Pan, Yang and Feng, Shanshan and Qiao, Hongliang and Bu, Lingguo and Li, Fan},
  title = {Dual modal data-driven virtual reality-based mild cognitive Impairment assessment using MCIformer},
  journal = {Computer Methods and Programs in Biomedicine},
  year = {2026},
  volume = {279},
  pages = {109312},
  doi = {10.1016/j.cmpb.2026.109312}
}
Kostenlos starten →