EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

BrainTwin-AI: A Multimodal MRI-EEG-Based Cognitive Digital Twin for Real-Time Brain Health Intelligence

Himadri Nath Saha iD, Utsho Banerjee iD, Rajarshi Karmakar iD, Saptarshi Banerjee iD, Jon Turdiev iD

Brain Sciences · 13.04.2026 · 16 (4) · 411

DOI: 10.3390/brainsci16040411 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Brain Sciences, online erschienen am 13.04.2026. Verfasst von Himadri Nath Saha und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, SNEC, University of Calcutta, Kolkata 700073, West Bengal, India. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Background/Objectives: Brain health monitoring is increasingly essential as modern cognitive load, stress, and lifestyle pressures contribute to widespread neural instability. The paper presents BrainTwin, a next-generation cognitive digital twin, as a patient-specific, constantly updating computer model that combines state-of-the-art MRI analytics for neuro-oncological assessment related to clinical study and management of tumors affecting the central nervous system (including their detection, progression, and monitoring) with real-time EEG-based brain health intelligence.

Methods

Structural analysis is driven by an Enhanced Vision Transformer (ViT++), which improves spatial representation and boundary localization, achieving more accurate tumor prediction than conventional models. The extracted tumor volume forms the baseline for short-horizon tumor progression modeling. Parallel to MRI analysis, continuous EEG signals are captured through an in-house wearable skullcap, preprocessed using Edge AI on a Hailo Toolkit-enabled Raspberry Pi 5 for low-latency denoising and secure cloud transmission. Pre-processed EEG packets are authenticated at the fog layer, ensuring secure and reliable cloud transfer, enabling significant load reduction in the edge and cloud nodes. In the digital twin, EEG characteristics offer real-time functional monitoring through dynamic brainwave analysis, while a BiLSTM classifier distinguishes relaxed, stress, and fatigue states, which are probabilistically inferred cognitive conditions derived from EEG spectral patterns. Unlike static MRI imaging, EEG provides real-time brain health monitoring. The BrainTwin performs EEG–MRI fusion, correlating functional EEG metrics with ViT++ structural embeddings to produce a single risk score that can be interpreted by clinicians to determine brain vulnerability to future diseases. Explainable artificial intelligence (XAI) provides clinical interpretability through gradient-weighted class activation mapping (Grad-CAM) heatmaps, which are used to interpret ViT++ decisions and are visualized on a 3D interactive brain model to allow more in-depth inspection of spatial details.

Results

The evaluation metrics demonstrate a BiLSTM macro-F1 of 0.94 (Precision/Recall/F1: Relaxed 0.96, Stress 0.93, Fatigue 0.92) and a ViT++ MRI accuracy of 96%, outperforming baseline architectures.

Conclusions

These results demonstrate BrainTwin’s reliability, interpretability, and clinical utility as an integrated digital companion for tumor assessment and real-time functional brain monitoring.

Schlagwörter

Stichwörter der Autor:innen

3D brainEEG-MRI fusionEdge AIViT++XAIdigital twinprogression modelingwearable skullcap

Autor:innen und Institutionen

  • Department of Computer Science, SNEC, University of Calcutta, Kolkata 700073, West Bengal, India.
  • Department of Computer Science and Engineering (Specialization in Internet of Things), Institute of Engineering and Management, Kolkata 700091, West Bengal, India.
  • Department of Computer Science and Engineering, University of Engineering and Management, Kolkata 700160, West Bengal, India.
  • Department of Computer Science, Illinois Institute of Technology, Chicago, IL 60616, USA.
  • Department of Computer Science, San Francisco State University, San Francisco, CA 94132, USA.

ORCID-Profile: Himadri Nath Saha, Utsho Banerjee, Rajarshi Karmakar, Saptarshi Banerjee, Jon Turdiev

Zitieren

APA

Saha, H. N., Banerjee, U., Karmakar, R., Banerjee, S., & Turdiev, J. (2026). BrainTwin-AI: A Multimodal MRI-EEG-Based Cognitive Digital Twin for Real-Time Brain Health Intelligence. Brain Sciences, 16(4), 411. https://doi.org/10.3390/brainsci16040411

Vancouver

Saha HN, Banerjee U, Karmakar R, Banerjee S, Turdiev J. BrainTwin-AI: A Multimodal MRI-EEG-Based Cognitive Digital Twin for Real-Time Brain Health Intelligence. Brain Sciences. 2026;16(4):411. doi:10.3390/brainsci16040411

BibTeX
@article{Saha2026,
  author = {Saha, Himadri Nath and Banerjee, Utsho and Karmakar, Rajarshi and Banerjee, Saptarshi and Turdiev, Jon},
  title = {BrainTwin-AI: A Multimodal MRI-EEG-Based Cognitive Digital Twin for Real-Time Brain Health Intelligence},
  journal = {Brain Sciences},
  year = {2026},
  volume = {16},
  number = {4},
  pages = {411},
  doi = {10.3390/brainsci16040411}
}
Kostenlos starten →