Attention-Based Multimodal Framework for Athlete-Performance Analysis and Rehabilitation Monitoring Using Vision and Wearable Sensors
Bioengineering · 23.06.2026 · 13 (7) · 718
DOI: 10.3390/bioengineering13070718 ↗Kurz gefasst
Fachartikel in der Zeitschrift Bioengineering, online erschienen am 23.06.2026. Verfasst von Mohammed Alonazi und 5 weiteren Autor:innen. Beteiligte Einrichtung: Department of Information Systems, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-Kharj 16273, Saudi Arabia. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 23 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: University of Bremen, SuUB Bremen, Princess Nourah bint Abdulrahman University.
Abstract (Originalsprache)
Background
Advances in monitoring systems featuring wearable sensors, computer vision, and artificial intelligence (AI) have been increasingly used in sports science and rehabilitation practices as a means of movement pattern analysis, injury prevention, and training optimization. These technologies are becoming essential components of athlete-performance analysis and rehabilitation-monitoring systems designed to support biomechanical assessment, athlete development, and movement-quality evaluation. Athlete-performance analysis and rehabilitation monitoring increasingly rely on intelligent multimodal sensing systems capable of continuously evaluating movement quality, biomechanical patterns, training execution, and recovery progress. Human activity recognition (HAR) serves as a key enabling technology for these applications by providing automated assessment of human movement using wearable and vision-based sensing modalities. Therefore, the purpose of this study was to develop and evaluate an attention-based multimodal framework that integrates wearable inertial sensing and RGB video analysis for robust athlete-performance assessment and rehabilitation monitoring through accurate recognition of human movement patterns.
Methods
Athlete-performance analysis and rehabilitation monitoring combining inertial sensor data and RGB-based visual information was introduced. Inertial signals were segmented with adaptive windowing, whereas silhouette refinement was performed to analyze motion structures from visual inputs in support of athlete-performance analysis and rehabilitation monitoring. Temporal, spatial, and motion features such as trajectory, orientation, and skeleton-based space-time representations were calculated from multimodal inputs. The proposed framework was designed to capture complex movement dynamics associated with rehabilitation exercises and sports-related motion patterns across heterogeneous sensing environments. Extracted features were then combined and optimized with a multimodal feature fusion approach, while the Ranger optimization algorithm was utilized during the process. An attention-based deep learning classifier was implemented to classify movement activities.
Results
The results showed that the proposed framework reached accuracy scores of 88.40% and 87.96% on the VIDIMU dataset and the UTD-MHAD dataset respectively. Recognition performance across both inertial and vision-based modalities provided greater robustness than single-modality solutions. The integration of wearable sensing and computer vision modalities further improved the ability of the framework to analyze complex movement behaviors under varying execution conditions and environmental variations.
Conclusion
The proposed multimodal framework provides a foundation for intelligent athlete-performance and rehabilitation-monitoring systems by integrating wearable sensing, computer vision, and attention-based artificial intelligence for robust movement analysis. The findings highlight its potential to support biomechanical assessment, movement-quality evaluation, training-performance monitoring, rehabilitation tracking, and injury-risk management in modern sports and healthcare environments.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Information Systems, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-Kharj 16273, Saudi Arabia.
- Faculty of Computer Science and AI, Air University, E-9, Islamabad 44000, Pakistan.
- Department of Information Technology, College of Computer and Information Sciences, Princess Nourah bint Abdulrahman University, P.O. Box 84428, Riyadh 11671, Saudi Arabia.
- Department of Information Technology, College of Computing and Informatics, Saudi Electronic University, Riyadh 93499, Saudi Arabia.
- Department of Computer Science and Engineering, College of Informatics, Korea University, Seoul 02841, Republic of Korea.
- Guodian Nanjing Automation Co., Ltd., Nanjing 210003, China.
ORCID-Profile: Mohammed Alonazi, Raed Alsaqour, Hui Liu
Förderung
- University of Bremen
- SuUB Bremen
- Princess Nourah bint Abdulrahman University
- Prince sattam bin Abdulaziz University
Zitieren
APA
Alonazi, M., Abro, I. A., Abdelhaq, M., Alsaqour, R., Jalal, A., & Liu, H. (2026). Attention-Based Multimodal Framework for Athlete-Performance Analysis and Rehabilitation Monitoring Using Vision and Wearable Sensors. Bioengineering, 13(7), 718. https://doi.org/10.3390/bioengineering13070718
Vancouver
Alonazi M, Abro IA, Abdelhaq M, Alsaqour R, Jalal A, Liu H. Attention-Based Multimodal Framework for Athlete-Performance Analysis and Rehabilitation Monitoring Using Vision and Wearable Sensors. Bioengineering. 2026;13(7):718. doi:10.3390/bioengineering13070718
BibTeX
@article{Alonazi2026,
author = {Alonazi, Mohammed and Abro, Iqra Aijaz and Abdelhaq, Maha and Alsaqour, Raed and Jalal, Ahmad and Liu, Hui},
title = {Attention-Based Multimodal Framework for Athlete-Performance Analysis and Rehabilitation Monitoring Using Vision and Wearable Sensors},
journal = {Bioengineering},
year = {2026},
volume = {13},
number = {7},
pages = {718},
doi = {10.3390/bioengineering13070718}
}
EUVIMED