EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multimodal Gait Abnormality Recognition Using a Convolutional Neural Network–Bidirectional Long Short-Term Memory (CNN-BiLSTM) Network Based on Multi-Sensor Data Fusion

Jing Li, Weisheng Liang, Xiyan Yin, Jun Li, Weizheng Guan

Sensors · 10.11.2023 · 23 (22) · 9101

DOI: 10.3390/s23229101 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 10.11.2023. Verfasst von Jing Li und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Mechanical Engineering and Hubei Modern Manufacturing Quality Engineering Key Laboratory, Hubei University of Technology, Wuhan 430068, Chi…. Hauptthemen laut MEDLINE: Parkinson Disease, Amyotrophic Lateral Sclerosis, Huntington Disease. Die Arbeit wurde bisher 38-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Department of Science and Technology of Hubei Province, Science and Technology Major Project of Hubei Province of China, Research Start-up Fund from Hubei University of Technology.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Global aging leads to a surge in neurological diseases. Quantitative gait analysis for the early detection of neurological diseases can effectively reduce the impact of the diseases. Recently, extensive research has focused on gait-abnormality-recognition algorithms using a single type of portable sensor. However, these studies are limited by the sensor’s type and the task specificity, constraining the widespread application of quantitative gait recognition. In this study, we propose a multimodal gait-abnormality-recognition framework based on a Convolutional Neural Network-Bidirectional Long Short-Term Memory (CNN-BiLSTM) network. The as-established framework effectively addresses the challenges arising from smooth data interference and lengthy time series by employing an adaptive sliding window technique. Then, we convert the time series into time–frequency plots to capture the characteristic variations in different abnormality gaits and achieve a unified representation of the multiple data types. This makes our signal processing method adaptable to several types of sensors. Additionally, we use a pre-trained Deep Convolutional Neural Network (DCNN) for feature extraction, and the consequently established CNN-BiLSTM network can achieve high-accuracy recognition by fusing and classifying the multi-sensor input data. To validate the proposed method, we conducted diversified experiments to recognize the gait abnormalities caused by different neuropathic diseases, such as amyotrophic lateral sclerosis (ALS), Parkinson’s disease (PD), and Huntington’s disease (HD). In the PDgait dataset, the framework achieved an accuracy of 98.89% in the classification of Parkinson’s disease severity, surpassing DCLSTM’s 96.71%. Moreover, the recognition accuracy of ALS, PD, and HD on the PDgait dataset was 100%, 96.97%, and 95.43% respectively, surpassing the majority of previously reported methods. These experimental results strongly demonstrate the potential of the proposed multimodal framework for gait abnormality identification. Due to the advantages of the framework, such as its suitability for different types of sensors and fewer training parameters, it is more suitable for gait monitoring in daily life and the customization of medical rehabilitation schedules, which will help more patients alleviate the harm caused by their diseases.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Parkinson DiseaseAmyotrophic Lateral SclerosisHuntington DiseaseHumansNeural Networks, ComputerGait

Stichwörter der Autor:innen

CNN-BiLSTM networkgait abnormality recognitionmulti-sensorneurodegenerative diseasestime–frequency plots

Autor:innen und Institutionen

  • School of Mechanical Engineering and Hubei Modern Manufacturing Quality Engineering Key Laboratory, Hubei University of Technology, Wuhan 430068, China.
  • School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China, Chengdu 611731, China.
  • Detroit Green Technology Institute, Hubei University of Technology, Wuhan 430068, China.

Förderung

  • Department of Science and Technology of Hubei Province
  • Science and Technology Major Project of Hubei Province of China
  • Research Start-up Fund from Hubei University of Technology
  • open fund from Hubei Modern Manufacturing Quality Engineering Key Laboratory

Zitieren

APA

Li, J., Liang, W., Yin, X., Li, J., & Guan, W. (2023). Multimodal Gait Abnormality Recognition Using a Convolutional Neural Network–Bidirectional Long Short-Term Memory (CNN-BiLSTM) Network Based on Multi-Sensor Data Fusion. Sensors, 23(22), 9101. https://doi.org/10.3390/s23229101

Vancouver

Li J, Liang W, Yin X, Li J, Guan W. Multimodal Gait Abnormality Recognition Using a Convolutional Neural Network–Bidirectional Long Short-Term Memory (CNN-BiLSTM) Network Based on Multi-Sensor Data Fusion. Sensors. 2023;23(22):9101. doi:10.3390/s23229101

BibTeX
@article{Li2023,
  author = {Li, Jing and Liang, Weisheng and Yin, Xiyan and Li, Jun and Guan, Weizheng},
  title = {Multimodal Gait Abnormality Recognition Using a Convolutional Neural Network–Bidirectional Long Short-Term Memory (CNN-BiLSTM) Network Based on Multi-Sensor Data Fusion},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {22},
  pages = {9101},
  doi = {10.3390/s23229101}
}
Kostenlos starten →