A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition
Sensors · 2023
DOI: 10.3390/s23052754 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Faiza Jahangir und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, HITEC University, Taxila 47080, Pakistan. Hauptthemen laut MEDLINE: Deep Learning. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: “Human Resources Program in Energy Technology” of the Korea Institute of Energy Technology Evaluation and Planning (KETEP), Ministry of Trade, Industry & Energy, Republic of Korea, Prince Satam bin Abdulaziz University.
Abstract (Originalsprache)
The performance of human gait recognition (HGR) is affected by the partial obstruction of the human body caused by the limited field of view in video surveillance. The traditional method required the bounding box to recognize human gait in the video sequences accurately; however, it is a challenging and time-consuming approach. Due to important applications, such as biometrics and video surveillance, HGR has improved performance over the last half-decade. Based on the literature, the challenging covariant factors that degrade gait recognition performance include walking while wearing a coat or carrying a bag. This paper proposed a new two-stream deep learning framework for human gait recognition. The first step proposed a contrast enhancement technique based on the local and global filters information fusion. The high-boost operation is finally applied to highlight the human region in a video frame. Data augmentation is performed in the second step to increase the dimension of the preprocessed dataset (CASIA-B). In the third step, two pre-trained deep learning models—MobilenetV2 and ShuffleNet—are fine-tuned and trained on the augmented dataset using deep transfer learning. Features are extracted from the global average pooling layer instead of the fully connected layer. In the fourth step, extracted features of both streams are fused using a serial-based approach and further refined in the fifth step by using an improved equilibrium state optimization-controlled Newton–Raphson (ESOcNR) selection method. The selected features are finally classified using machine learning algorithms for the final classification accuracy. The experimental process was conducted on 8 angles of the CASIA-B dataset and obtained an accuracy of 97.3, 98.6, 97.7, 96.5, 92.9, 93.7, 94.7, and 91.2%, respectively. Comparisons were conducted with state-of-the-art (SOTA) techniques, and showed improved accuracy and reduced computational time.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Computer Science, HITEC University, Taxila 47080, Pakistan.
- Department of Informatics, University of Leicester, Leicester LE1 7RH, UK.
- College of Computer Science and Engineering, University of Ha'il, Ha'il 81451, Saudi Arabia.
- Department of Software Engineering, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-kharj 16242, Saudi Arabia.
- Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-kharj 16242, Saudi Arabia.
- Faculty of Computers & Information Technology, Computer Science Department, University of Tabuk, Tabuk 71491, Saudi Arabia.
ORCID-Profile: Muhammad Attique Khan, Shtwai Alsubai
Förderung
- “Human Resources Program in Energy Technology” of the Korea Institute of Energy Technology Evaluation and Planning (KETEP)
- Ministry of Trade, Industry & Energy, Republic of Korea
- Prince Satam bin Abdulaziz University
Zitieren
APA
Jahangir, F., Khan, M. A., Alhaisoni, M., Alqahtani, A., Alsubai, S., Sha, M., Al Hejaili, A., & Cha, J. H. (2023). A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition. Sensors. https://doi.org/10.3390/s23052754
Vancouver
Jahangir F, Khan MA, Alhaisoni M, Alqahtani A, Alsubai S, Sha M, et al. A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition. Sensors. 2023. doi:10.3390/s23052754
BibTeX
@article{Jahangir2023,
author = {Jahangir, Faiza and Khan, Muhammad Attique and Alhaisoni, Majed and Alqahtani, Abdullah and Alsubai, Shtwai and Sha, Mohemmed and Al Hejaili, Abdullah and Cha, Jae-Hyuk},
title = {A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition},
journal = {Sensors},
year = {2023},
doi = {10.3390/s23052754}
}
EUVIMED