EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition

Faiza Jahangir, Muhammad Attique Khan iD, Majed Alhaisoni, Abdullah Alqahtani, Shtwai Alsubai iD, Mohemmed Sha, Abdullah Al Hejaili, Jae-Hyuk Cha

Sensors · 2023

DOI: 10.3390/s23052754 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, 2023. Verfasst von Faiza Jahangir und 7 weiteren Autor:innen. Beteiligte Einrichtung: Department of Computer Science, HITEC University, Taxila 47080, Pakistan. Hauptthemen laut MEDLINE: Deep Learning. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: “Human Resources Program in Energy Technology” of the Korea Institute of Energy Technology Evaluation and Planning (KETEP), Ministry of Trade, Industry & Energy, Republic of Korea, Prince Satam bin Abdulaziz University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The performance of human gait recognition (HGR) is affected by the partial obstruction of the human body caused by the limited field of view in video surveillance. The traditional method required the bounding box to recognize human gait in the video sequences accurately; however, it is a challenging and time-consuming approach. Due to important applications, such as biometrics and video surveillance, HGR has improved performance over the last half-decade. Based on the literature, the challenging covariant factors that degrade gait recognition performance include walking while wearing a coat or carrying a bag. This paper proposed a new two-stream deep learning framework for human gait recognition. The first step proposed a contrast enhancement technique based on the local and global filters information fusion. The high-boost operation is finally applied to highlight the human region in a video frame. Data augmentation is performed in the second step to increase the dimension of the preprocessed dataset (CASIA-B). In the third step, two pre-trained deep learning models—MobilenetV2 and ShuffleNet—are fine-tuned and trained on the augmented dataset using deep transfer learning. Features are extracted from the global average pooling layer instead of the fully connected layer. In the fourth step, extracted features of both streams are fused using a serial-based approach and further refined in the fifth step by using an improved equilibrium state optimization-controlled Newton–Raphson (ESOcNR) selection method. The selected features are finally classified using machine learning algorithms for the final classification accuracy. The experimental process was conducted on 8 angles of the CASIA-B dataset and obtained an accuracy of 97.3, 98.6, 97.7, 96.5, 92.9, 93.7, 94.7, and 91.2%, respectively. Comparisons were conducted with state-of-the-art (SOTA) techniques, and showed improved accuracy and reduced computational time.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningHumansAlgorithmsGaitMachine LearningBiometry

Stichwörter der Autor:innen

contrast enhancementdeep learningfeature selectionfusiongait recognitionmachine learning

Autor:innen und Institutionen

  • Department of Computer Science, HITEC University, Taxila 47080, Pakistan.
  • Department of Informatics, University of Leicester, Leicester LE1 7RH, UK.
  • College of Computer Science and Engineering, University of Ha'il, Ha'il 81451, Saudi Arabia.
  • Department of Software Engineering, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-kharj 16242, Saudi Arabia.
  • Department of Computer Science, College of Computer Engineering and Sciences, Prince Sattam bin Abdulaziz University, Al-kharj 16242, Saudi Arabia.
  • Faculty of Computers & Information Technology, Computer Science Department, University of Tabuk, Tabuk 71491, Saudi Arabia.

ORCID-Profile: Muhammad Attique Khan, Shtwai Alsubai

Förderung

  • “Human Resources Program in Energy Technology” of the Korea Institute of Energy Technology Evaluation and Planning (KETEP)
  • Ministry of Trade, Industry & Energy, Republic of Korea
  • Prince Satam bin Abdulaziz University

Zitieren

APA

Jahangir, F., Khan, M. A., Alhaisoni, M., Alqahtani, A., Alsubai, S., Sha, M., Al Hejaili, A., & Cha, J. H. (2023). A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition. Sensors. https://doi.org/10.3390/s23052754

Vancouver

Jahangir F, Khan MA, Alhaisoni M, Alqahtani A, Alsubai S, Sha M, et al. A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition. Sensors. 2023. doi:10.3390/s23052754

BibTeX
@article{Jahangir2023,
  author = {Jahangir, Faiza and Khan, Muhammad Attique and Alhaisoni, Majed and Alqahtani, Abdullah and Alsubai, Shtwai and Sha, Mohemmed and Al Hejaili, Abdullah and Cha, Jae-Hyuk},
  title = {A Fusion-Assisted Multi-Stream Deep Learning and ESO-Controlled Newton–Raphson-Based Feature Selection Approach for Human Gait Recognition},
  journal = {Sensors},
  year = {2023},
  doi = {10.3390/s23052754}
}
Kostenlos starten →