EUVIMEDEUVIMED entdecken
Crossref

GaitFi: Robust Device-Free Human Identification via WiFi and Vision Multimodal Learning

Lang Deng, Jianfei Yang, Shenghai Yuan, Han Zou, Chris Xiaoxuan Lu, Lihua Xie

IEEE Internet of Things Journal · 01.01.2023 · 10 (1) · 625-636

DOI: 10.1109/jiot.2022.3203559 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Internet of Things Journal, erschienen am 01.01.2023. Verfasst von Lang Deng und 5 weiteren Autor:innen. Die Arbeit wurde bisher 71-mal zitiert (Crossref) und nennt 75 Literaturangaben. Gefördert von: NTU Presidential Postdoctoral Fellowship, “Adaptive Multimodal Learning for Robust Sensing and Recognition in Smart Cities” Project Fund, Nanyang Technological….

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

As an important biomarker for human identification, human gait can be collected at a distance by passive sensors without subject cooperation, which plays an essential role in crime prevention, security detection, and other human identification applications. Presently, most research works are based on cameras and computer vision techniques to perform gait recognition. However, vision-based methods are not reliable when confronting poor illuminations, leading to degrading performances. In this article, we propose a novel multimodal gait recognition method, namely, GaitFi, which leverages WiFi signals and videos for human identification. In GaitFi, channel state information (CSI) that reflects the multipath propagation of WiFi is collected to capture human gaits, while videos are captured by cameras. To learn robust gait information, we propose a lightweight residual convolution network (LRCN) as the backbone network and further propose the two-stream GaitFi by integrating WiFi and vision features for the gait retrieval task. The GaitFi is trained by the triplet loss and classification loss on different levels of features. Extensive experiments are conducted in the real world, which demonstrates that the GaitFi outperforms state-of-the-art gait recognition methods based on single WiFi or camera, achieving 94.2% for human identification tasks of 12 subjects.

Förderung

  • NTU Presidential Postdoctoral Fellowship, “Adaptive Multimodal Learning for Robust Sensing and Recognition in Smart Cities” Project Fund, Nanyang Technological…

Zitieren

APA

Deng, L., Yang, J., Yuan, S., Zou, H., Lu, C. X., & Xie, L. (2023). GaitFi: Robust Device-Free Human Identification via WiFi and Vision Multimodal Learning. IEEE Internet of Things Journal, 10(1), 625-636. https://doi.org/10.1109/jiot.2022.3203559

Vancouver

Deng L, Yang J, Yuan S, Zou H, Lu CX, Xie L. GaitFi: Robust Device-Free Human Identification via WiFi and Vision Multimodal Learning. IEEE Internet of Things Journal. 2023;10(1):625-636. doi:10.1109/jiot.2022.3203559

BibTeX
@article{Deng2023,
  author = {Deng, Lang and Yang, Jianfei and Yuan, Shenghai and Zou, Han and Lu, Chris Xiaoxuan and Xie, Lihua},
  title = {GaitFi: Robust Device-Free Human Identification via WiFi and Vision Multimodal Learning},
  journal = {IEEE Internet of Things Journal},
  year = {2023},
  volume = {10},
  number = {1},
  pages = {625--636},
  doi = {10.1109/jiot.2022.3203559}
}
Kostenlos starten →