EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Critical Analysis of Data Leakage in WiFi CSI-Based Human Action Recognition Using CNNs

Domonkos Varga iD

Sensors · 16.05.2024 · 24 (10) · 3159

DOI: 10.3390/s24103159 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 16.05.2024. Verfasst von Domonkos Varga. Beteiligte Einrichtung: Nokia Bell Labs, 1082 Budapest, Hungary. Hauptthemen laut MEDLINE: Neural Networks, Computer. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

WiFi Channel State Information (CSI)-based human action recognition using convolutional neural networks (CNNs) has emerged as a promising approach for non-intrusive activity monitoring. However, the integrity and reliability of the reported performance metrics are susceptible to data leakage, wherein information from the test set inadvertently influences the training process, leading to inflated accuracy rates. In this paper, we conduct a critical analysis of a notable IEEE Sensors Journal study on WiFi CSI-based human action recognition, uncovering instances of data leakage resulting from the absence of subject-based data partitioning. Empirical investigation corroborates the lack of exclusivity of individuals across dataset partitions, underscoring the importance of rigorous data management practices. Furthermore, we demonstrate that employing data partitioning with respect to humans results in significantly lower precision rates than the reported 99.9% precision, highlighting the exaggerated nature of the original findings. Such inflated results could potentially discourage other researchers and impede progress in the field by fostering a sense of complacency.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerHumansWireless TechnologyAlgorithmsHuman ActivitiesReproducibility of Results

Stichwörter der Autor:innen

WiFi CSIconvolutional neural networksdata leakagehuman action recognitionmachine learning

Autor:innen und Institutionen

  • Nokia Bell Labs, 1082 Budapest, Hungary.

ORCID-Profile: Domonkos Varga

Zitieren

APA

Varga, D. (2024). Critical Analysis of Data Leakage in WiFi CSI-Based Human Action Recognition Using CNNs. Sensors, 24(10), 3159. https://doi.org/10.3390/s24103159

Vancouver

Varga D. Critical Analysis of Data Leakage in WiFi CSI-Based Human Action Recognition Using CNNs. Sensors. 2024;24(10):3159. doi:10.3390/s24103159

BibTeX
@article{Varga2024,
  author = {Varga, Domonkos},
  title = {Critical Analysis of Data Leakage in WiFi CSI-Based Human Action Recognition Using CNNs},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {10},
  pages = {3159},
  doi = {10.3390/s24103159}
}
Kostenlos starten →