Critical Analysis of Data Leakage in WiFi CSI-Based Human Action Recognition Using CNNs
Sensors · 16.05.2024 · 24 (10) · 3159
DOI: 10.3390/s24103159 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 16.05.2024. Verfasst von Domonkos Varga. Beteiligte Einrichtung: Nokia Bell Labs, 1082 Budapest, Hungary. Hauptthemen laut MEDLINE: Neural Networks, Computer. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
WiFi Channel State Information (CSI)-based human action recognition using convolutional neural networks (CNNs) has emerged as a promising approach for non-intrusive activity monitoring. However, the integrity and reliability of the reported performance metrics are susceptible to data leakage, wherein information from the test set inadvertently influences the training process, leading to inflated accuracy rates. In this paper, we conduct a critical analysis of a notable IEEE Sensors Journal study on WiFi CSI-based human action recognition, uncovering instances of data leakage resulting from the absence of subject-based data partitioning. Empirical investigation corroborates the lack of exclusivity of individuals across dataset partitions, underscoring the importance of rigorous data management practices. Furthermore, we demonstrate that employing data partitioning with respect to humans results in significantly lower precision rates than the reported 99.9% precision, highlighting the exaggerated nature of the original findings. Such inflated results could potentially discourage other researchers and impede progress in the field by fostering a sense of complacency.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Nokia Bell Labs, 1082 Budapest, Hungary.
ORCID-Profile: Domonkos Varga
Zitieren
APA
Varga, D. (2024). Critical Analysis of Data Leakage in WiFi CSI-Based Human Action Recognition Using CNNs. Sensors, 24(10), 3159. https://doi.org/10.3390/s24103159
Vancouver
Varga D. Critical Analysis of Data Leakage in WiFi CSI-Based Human Action Recognition Using CNNs. Sensors. 2024;24(10):3159. doi:10.3390/s24103159
BibTeX
@article{Varga2024,
author = {Varga, Domonkos},
title = {Critical Analysis of Data Leakage in WiFi CSI-Based Human Action Recognition Using CNNs},
journal = {Sensors},
year = {2024},
volume = {24},
number = {10},
pages = {3159},
doi = {10.3390/s24103159}
}
EUVIMED