A Hybrid Transformer Framework for Efficient Activity Recognition Using Consumer Electronics
IEEE Transactions on Consumer Electronics · 2024-11 · 70 (4) · 6800-6807
DOI: 10.1109/tce.2024.3373824 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Consumer Electronics, 2024-11. Verfasst von Altaf Hussain und 6 weiteren Autor:innen. Die Arbeit wurde bisher 36-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: National Research Foundation of Korea (NRF) Grant, Korea Government.
Abstract (Originalsprache)
In the field of research on wireless visual sensor networks, human activity recognition (HAR) using consumer electronics is now an emerging research area in both the academic and industrial sectors, with a diverse range of applications. However, the implementation of HAR through computer vision methods is highly challenging on consumer electronic devices, due to their limited computational capabilities. This means that mainstream approaches in which computationally complex contextual networks and variants of recurrent neural networks are used to learn long-range spatiotemporal dependencies have achieved limited performance. To address these challenges, this paper presents an efficient framework for robust HAR for consumer electronics devices, which is divided into two main stages. In the first stage, convolutional features from the multiply_17 layer of a lightweight MobileNetV3 are employed to balance the computational complexity and extract the most salient contextual features ( $7\times 7\times 576\times 30$ ) from each video. In the second stage, a sequential residual transformer network (SRTN) is designed in a residual fashion to effectively learn the long-range temporal dependencies across multiple video frames. The temporal multi-head self-attention module and residual strategy of the SRTN enable the proposed method to discard non-relevant features and to optimise the spatiotemporal feature vector for efficient HAR. The performance of the proposed model is evaluated on three challenging HAR datasets, and is found to yield high levels of accuracy of 76.1428%, 96.6399%, and 97.3130% on the HMDB51, UCF101, and UCF50 datasets, respectively, outperforming a state-of-the-art method for HAR.
Förderung
- National Research Foundation of Korea (NRF) Grant
- Korea Government
Zitieren
APA
Hussain, A., Khan, S. U., Khan, N., Bhatt, M. W., Farouk, A., Bhola, J., & Baik, S. W. (2024). A Hybrid Transformer Framework for Efficient Activity Recognition Using Consumer Electronics. IEEE Transactions on Consumer Electronics, 70(4), 6800-6807. https://doi.org/10.1109/tce.2024.3373824
Vancouver
Hussain A, Khan SU, Khan N, Bhatt MW, Farouk A, Bhola J, et al. A Hybrid Transformer Framework for Efficient Activity Recognition Using Consumer Electronics. IEEE Transactions on Consumer Electronics. 2024;70(4):6800-6807. doi:10.1109/tce.2024.3373824
BibTeX
@article{Hussain2024,
author = {Hussain, Altaf and Khan, Samee Ullah and Khan, Noman and Bhatt, Mohammed Wasim and Farouk, Ahmed and Bhola, Jyoti and Baik, Sung Wook},
title = {A Hybrid Transformer Framework for Efficient Activity Recognition Using Consumer Electronics},
journal = {IEEE Transactions on Consumer Electronics},
year = {2024},
volume = {70},
number = {4},
pages = {6800--6807},
doi = {10.1109/tce.2024.3373824}
}
EUVIMED