TinyAct: A framework for real-time action recognition in the cloud through distillation learning
PLOS One · 2026
DOI: 10.1371/journal.pone.0347245 ↗Kurz gefasst
Fachartikel in der Zeitschrift PLOS One, 2026. Verfasst von Yupaporn Wanna und 2 weiteren Autor:innen. Beteiligte Einrichtung: Visual Intelligence Laboratory, Department of Statistics, Faculty of Science, Khon Kaen University, Khon Kaen, Thailand. Hauptthemen laut MEDLINE: Cloud Computing, Pattern Recognition, Automated, Human Activities. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Fundamental Fund of Khon Kaen University, National Science, Research and Innovation Fund.
Abstract (Originalsprache)
Human action recognition has become increasingly important for applications in security surveillance, healthcare monitoring, and smart environments. However, existing deep learning models typically require substantial computational resources, making deployment on resource-constrained edge devices challenging. To address this limitation, we propose TinyAct, a lightweight framework for real-time human action recognition that combines edge computing with cloud-based processing through knowledge distillation. TinyAct employs a 3D video autoencoder to extract compact spatiotemporal features from video sequences, coupled with classical machine learning classifiers for action prediction. The framework utilizes an AIoT (Artificial Intelligence of Things) architecture where feature extraction occurs on edge devices while classification is performed in the cloud, enabling real-time processing with reduced bandwidth requirements. To enhance performance, we implement knowledge distillation using the ILA-ViT-B/16 transformer as a teacher model to transfer temporal knowledge to our compact student architecture. Our experiments on the Kinetics-400 dataset demonstrate that TinyAct achieves competitive performance while maintaining computational efficiency. Using 16-frame video clips with 1024-dimensional latent features, Random Forest achieved the highest baseline accuracy of 57.00%, followed by SVM (55.00%) and XGBoost (54.00%). The autoencoder-based feature extraction significantly reduces computational overhead compared to end-to-end deep learning approaches while preserving essential spatiotemporal information for accurate action recognition. The knowledge distillation experiments reveal that training configuration critically affects performance, with non-pretrained student models achieving better results (15.11% with SVM) than pretrained ones under teacher supervision. This suggests that joint optimization of the encoder and classifier is essential for effective knowledge transfer in resource-constrained settings. TinyAct’s modular architecture enables flexible deployment across diverse hardware configurations, supporting both lightweight edge inference and cloud-based training pipelines. The framework demonstrates that effective human action recognition can be achieved without computationally intensive deep networks, making it suitable for smart surveillance systems, IoT applications, and embedded devices where computational resources are limited.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Autor:innen und Institutionen
- Visual Intelligence Laboratory, Department of Statistics, Faculty of Science, Khon Kaen University, Khon Kaen, Thailand.
ORCID-Profile: Thanapong Intharah
Förderung
- Fundamental Fund of Khon Kaen University
- National Science, Research and Innovation Fund
Zitieren
APA
Wanna, Y., Wiratchawa, K., & Intharah, T. (2026). TinyAct: A framework for real-time action recognition in the cloud through distillation learning. PLOS One. https://doi.org/10.1371/journal.pone.0347245
Vancouver
Wanna Y, Wiratchawa K, Intharah T. TinyAct: A framework for real-time action recognition in the cloud through distillation learning. PLOS One. 2026. doi:10.1371/journal.pone.0347245
BibTeX
@article{Wanna2026,
author = {Wanna, Yupaporn and Wiratchawa, Kannika and Intharah, Thanapong},
title = {TinyAct: A framework for real-time action recognition in the cloud through distillation learning},
journal = {PLOS One},
year = {2026},
doi = {10.1371/journal.pone.0347245}
}
EUVIMED