A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection
Sensors · 30.08.2024 · 24 (17) · 5640
DOI: 10.3390/s24175640 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 30.08.2024. Verfasst von Xiaoli Zhang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Computer Science, Kunming University of Science and Technology, Kunming 650500, China. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: GuiFuZhu,WeiDai, WeiDai, Yunnan Provincial Department of Education Science Research Fund Project.
Abstract (Originalsprache)
With the development of educational technology, machine learning and deep learning provide technical support for traditional classroom observation assessment. However, in real classroom scenarios, the technique faces challenges such as lack of clarity of raw images, complexity of datasets, multi-target detection errors, and complexity of character interactions. Based on the above problems, a student classroom behavior recognition network incorporating super-resolution and target detection is proposed. To cope with the problem of unclear original images in the classroom scenario, SRGAN (Super Resolution Generative Adversarial Network for Images) is used to improve the image resolution and thus the recognition accuracy. To address the dataset complexity and multi-targeting problems, feature extraction is optimized, and multi-scale feature recognition is enhanced by introducing AKConv and LASK attention mechanisms into the Backbone module of the YOLOv8s algorithm. To improve the character interaction complexity problem, the CBAM attention mechanism is integrated to enhance the recognition of important feature channels and spatial regions. Experiments show that it can detect six behaviors of students—raising their hands, reading, writing, playing on their cell phones, looking down, and leaning on the table—in high-definition images. And the accuracy and robustness of this network is verified. Compared with small-object detection algorithms such as Faster R-CNN, YOLOv5, and YOLOv8s, this network demonstrates good detection performance on low-resolution small objects, complex datasets with numerous targets, occlusion, and overlapping students.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Key Laboratory of Computer Science, Kunming University of Science and Technology, Kunming 650500, China.
- School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China.
- Informationization Construction Management Center, Kunming University of Science and Technology, Kunming 650500, China.
ORCID-Profile: Shoulin Wei, Wei Dai
Förderung
- GuiFuZhu,WeiDai
- WeiDai
- Yunnan Provincial Department of Education Science Research Fund Project
- National Natural Science Foundation of China
Zitieren
APA
Zhang, X., Nie, J., Wei, S., Zhu, G., Dai, W., & Yang, C. (2024). A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection. Sensors, 24(17), 5640. https://doi.org/10.3390/s24175640
Vancouver
Zhang X, Nie J, Wei S, Zhu G, Dai W, Yang C. A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection. Sensors. 2024;24(17):5640. doi:10.3390/s24175640
BibTeX
@article{Zhang2024,
author = {Zhang, Xiaoli and Nie, Jialei and Wei, Shoulin and Zhu, Guifu and Dai, Wei and Yang, Can},
title = {A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection},
journal = {Sensors},
year = {2024},
volume = {24},
number = {17},
pages = {5640},
doi = {10.3390/s24175640}
}
EUVIMED