EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection

Xiaoli Zhang, Jialei Nie, Shoulin Wei iD, Guifu Zhu, Wei Dai iD, Can Yang

Sensors · 30.08.2024 · 24 (17) · 5640

DOI: 10.3390/s24175640 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 30.08.2024. Verfasst von Xiaoli Zhang und 5 weiteren Autor:innen. Beteiligte Einrichtung: Key Laboratory of Computer Science, Kunming University of Science and Technology, Kunming 650500, China. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: GuiFuZhu,WeiDai, WeiDai, Yunnan Provincial Department of Education Science Research Fund Project.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With the development of educational technology, machine learning and deep learning provide technical support for traditional classroom observation assessment. However, in real classroom scenarios, the technique faces challenges such as lack of clarity of raw images, complexity of datasets, multi-target detection errors, and complexity of character interactions. Based on the above problems, a student classroom behavior recognition network incorporating super-resolution and target detection is proposed. To cope with the problem of unclear original images in the classroom scenario, SRGAN (Super Resolution Generative Adversarial Network for Images) is used to improve the image resolution and thus the recognition accuracy. To address the dataset complexity and multi-targeting problems, feature extraction is optimized, and multi-scale feature recognition is enhanced by introducing AKConv and LASK attention mechanisms into the Backbone module of the YOLOv8s algorithm. To improve the character interaction complexity problem, the CBAM attention mechanism is integrated to enhance the recognition of important feature channels and spatial regions. Experiments show that it can detect six behaviors of students—raising their hands, reading, writing, playing on their cell phones, looking down, and leaning on the table—in high-definition images. And the accuracy and robustness of this network is verified. Compared with small-object detection algorithms such as Faster R-CNN, YOLOv5, and YOLOv8s, this network demonstrates good detection performance on low-resolution small objects, complex datasets with numerous targets, occlusion, and overlapping students.

Schlagwörter

Stichwörter der Autor:innen

character interactionclassroom behavior recognitionsuper-resolutiontarget detection

Autor:innen und Institutionen

  • Key Laboratory of Computer Science, Kunming University of Science and Technology, Kunming 650500, China.
  • School of Information Engineering and Automation, Kunming University of Science and Technology, Kunming 650500, China.
  • Informationization Construction Management Center, Kunming University of Science and Technology, Kunming 650500, China.

ORCID-Profile: Shoulin Wei, Wei Dai

Förderung

  • GuiFuZhu,WeiDai
  • WeiDai
  • Yunnan Provincial Department of Education Science Research Fund Project
  • National Natural Science Foundation of China

Zitieren

APA

Zhang, X., Nie, J., Wei, S., Zhu, G., Dai, W., & Yang, C. (2024). A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection. Sensors, 24(17), 5640. https://doi.org/10.3390/s24175640

Vancouver

Zhang X, Nie J, Wei S, Zhu G, Dai W, Yang C. A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection. Sensors. 2024;24(17):5640. doi:10.3390/s24175640

BibTeX
@article{Zhang2024,
  author = {Zhang, Xiaoli and Nie, Jialei and Wei, Shoulin and Zhu, Guifu and Dai, Wei and Yang, Can},
  title = {A Study of Classroom Behavior Recognition Incorporating Super-Resolution and Target Detection},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {17},
  pages = {5640},
  doi = {10.3390/s24175640}
}
Kostenlos starten →