EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Improving YOLOv7 for Large Target Classroom Behavior Recognition of Teachers in Smart Classroom Scenarios

Long Ma, Tao Zhou, Baohua Yu, Zhigang Li, Rencheng Fang, Xinqi Liu

Electronics · 20.09.2024 · 13 (18) · 3726

DOI: 10.3390/electronics13183726 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 20.09.2024. Verfasst von Long Ma und 5 weiteren Autor:innen. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 44 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, the Bing-tuan Science and Technology Public Relations Project “A Data-driven Regional Smart Education Service Key Technology Research and Application Demonstra….

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep learning technology has recently become increasingly prevalent in the field of education due to the rapid growth of artificial intelligence. Teachers’ teaching behavior is a crucial component of classroom teaching activities, and identifying and examining teachers’ classroom teaching behavior is an important way to assess teaching. However, the traditional teaching evaluation method involves evaluating by either listening to the class on-site or playing back the teaching video afterward, which is a time-consuming and inefficient manual method. Therefore, this paper obtained teaching behavior data from a real smart classroom scenario and observed and analyzed the teacher behavior characteristics in this scenario. Aiming at the problems of complex classroom environments and the high similarity between teaching behavior classes, a method to improve YOLOv7 for large target classroom behavior recognition in smart classroom scenarios is proposed. First, we constructed the Teacher Classroom Behavior Data Set (TCBDS), which contains 6660 images covering six types of teaching behaviors: facing the board (to_blackboard, tb), facing the students (to_student, ts), writing on the board (writing, w), teaching while facing the board (black_teach, bt), teaching while facing the students (student_teach, st), and interactive (interact, i). This research adds a large target detection layer to the backbone network so that teachers’ instructional behaviors can be efficiently identified in complex classroom circumstances. Second, the original model’s backbone was extended with an effective multiscale attention module (EMA) to construct cross-scale feature dependencies under various branches. Finally, the bounding box loss function of the original model was replaced with MPDIoU, and a bounding box scaling factor was introduced to propose the Inner_MPDIoU loss function. Experiments were conducted using the TCBDS dataset. The method proposed in this study achieved mAP@.50, mAP@.50:.95, and recall values of 96.2%, 82.5%, and 92.9%, respectively—improvements of 1.1%, 2.0%, and 2.3% over the original model. This method outperformed other mainstream models compared to the current state of the art. The experimental results demonstrate the method’s excellent performance, its ability to identify various classroom behaviors of teachers in realistic scenarios, and its potential to facilitate the analysis and visualization of teacher classroom behaviors.

Förderung

  • National Natural Science Foundation of China
  • the Bing-tuan Science and Technology Public Relations Project “A Data-driven Regional Smart Education Service Key Technology Research and Application Demonstra…

Zitieren

APA

Ma, L., Zhou, T., Yu, B., Li, Z., Fang, R., & Liu, X. (2024). Improving YOLOv7 for Large Target Classroom Behavior Recognition of Teachers in Smart Classroom Scenarios. Electronics, 13(18), 3726. https://doi.org/10.3390/electronics13183726

Vancouver

Ma L, Zhou T, Yu B, Li Z, Fang R, Liu X. Improving YOLOv7 for Large Target Classroom Behavior Recognition of Teachers in Smart Classroom Scenarios. Electronics. 2024;13(18):3726. doi:10.3390/electronics13183726

BibTeX
@article{Ma2024,
  author = {Ma, Long and Zhou, Tao and Yu, Baohua and Li, Zhigang and Fang, Rencheng and Liu, Xinqi},
  title = {Improving YOLOv7 for Large Target Classroom Behavior Recognition of Teachers in Smart Classroom Scenarios},
  journal = {Electronics},
  year = {2024},
  volume = {13},
  number = {18},
  pages = {3726},
  doi = {10.3390/electronics13183726}
}
Kostenlos starten →