Action Quality Assessment Model Using Specialists’ Gaze Location and Kinematics Data—Focusing on Evaluating Figure Skating Jumps
Sensors · 20.11.2023 · 23 (22) · 9282
DOI: 10.3390/s23229282 ↗Kurz gefasst
Fachartikel in der Zeitschrift Sensors, online erschienen am 20.11.2023. Verfasst von Seiji Hirosawa und 3 weiteren Autor:innen. Beteiligte Einrichtung: Graduate School of Science and Technology, Keio University, Yokohama 223-8522, Japan. Hauptthemen laut MEDLINE: Skating, Sports. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Action quality assessment (AQA) tasks in computer vision evaluate action quality in videos, and they can be applied to sports for performance evaluation. A typical example of AQA is predicting the final score from a video that captures an entire figure skating program. However, no previous studies have predicted individual jump scores, which are of great interest to competitors because of the high weight of competition. Despite the presence of unnecessary information in figure skating videos, human specialists can focus and reduce information when they evaluate jumps. In this study, we clarified the eye movements of figure skating judges and skaters while evaluating jumps and proposed a prediction model for jump performance that utilized specialists’ gaze location to reduce information. Kinematic features obtained from the tracking system were input into the model in addition to videos to improve accuracy. The results showed that skaters focused more on the face, whereas judges focused on the lower extremities. These gaze locations were applied to the model, which demonstrated the highest accuracy when utilizing both specialists’ gaze locations. The model outperformed human predictions and the baseline model (RMSE:0.775), suggesting a combination of human specialist knowledge and machine capabilities could yield higher accuracy.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Graduate School of Science and Technology, Keio University, Yokohama 223-8522, Japan.
- Faculty of Sport and Health Sciences, Toin University of Yokohama, Yokohama 225-8503, Japan.
- Faculty of Environment and Information Studies, Keio University, Fujisawa 252-0882, Japan.
- College of Engineering, Chubu University, Kasugai 487-8501, Japan.
ORCID-Profile: Seiji Hirosawa, Yoshimitsu Aoki
Zitieren
APA
Hirosawa, S., Kato, T., Yamashita, T., & Aoki, Y. (2023). Action Quality Assessment Model Using Specialists’ Gaze Location and Kinematics Data—Focusing on Evaluating Figure Skating Jumps. Sensors, 23(22), 9282. https://doi.org/10.3390/s23229282
Vancouver
Hirosawa S, Kato T, Yamashita T, Aoki Y. Action Quality Assessment Model Using Specialists’ Gaze Location and Kinematics Data—Focusing on Evaluating Figure Skating Jumps. Sensors. 2023;23(22):9282. doi:10.3390/s23229282
BibTeX
@article{Hirosawa2023,
author = {Hirosawa, Seiji and Kato, Takaaki and Yamashita, Takayoshi and Aoki, Yoshimitsu},
title = {Action Quality Assessment Model Using Specialists’ Gaze Location and Kinematics Data—Focusing on Evaluating Figure Skating Jumps},
journal = {Sensors},
year = {2023},
volume = {23},
number = {22},
pages = {9282},
doi = {10.3390/s23229282}
}
EUVIMED