Frame Importance Voting for Video Scene Classification
JOIV : International Journal on Informatics Visualization · 31.07.2026 · 10 (4) · 1635
DOI: 10.62527/joiv.10.4.5988 ↗Kurz gefasst
Fachartikel in der Zeitschrift JOIV : International Journal on Informatics Visualization, online erschienen am 31.07.2026. Verfasst von Yahya Albugg und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).
Abstract (Originalsprache)
Classification of video data is challenging due to the temporally repeated measures and the differential importance of different frames in a video clip. This paper proposes a framework called Frame Importance Voting (FIV), where frame importance weighting and voting are merged as part of a shared inference process to enhance the temporal classification of video data without additional computational burden. Spatial video features were extracted from the video clips using a ResNet-50 architecture, and the temporal relationships were modeled using a two-layer transform encoder. Frame significance was derived adaptively by summing the transformer's attention and confidence scores for each frame, and predictions for categories were made by summing the frame predictions using weighted voting. Results on Kinetics-400 (50 categories, 10,000 clips, 16-32 frames per video) confirmed that FIV achieved 77.4% top-1, 92.5% top-5, and 76.8% top-1, outperforming the aggregators by up to 5.6% (using about 37 million parameters).
Zitieren
APA
Albugg, Y., Alsaleem, M. Y. A., & Hasan, O. S. (2026). Frame Importance Voting for Video Scene Classification. JOIV : International Journal on Informatics Visualization, 10(4), 1635. https://doi.org/10.62527/joiv.10.4.5988
Vancouver
Albugg Y, Alsaleem MYA, Hasan OS. Frame Importance Voting for Video Scene Classification. JOIV : International Journal on Informatics Visualization. 2026;10(4):1635. doi:10.62527/joiv.10.4.5988
BibTeX
@article{Albugg2026,
author = {Albugg, Yahya and Alsaleem, Maan Y Anad and Hasan, Omar Shakir},
title = {Frame Importance Voting for Video Scene Classification},
journal = {JOIV : International Journal on Informatics Visualization},
year = {2026},
volume = {10},
number = {4},
pages = {1635},
doi = {10.62527/joiv.10.4.5988}
}
EUVIMED