EUVIMEDEUVIMED entdecken
Crossref

58‐2: Fine‐grained Action Detection in Visual HCI with Spatial Mask Video Foundation Models

Haiyang Guo, Lei Song, Bin Lv, Xingqun Jiang

SID Symposium Digest of Technical Papers · 2026-08 · 57 (S1) · 579-582

DOI: 10.1002/sdtp.70003_150 ↗

Kurz gefasst

Fachartikel in der Zeitschrift SID Symposium Digest of Technical Papers, online erschienen am 11.09.2026. Verfasst von Haiyang Guo und 3 weiteren Autor:innen. Die Arbeit nennt 11 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Visual human‐computer interaction (HCI) is a broad and pivotal research direction in display applications, where AI‐driven precise recognition of micro‐actions in videos enables more intelligent and natural interaction experiences for display devices. Conventional AI methods, such as using convolutional neural networks (CNNs) as feature encoders for action recognition, often suffer from limited accuracy and robustness across micro‐action and multi‐labels. To address these challenges, this paper introduces two innovations: 1) employing a video understanding large model as the foundational network for action detection, with self‐supervised pre‐training of the base model ; and 2) designing a tailored spatial mask module to precisely locate and identify actions of micro spatial variation. Experimental results on the MMAD52 dataset demonstrate that our algorithm achieves the state of the art performance of 52 micro‐actions across seven categories, This technology can be applied in multiple visual HCI scenarios such as smart display devices and embodied AI perception systems.

Zitieren

APA

Guo, H., Song, L., Lv, B., & Jiang, X. (2026). 58‐2: Fine‐grained Action Detection in Visual HCI with Spatial Mask Video Foundation Models. SID Symposium Digest of Technical Papers, 57(S1), 579-582. https://doi.org/10.1002/sdtp.70003_150

Vancouver

Guo H, Song L, Lv B, Jiang X. 58‐2: Fine‐grained Action Detection in Visual HCI with Spatial Mask Video Foundation Models. SID Symposium Digest of Technical Papers. 2026;57(S1):579-582. doi:10.1002/sdtp.70003_150

BibTeX
@article{Guo2026,
  author = {Guo, Haiyang and Song, Lei and Lv, Bin and Jiang, Xingqun},
  title = {58‐2: Fine‐grained Action Detection in Visual HCI with Spatial Mask Video Foundation Models},
  journal = {SID Symposium Digest of Technical Papers},
  year = {2026},
  volume = {57},
  number = {S1},
  pages = {579--582},
  doi = {10.1002/sdtp.70003_150}
}
Kostenlos starten →