Style-Abstraction-Based Data Augmentation for Robust Affective Computing
Applied Sciences · 23.03.2026 · 16 (6) · 3109
DOI: 10.3390/app16063109 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 23.03.2026. Verfasst von Xu Qiu und 2 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Korea government.
Abstract (Originalsprache)
Personality recognition and emotion recognition, two core tasks within affective computing, are fundamentally constrained by data scarcity as collecting and annotating human behavioral data is expensive and restricted by privacy concerns. Under these limited data conditions, existing models tend to rely on superficial shortcut features such as background appearance, lighting conditions, or color variations, rather than behavior-relevant cues including facial expressions, posture, and motion dynamics. To address this issue, we propose Style-Abstraction-based Data Augmentation, a style transfer-based augmentation strategy that reduces dependency on low-level appearance information while preserving high-level semantic cues. Specifically, we employ cartoonization to generate stylized variants of training videos that retain expressive characteristics but remove stylistic bias. We validate our approach on three diverse personality benchmarks (First Impression v2, UDIVA v0.5, and KETI) and emotion benchmark(Emotion Dataset) using state-of-the-art models including ViViT (Video Vision Transformer), TimeSformer, and VST (Video Swin Transformer). Our experiments indicate that increasing the proportion of style-abstracted data in the training set can improve performance on the evaluated datasets. Notably, our method yields consistent gains across all benchmarks: a 0.0893 reduction in MSE on UDIVA v0.5 (with VST), a 0.0023 improvement in 1-MAE on KETI (with TimeSformer), and a 0.0051 improvement on First Impression v2 (with TimeSformer). Furthermore, extending style-abstraction-based data augmentation to a four-class categorical emotion recognition task demonstrates similar performance gains, achieving up to a 3.44% accuracy increase with the TimeSformer backbone. These findings verify that our style-abstraction-based data augmentation facilitates learning of behavior-relevant features by reducing reliance on superficial shortcuts. Overall, cartoonization-based style abstraction for data augmentation functions as both an effective augmentation strategy and a regularization mechanism, encouraging the model to learn more stable and generalizable representations for affective computing applications.
Förderung
- Korea government
Zitieren
APA
Qiu, X., Kim, T., & Kim, B. (2026). Style-Abstraction-Based Data Augmentation for Robust Affective Computing. Applied Sciences, 16(6), 3109. https://doi.org/10.3390/app16063109
Vancouver
Qiu X, Kim T, Kim B. Style-Abstraction-Based Data Augmentation for Robust Affective Computing. Applied Sciences. 2026;16(6):3109. doi:10.3390/app16063109
BibTeX
@article{Qiu2026,
author = {Qiu, Xu and Kim, Taewan and Kim, Bongjae},
title = {Style-Abstraction-Based Data Augmentation for Robust Affective Computing},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {6},
pages = {3109},
doi = {10.3390/app16063109}
}
EUVIMED