Frequency-aware elastic prototype boundary learning for long-tailed scene graph generation
Journal of King Saud University Computer and Information Sciences · 2026-09 · 38 (7)
DOI: 10.1007/s44443-026-01030-9 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 18.08.2026. Verfasst von Binghao Wang und 3 weiteren Autor:innen. Die Arbeit nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Basic Research Program of Jiangsu Province.
Abstract (Originalsprache)
Scene graph generation (SGG) addresses the task of detecting objects in an image and predicting the relationships among them. Although prototype-based methods have recently achieved clear progress on long-tailed SGG, fine-grained low-frequency predicates remain difficult to recognize because their relation features often exhibit larger intra-class variation and more dispersed distributions, making them easily confused with semantically similar high-frequency coarse-grained predicates under a unified prototype-matching rule. To alleviate this issue, we propose a frequency-aware elastic prototype boundary learning framework, termed SGE-Net. Under fixed relation prototypes, the framework learns relation-category-specific boundary scales through explicit frequency compensation and frequency-adaptive virtual sampling, so that relation prediction can exploit not only prototype-center matching but also category-dependent decision-boundary information. During inference, we further introduce elastic boundary-aware distance calibration, enabling the boundary information learned during training to better distinguish relation categories that are easily confused under prototype matching. In addition, we combine visual and semantic features with dynamic gating to provide more reliable relation features for the above boundary learning. Experiments and analyses on Visual Genome and Open Images V6 demonstrate that the proposed method achieves consistent gains in both long-tailed relation prediction and overall evaluation metrics.
Förderung
- Basic Research Program of Jiangsu Province
Zitieren
APA
Wang, B., Sun, X., Dai, H., & Shi, Y. (2026). Frequency-aware elastic prototype boundary learning for long-tailed scene graph generation. Journal of King Saud University Computer and Information Sciences, 38(7). https://doi.org/10.1007/s44443-026-01030-9
Vancouver
Wang B, Sun X, Dai H, Shi Y. Frequency-aware elastic prototype boundary learning for long-tailed scene graph generation. Journal of King Saud University Computer and Information Sciences. 2026;38(7). doi:10.1007/s44443-026-01030-9
BibTeX
@article{Wang2026,
author = {Wang, Binghao and Sun, Xueying and Dai, Hanzhu and Shi, Yuqi},
title = {Frequency-aware elastic prototype boundary learning for long-tailed scene graph generation},
journal = {Journal of King Saud University Computer and Information Sciences},
year = {2026},
volume = {38},
number = {7},
doi = {10.1007/s44443-026-01030-9}
}
EUVIMED