Group Visual Relation Detection
IEEE Transactions on Image Processing · 2025 · 34 · 1645-1659
DOI: 10.1109/tip.2025.3543114 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Image Processing, 2025. Verfasst von Fan Yu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 79 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Fundamental Research Funds for the Central Universities, Collaborative Innovation Center of Novel Software Technology and Industrialization.
Abstract (Originalsprache)
In this paper, we propose a novel visual relation detection task, named Group Visual Relation Detection (GVRD), for detecting visual relations whose subjects and/or objects are groups (GVRs), inspired by the observation that groups are common in image semantic representation. GVRD can be deemed as an evolution over the existing visual relation detection task that limits both subjects and objects of visual relations as individuals. We propose a Simultaneous Group Relation Prediction (SGRP) method that can simultaneously predict groups and predicates to address GVRD. SGRP contains an Entity Construction (EC) module, a Feature Extraction (FE) module, and a Group Relation Prediction (GRP) module. Specifically, the EC module constructs instances, group candidates, and phrase candidates; the FE module extracts visual, location and semantic features for these entities; and the GRP module simultaneously predicts groups and predicates, and generates the GVRs. Moreover, we construct a new dataset, named COCO-GVR, to facilitate solutions to GVRD task, which consists of 9,570 images from COCO dataset and 31,855 manually labeled GVRs. We test and validate the performance of SGRP by extensive experiments on COCO-GVR dataset. It shows that SGRP outperforms the baselines generated from the state-of-the-art visual relation detection and scene graph generation methods.
Förderung
- National Natural Science Foundation of China
- Fundamental Research Funds for the Central Universities
- Collaborative Innovation Center of Novel Software Technology and Industrialization
Zitieren
APA
Yu, F., Zhang, B., Ren, T., Liu, J., Wu, G., & Tang, J. (2025). Group Visual Relation Detection. IEEE Transactions on Image Processing, 34, 1645-1659. https://doi.org/10.1109/tip.2025.3543114
Vancouver
Yu F, Zhang B, Ren T, Liu J, Wu G, Tang J. Group Visual Relation Detection. IEEE Transactions on Image Processing. 2025;34:1645-1659. doi:10.1109/tip.2025.3543114
BibTeX
@article{Yu2025,
author = {Yu, Fan and Zhang, Beibei and Ren, Tongwei and Liu, Jiale and Wu, Gangshan and Tang, Jinhui},
title = {Group Visual Relation Detection},
journal = {IEEE Transactions on Image Processing},
year = {2025},
volume = {34},
pages = {1645--1659},
doi = {10.1109/tip.2025.3543114}
}
EUVIMED