EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

UniffordInteractor: Reasoning the Unified Affordance for Human and Multi-Object Interaction

Chen Su, Xingqun Qi, Xurui Hu, Bingkun Yang, Muyi Sun, Man Zhang, Zhenan Sun

ACM Transactions on Graphics · 09.11.2026 · 45 (6) · 1-13

DOI: 10.1145/3842530 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 09.11.2026. Verfasst von Chen Su und 6 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: NSFC.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deriving plausible and dynamic Human Object Interaction (HOI) has gained tremendous progress in Embodied AI and Immersive AR/VR. While existing HOI methods have effectively explored human interaction with individual or fixed objects, they still show limitations in complex multi-object interaction scenes. Meanwhile, previous approaches focus more on the contact information held by human-object relation, overlooking the significance of the contact situation of various entities ( i.e. , object-object). To address these limitations, we propose UniffordInteractor , a Reasoning-then-Interacting framework that leverages unified affordance for realistic and long-horizon human and multi-object interaction modeling. At the reasoning stage, we devise a Unified Affordance Reasoner (UAR) that employs a fine-tuned 3D Multimodal Large Language Model for unified object-centric affordance prediction. At the interacting stage, we propose Hierarchical Interaction Generator (HIG) , which formulates the interaction generation as a hierarchical ( e.g. , root→body→hand→objects) autoregressive prediction, conditioned on the obtained unified affordance. Extensive experiments demonstrate that UniffordInteractor surpasses SOTA counterparts in human and multi-object interaction generation. Our project page is available at this site. Code and dataset will be released upon publication.

Förderung

  • NSFC

Zitieren

APA

Su, C., Qi, X., Hu, X., Yang, B., Sun, M., Zhang, M., & Sun, Z. (2026). UniffordInteractor: Reasoning the Unified Affordance for Human and Multi-Object Interaction. ACM Transactions on Graphics, 45(6), 1-13. https://doi.org/10.1145/3842530

Vancouver

Su C, Qi X, Hu X, Yang B, Sun M, Zhang M, et al. UniffordInteractor: Reasoning the Unified Affordance for Human and Multi-Object Interaction. ACM Transactions on Graphics. 2026;45(6):1-13. doi:10.1145/3842530

BibTeX
@article{Su2026,
  author = {Su, Chen and Qi, Xingqun and Hu, Xurui and Yang, Bingkun and Sun, Muyi and Zhang, Man and Sun, Zhenan},
  title = {UniffordInteractor: Reasoning the Unified Affordance for Human and Multi-Object Interaction},
  journal = {ACM Transactions on Graphics},
  year = {2026},
  volume = {45},
  number = {6},
  pages = {1--13},
  doi = {10.1145/3842530}
}
Kostenlos starten →