EUVIMEDEUVIMED entdecken
Crossref

EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning

Xuehao Gao, Yang Yang, Shaoyi Du, Yang Wu, Yebin Liu, Guo-Jun Qi

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2025 · 1-15

DOI: 10.1109/tpami.2025.3573414 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2025. Verfasst von Xuehao Gao und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This paper explores a cross-modality synthesis task that infers 3D human-object interactions (HOIs) from a given text-based instruction. Existing text-to-HOI synthesis methods mainly deploy a direct mapping from texts to object-specific 3D body motions, which may encounter a performance bottleneck since the huge cross-modality gap. In this paper, we observe that those HOI samples with the same interaction intention toward different targets, e.g., "lift a chair" and "lift a cup", always encapsulate similar action-specific body motion patterns while characterizing different object-specific interaction styles. Thus, learning effective action-specific motion priors and object-specific interaction priors is crucial for a text-to-HOI model and dominates its performances on text-HOI semantic consistency and body-object interaction realism. In light of this, we propose a novel body pose generation strategy for the text-to-HOI task: infer object-agnostic canonical body action first and then enrich object-specific interaction styles. Specifically, the first canonical body action inference stage focuses on learning intra-class shareable body motion priors and mapping given text-based semantics to action-specific canonical 3D body motions. Then, in the object-specific interaction inference stage, we focus on object affordance learning and enrich object-specific interaction styles on an inferred action-specific body motion basis. Extensive experiments verify that our proposed text-to-HOI synthesis system significantly outperforms other SOTA methods on three large-scale datasets with better semantic consistency and interaction realism performances.

Zitieren

APA

Gao, X., Yang, Y., Du, S., Wu, Y., Liu, Y., & Qi, G. J. (2025). EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning. IEEE Transactions on Pattern Analysis and Machine Intelligence, 1-15. https://doi.org/10.1109/tpami.2025.3573414

Vancouver

Gao X, Yang Y, Du S, Wu Y, Liu Y, Qi GJ. EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2025:1-15. doi:10.1109/tpami.2025.3573414

BibTeX
@article{Gao2025,
  author = {Gao, Xuehao and Yang, Yang and Du, Shaoyi and Wu, Yang and Liu, Yebin and Qi, Guo-Jun},
  title = {EigenActor: Variant Body-Object Interaction Generation Evolved from Invariant Action Basis Reasoning},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2025},
  pages = {1--15},
  doi = {10.1109/tpami.2025.3573414}
}
Kostenlos starten →