EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

GeCHO: Generation of Contextualized Human–Object Interactions

Giovanni Minelli, Andrea Benericetti, Leonardo Taccari, Francesco Sambo, Samuele Salti

IEEE Access · 2026 · 14 · 48872-48886

DOI: 10.1109/access.2026.3678513 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Giovanni Minelli und 4 weiteren Autor:innen. Die Arbeit nennt 93 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Creating realistic human-world interactions with diffusion models remains a key challenge, often requiring tedious trial-and-error processes and iterative manual refinements to achieve the desired result. Current approaches either fail to seamlessly integrate new content while maintaining global consistency of the scene, or require time-consuming editing and prompt engineering, making the process impractical for large-scale applications. To address this challenge, we propose an inpainting approach that specifically tackles the complexities of generating contextual human-object interactions, which we refer to as GeCHO. Our method improves local object fidelity and global scene consistency by leveraging cross-attention maps for automated, annotation-free object placement and using ControlNet to ensure precise spatial localization. We demonstrate the practical impact of our approach through two key applications: natural image inpainting, where we achieve contextual object placement with flexible spatial control, and human-object interaction detection, where we address the problem of long-tail distributions through synthetic data generation. Our results show that the proposed method enhances realism and adherence of generated images to text prompts, simplifies the generation of complex scenes without extensive input engineering, and improves performance in computer vision tasks limited by data scarcity. The source code implementation is available here: https://github.com/johnMinelli/gecho

Zitieren

APA

Minelli, G., Benericetti, A., Taccari, L., Sambo, F., & Salti, S. (2026). GeCHO: Generation of Contextualized Human–Object Interactions. IEEE Access, 14, 48872-48886. https://doi.org/10.1109/access.2026.3678513

Vancouver

Minelli G, Benericetti A, Taccari L, Sambo F, Salti S. GeCHO: Generation of Contextualized Human–Object Interactions. IEEE Access. 2026;14:48872-48886. doi:10.1109/access.2026.3678513

BibTeX
@article{Minelli2026,
  author = {Minelli, Giovanni and Benericetti, Andrea and Taccari, Leonardo and Sambo, Francesco and Salti, Samuele},
  title = {GeCHO: Generation of Contextualized Human–Object Interactions},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {48872--48886},
  doi = {10.1109/access.2026.3678513}
}
Kostenlos starten →