EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detection

Rosario Leonardi, Antonino Furnari, Francesco Ragusa, Giovanni Maria Farinella

International Journal of Computer Vision · 2026-06 · 134 (6)

DOI: 10.1007/s11263-026-02838-8 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Computer Vision, online erschienen am 20.05.2026. Verfasst von Rosario Leonardi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministero dell’Università e della Ricerca.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this work, we explore the role of synthetic data in improving the detection of Hand-Object Interactions from egocentric images. Through extensive experimentation and comparative analysis on VISOR , EgoHOS , and ENIGMA-51 datasets, our findings demonstrate the potential of synthetic data to significantly improve HOI detection, particularly when real labeled data are scarce or unavailable. By using synthetic data and only $$10\%$$ 10 % of the real labeled data, we achieve improvements in Overall AP over models trained exclusively on real data, with gains of $$+5.67\%$$ + 5.67 % on VISOR , $$+8.24\%$$ + 8.24 % on EgoHOS , and $$+11.69\%$$ + 11.69 % on ENIGMA-51 . Furthermore, we systematically study how aligning synthetic data to specific real-world benchmarks with respect to objects, grasps, and environments, showing that the effectiveness of synthetic data consistently improves with better synthetic-real alignment. As a result of this work, we release a new data generation pipeline and the new HOI-Synth benchmark, which augments existing datasets with synthetic images of hand-object interaction. These data are automatically annotated with hand-object contact states, bounding boxes, and pixel-wise segmentation masks. All data, code, and tools for synthetic data generation are available at: https://fpv-iplab.github.io/HOI-Synth/ .

Förderung

  • Ministero dell’Università e della Ricerca

Zitieren

APA

Leonardi, R., Furnari, A., Ragusa, F., & Farinella, G. M. (2026). Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detection. International Journal of Computer Vision, 134(6). https://doi.org/10.1007/s11263-026-02838-8

Vancouver

Leonardi R, Furnari A, Ragusa F, Farinella GM. Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detection. International Journal of Computer Vision. 2026;134(6). doi:10.1007/s11263-026-02838-8

BibTeX
@article{Leonardi2026,
  author = {Leonardi, Rosario and Furnari, Antonino and Ragusa, Francesco and Farinella, Giovanni Maria},
  title = {Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detection},
  journal = {International Journal of Computer Vision},
  year = {2026},
  volume = {134},
  number = {6},
  doi = {10.1007/s11263-026-02838-8}
}
Kostenlos starten →