Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detection
International Journal of Computer Vision · 2026-06 · 134 (6)
DOI: 10.1007/s11263-026-02838-8 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Computer Vision, online erschienen am 20.05.2026. Verfasst von Rosario Leonardi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 72 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministero dell’Università e della Ricerca.
Abstract (Originalsprache)
In this work, we explore the role of synthetic data in improving the detection of Hand-Object Interactions from egocentric images. Through extensive experimentation and comparative analysis on VISOR , EgoHOS , and ENIGMA-51 datasets, our findings demonstrate the potential of synthetic data to significantly improve HOI detection, particularly when real labeled data are scarce or unavailable. By using synthetic data and only $$10\%$$ 10 % of the real labeled data, we achieve improvements in Overall AP over models trained exclusively on real data, with gains of $$+5.67\%$$ + 5.67 % on VISOR , $$+8.24\%$$ + 8.24 % on EgoHOS , and $$+11.69\%$$ + 11.69 % on ENIGMA-51 . Furthermore, we systematically study how aligning synthetic data to specific real-world benchmarks with respect to objects, grasps, and environments, showing that the effectiveness of synthetic data consistently improves with better synthetic-real alignment. As a result of this work, we release a new data generation pipeline and the new HOI-Synth benchmark, which augments existing datasets with synthetic images of hand-object interaction. These data are automatically annotated with hand-object contact states, bounding boxes, and pixel-wise segmentation masks. All data, code, and tools for synthetic data generation are available at: https://fpv-iplab.github.io/HOI-Synth/ .
Förderung
- Ministero dell’Università e della Ricerca
Zitieren
APA
Leonardi, R., Furnari, A., Ragusa, F., & Farinella, G. M. (2026). Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detection. International Journal of Computer Vision, 134(6). https://doi.org/10.1007/s11263-026-02838-8
Vancouver
Leonardi R, Furnari A, Ragusa F, Farinella GM. Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detection. International Journal of Computer Vision. 2026;134(6). doi:10.1007/s11263-026-02838-8
BibTeX
@article{Leonardi2026,
author = {Leonardi, Rosario and Furnari, Antonino and Ragusa, Francesco and Farinella, Giovanni Maria},
title = {Leveraging Synthetic Data for Enhancing Egocentric Hand-Object Interaction Detection},
journal = {International Journal of Computer Vision},
year = {2026},
volume = {134},
number = {6},
doi = {10.1007/s11263-026-02838-8}
}
EUVIMED