EUVIMEDEUVIMED entdecken
Crossref

End-to-End One-Shot Human Parsing

Haoyu He, Jing Zhang, Bohan Zhuang, Jianfei Cai, Dacheng Tao

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2023

DOI: 10.1109/tpami.2023.3301672 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2023. Verfasst von Haoyu He und 4 weiteren Autor:innen. Hauptthemen laut MEDLINE: Algorithms, Benchmarking. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 89 Literaturangaben. Gefördert von: ARC, University of Sydney.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Previous human parsing methods are limited to parsing humans into pre-defined classes, which is inflexible for practical fashion applications that often have new fashion item classes. In this paper, we define a novel one-shot human parsing (OSHP) task that requires parsing humans into an open set of classes defined by any test example. During training, only base classes are exposed, which only overlap with part of the test-time classes. To address three main challenges in OSHP, i.e., small sizes, testing bias, and similar parts, we devise an End-to-end One-shot human Parsing Network (EOP-Net). Firstly, an end-to-end human parsing framework is proposed to parse the query image into both coarse-grained and fine-grained human classes, which embeds rich semantic information that is shared across different granularities to identify the small-sized human classes. Then, we gradually smooth the training-time static prototypes to get robust class representations. Moreover, we employ a dynamic objective to encourage the network enhancing features' representational capability in the early training phase while improving features' transferability in the late training phase. Therefore, our method can quickly adapt to the novel classes and mitigate the testing bias issue. In addition, we add a contrastive loss at the prototype level to enforce inter-class distances, thereby discriminating the similar parts. For comprehensive evaluations on the new task, we tailor three existing popular human parsing benchmarks to the OSHP task. Experiments demonstrate that EOP-Net outperforms representative one-shot segmentation models by large margins and serves as a strong baseline for further research.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsBenchmarkingHumansSemantics

Förderung

  • ARC
  • University of Sydney

Zitieren

APA

He, H., Zhang, J., Zhuang, B., Cai, J., & Tao, D. (2023). End-to-End One-Shot Human Parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence. https://doi.org/10.1109/tpami.2023.3301672

Vancouver

He H, Zhang J, Zhuang B, Cai J, Tao D. End-to-End One-Shot Human Parsing. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2023. doi:10.1109/tpami.2023.3301672

BibTeX
@article{He2023,
  author = {He, Haoyu and Zhang, Jing and Zhuang, Bohan and Cai, Jianfei and Tao, Dacheng},
  title = {End-to-End One-Shot Human Parsing},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2023},
  doi = {10.1109/tpami.2023.3301672}
}
Kostenlos starten →