EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Enhanced ENCODER for Composed Thangka Image Retrieval via Domain Adaptation and Hierarchical Text Alignment

Molion Syahputra Mulya, Cendra Putra

Journal of Artificial Intelligence and Data Science · 2026

DOI: 10.67561/jaids.v2i1.4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Artificial Intelligence and Data Science, 2026. Verfasst von Molion Syahputra Mulya und 1 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Composed image retrieval (CIR) for Thangka imagery presents a challenging domain gap: queries combine a sketch with hierarchical natural language descriptions, yet general-purpose vision–language models struggle with the dense iconographic structures of this culturally specific domain. This paper proposes four parameter-efficient modifications to ENCODER, the strongest supervised baseline on the CIRThan benchmark: Cross-Domain Projection (CDP) residual adapters, Level-Aware Tags (LAT), Hard Negative Mining (HNM), and UCDR Domain Prompts. All modifications are integrated via component-level code transplantation and fine-tuned for 20 epochs on a Kaggle Tesla T4 GPU. Our re-run of ENCODER achieves 52.91% average R@1. UCDR domain prompts alone contribute the largest single gain (+1.43 pp), more than the other three modifications combined (+0.31 pp), confirming that visual domain adaptation is the primary bottleneck. The full model (UCDR+CDP+LAT+HNM) achieves 55.61% average R@1 (+2.70 pp over baseline), adding only 2.23M trainable parameters to the 151M frozen CLIP backbone. A full component-wise ablation across 16 variants shows that all top 5 combinations include UCDR domain prompts. Multi-seed evaluation across three random seeds further shows that ENCODER+CDP+LAT+HNM achieves the best single-seed result of 58.95% average R@1 (seed 123), while the full model maintains more consistent performance across seeds (53.14%–56.09%). The L3–L1 spread narrows from 4.06 pp (ENCODER) to 1.67 pp (full model), indicating improved handling of coarse-level queries.

Zitieren

APA

Mulya, M. S., & Putra, C. (2026). Enhanced ENCODER for Composed Thangka Image Retrieval via Domain Adaptation and Hierarchical Text Alignment. Journal of Artificial Intelligence and Data Science. https://doi.org/10.67561/jaids.v2i1.4

Vancouver

Mulya MS, Putra C. Enhanced ENCODER for Composed Thangka Image Retrieval via Domain Adaptation and Hierarchical Text Alignment. Journal of Artificial Intelligence and Data Science. 2026. doi:10.67561/jaids.v2i1.4

BibTeX
@article{Mulya2026,
  author = {Mulya, Molion Syahputra and Putra, Cendra},
  title = {Enhanced ENCODER for Composed Thangka Image Retrieval via Domain Adaptation and Hierarchical Text Alignment},
  journal = {Journal of Artificial Intelligence and Data Science},
  year = {2026},
  doi = {10.67561/jaids.v2i1.4}
}
Kostenlos starten →