EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Enhancing Semantic Coherence in Image Captioning via a Parameter-Efficient Refinement Framework

Huynh Anh Ngan Ha, Lam Hoang Phu Bui, Minh Sam Lam, Thi Dinh Nguyen

Journal of Technical Education Science · 23.06.2026

DOI: 10.54644/jte.2026.2126 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Technical Education Science, online erschienen am 23.06.2026. Verfasst von Huynh Anh Ngan Ha und 3 weiteren Autor:innen. Die Arbeit nennt 22 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large-scale pre-trained visual-linguistic models have achieved significant progress in image annotation generation. However, the generated descriptions often suffer from limitations in semantic consistency, a lack of key image elements, and structural coherence. To overcome these limitations without requiring high-cost end-to-end refinement, this study proposes a two-stage parameter-efficient refinement framework. In the first stage, the pre-trained visual-linguistic model is fixed to generate initial annotations from the input image. In the second stage, the problem is redefined as a conditional text generation task, where the pre-trained linguistic model is adjusted using low-order adaptive techniques to improve grammatical structure and enhance semantic coherence, while preserving previously learned knowledge. Experimental results on the Flickr30k dataset, using BLEU-n and METEOR scales, demonstrate that the proposed method significantly enhances the quality of expression and semantic consistency compared to the baseline model, while maintaining a low number of trained parameters. The proposed framework offers a cost-effective solution for enhancing the quality of semantically oriented annotations, and also lays the groundwork for further research on fine-tuning efficient parameters in multimodal language generation models.

Zitieren

APA

Ha, H. A. N., Bui, L. H. P., Lam, M. S., & Nguyen, T. D. (2026). Enhancing Semantic Coherence in Image Captioning via a Parameter-Efficient Refinement Framework. Journal of Technical Education Science. https://doi.org/10.54644/jte.2026.2126

Vancouver

Ha HAN, Bui LHP, Lam MS, Nguyen TD. Enhancing Semantic Coherence in Image Captioning via a Parameter-Efficient Refinement Framework. Journal of Technical Education Science. 2026. doi:10.54644/jte.2026.2126

BibTeX
@article{Ha2026,
  author = {Ha, Huynh Anh Ngan and Bui, Lam Hoang Phu and Lam, Minh Sam and Nguyen, Thi Dinh},
  title = {Enhancing Semantic Coherence in Image Captioning via a Parameter-Efficient Refinement Framework},
  journal = {Journal of Technical Education Science},
  year = {2026},
  doi = {10.54644/jte.2026.2126}
}
Kostenlos starten →