EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

A Study of ConvNeXt Architectures for Enhanced Image Captioning

Leo Ramos, Edmundo Casas, Cristian Romero, Francklin Rivas-Echeverría, Manuel Eugenio Morocho-Cayamcela

IEEE Access · 2024 · 12 · 13711-13728

DOI: 10.1109/access.2024.3356551 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Leo Ramos und 4 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study explores the effectiveness of the ConvNeXt model, an advanced computer vision architecture, in the task of image captioning. We integrated ConvNeXt with a Long Short-Term Memory network that includes a visual attention module, focusing on assessing its performance across different scenarios. Experiments were conducted using various ConvNeXt versions for feature extraction, different learning rates during the training phase were tested, and the impact of including or excluding teacher-forcing was analyzed. The MS COCO 2014 dataset was employed, with top-5 accuracy and BLEU metrics used to evaluate performance. The implementation of ConvNeXt in image captioning systems reveals notable performance enhancements. In terms of BLEU-4 scores, ConvNeXt outperformed existing benchmarks by 43.04% for models using soft-attention and by 39.04% for those with hard-attention mechanisms. Furthermore, ConvNeXt surpassed models based on vision transformers and data-efficient image transformers by 4.57% and 0.93%, respectively, in BLEU-4 scores. When compared with systems using encoders such as ResNet-101, ResNet-152, VGG-16, ResNeXt-101, and MobileNet V3, ConvNeXt achieved higher top-5 accuracy improvements of 6.44%, 6.46%, 6.47%, 6.39%, and 6.68%, and reduced loss by 18.46%, 18.44%, 18.46%, 18.24%, and 18.72%, respectively.

Zitieren

APA

Ramos, L., Casas, E., Romero, C., Rivas-Echeverría, F., & Morocho-Cayamcela, M. E. (2024). A Study of ConvNeXt Architectures for Enhanced Image Captioning. IEEE Access, 12, 13711-13728. https://doi.org/10.1109/access.2024.3356551

Vancouver

Ramos L, Casas E, Romero C, Rivas-Echeverría F, Morocho-Cayamcela ME. A Study of ConvNeXt Architectures for Enhanced Image Captioning. IEEE Access. 2024;12:13711-13728. doi:10.1109/access.2024.3356551

BibTeX
@article{Ramos2024,
  author = {Ramos, Leo and Casas, Edmundo and Romero, Cristian and Rivas-Echeverría, Francklin and Morocho-Cayamcela, Manuel Eugenio},
  title = {A Study of ConvNeXt Architectures for Enhanced Image Captioning},
  journal = {IEEE Access},
  year = {2024},
  volume = {12},
  pages = {13711--13728},
  doi = {10.1109/access.2024.3356551}
}
Kostenlos starten →