A Study of ConvNeXt Architectures for Enhanced Image Captioning
IEEE Access · 2024 · 12 · 13711-13728
DOI: 10.1109/access.2024.3356551 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2024. Verfasst von Leo Ramos und 4 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 34 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
This study explores the effectiveness of the ConvNeXt model, an advanced computer vision architecture, in the task of image captioning. We integrated ConvNeXt with a Long Short-Term Memory network that includes a visual attention module, focusing on assessing its performance across different scenarios. Experiments were conducted using various ConvNeXt versions for feature extraction, different learning rates during the training phase were tested, and the impact of including or excluding teacher-forcing was analyzed. The MS COCO 2014 dataset was employed, with top-5 accuracy and BLEU metrics used to evaluate performance. The implementation of ConvNeXt in image captioning systems reveals notable performance enhancements. In terms of BLEU-4 scores, ConvNeXt outperformed existing benchmarks by 43.04% for models using soft-attention and by 39.04% for those with hard-attention mechanisms. Furthermore, ConvNeXt surpassed models based on vision transformers and data-efficient image transformers by 4.57% and 0.93%, respectively, in BLEU-4 scores. When compared with systems using encoders such as ResNet-101, ResNet-152, VGG-16, ResNeXt-101, and MobileNet V3, ConvNeXt achieved higher top-5 accuracy improvements of 6.44%, 6.46%, 6.47%, 6.39%, and 6.68%, and reduced loss by 18.46%, 18.44%, 18.46%, 18.24%, and 18.72%, respectively.
Zitieren
APA
Ramos, L., Casas, E., Romero, C., Rivas-Echeverría, F., & Morocho-Cayamcela, M. E. (2024). A Study of ConvNeXt Architectures for Enhanced Image Captioning. IEEE Access, 12, 13711-13728. https://doi.org/10.1109/access.2024.3356551
Vancouver
Ramos L, Casas E, Romero C, Rivas-Echeverría F, Morocho-Cayamcela ME. A Study of ConvNeXt Architectures for Enhanced Image Captioning. IEEE Access. 2024;12:13711-13728. doi:10.1109/access.2024.3356551
BibTeX
@article{Ramos2024,
author = {Ramos, Leo and Casas, Edmundo and Romero, Cristian and Rivas-Echeverría, Francklin and Morocho-Cayamcela, Manuel Eugenio},
title = {A Study of ConvNeXt Architectures for Enhanced Image Captioning},
journal = {IEEE Access},
year = {2024},
volume = {12},
pages = {13711--13728},
doi = {10.1109/access.2024.3356551}
}
EUVIMED