Deep Learning Approaches on Image Captioning: A Review
ACM Computing Surveys · 31.03.2024 · 56 (3) · 1-39
DOI: 10.1145/3617592 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 05.10.2023. Verfasst von Taraneh Ghandi und 2 weiteren Autor:innen. Die Arbeit wurde bisher 190-mal zitiert (Crossref) und nennt 149 Literaturangaben.
Abstract (Originalsprache)
Image captioning is a research area of immense importance, aiming to generate natural language descriptions for visual content in the form of still images. The advent of deep learning and more recently vision-language pre-training techniques has revolutionized the field, leading to more sophisticated methods and improved performance. In this survey article, we provide a structured review of deep learning methods in image captioning by presenting a comprehensive taxonomy and discussing each method category in detail. Additionally, we examine the datasets commonly employed in image captioning research, as well as the evaluation metrics used to assess the performance of different captioning models. We address the challenges faced in this field by emphasizing issues such as object hallucination, missing context, illumination conditions, contextual understanding, and referring expressions. We rank different deep learning methods’ performance according to widely used evaluation metrics, giving insight into the current state-of-the-art. Furthermore, we identify several potential future directions for research in this area, which include tackling the information misalignment problem between image and text modalities, mitigating dataset bias, incorporating vision-language pre-training methods to enhance caption generation, and developing improved evaluation tools to accurately measure the quality of image captions.
Zitieren
APA
Ghandi, T., Pourreza, H., & Mahyar, H. (2024). Deep Learning Approaches on Image Captioning: A Review. ACM Computing Surveys, 56(3), 1-39. https://doi.org/10.1145/3617592
Vancouver
Ghandi T, Pourreza H, Mahyar H. Deep Learning Approaches on Image Captioning: A Review. ACM Computing Surveys. 2024;56(3):1-39. doi:10.1145/3617592
BibTeX
@article{Ghandi2024,
author = {Ghandi, Taraneh and Pourreza, Hamidreza and Mahyar, Hamidreza},
title = {Deep Learning Approaches on Image Captioning: A Review},
journal = {ACM Computing Surveys},
year = {2024},
volume = {56},
number = {3},
pages = {1--39},
doi = {10.1145/3617592}
}
EUVIMED