Penerapan CNN dan RNN untuk Pembuatan Deskripsi Konten Visual Menggunakan Deep Learning
Building of Informatics, Technology and Science (BITS) · 16.03.2025 · 6 (4) · 2573-2581
DOI: 10.47065/bits.v6i4.6958 ↗Kurz gefasst
Fachartikel in der Zeitschrift Building of Informatics, Technology and Science (BITS), online erschienen am 16.03.2025. Verfasst von Aldy Agil Hermanto und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
The development of technology in the field of image and sound processing has had a significant impact on increasing the accessibility of information for various groups, especially for individuals with visual impairments. One of the innovations that emerged was the image to speech system, which allows the conversion of images into sounds that can be understood by its users. The main problem lies in the low accuracy of object recognition in images with high variability, such as poor lighting or complex backgrounds, as well as the challenge of producing suitable text descriptions to be converted into audio. The method used involves extracting image features using InceptionV3-based CNN and forming a sequence of descriptive texts through RNN with an attention mechanism. The dataset consists of 40,455 captions and 8,091 images, processed using text and image pre-processing techniques before being trained using the teacher forcing technique. The evaluation results show a very low BLEU score (5.154827976372712e-153), indicating the model's inability to replicate the original caption well. However, the audio from the text-to-speech conversion using Google Text-to-Speech is quite clear. Future solutions include increasing the dataset, applying regularization, and adjusting the model architecture to improve the accuracy of caption prediction and audio relevance to the image. With these improvements, it is hoped that the system can provide more inclusive visual information accessibility for individuals with visual impairments.
Zitieren
APA
Hermanto, A. A., Karyono, G., & Tahyudin, I. (2025). Penerapan CNN dan RNN untuk Pembuatan Deskripsi Konten Visual Menggunakan Deep Learning. Building of Informatics, Technology and Science (BITS), 6(4), 2573-2581. https://doi.org/10.47065/bits.v6i4.6958
Vancouver
Hermanto AA, Karyono G, Tahyudin I. Penerapan CNN dan RNN untuk Pembuatan Deskripsi Konten Visual Menggunakan Deep Learning. Building of Informatics, Technology and Science (BITS). 2025;6(4):2573-2581. doi:10.47065/bits.v6i4.6958
BibTeX
@article{Hermanto2025,
author = {Hermanto, Aldy Agil and Karyono, Giat and Tahyudin, Imam},
title = {Penerapan CNN dan RNN untuk Pembuatan Deskripsi Konten Visual Menggunakan Deep Learning},
journal = {Building of Informatics, Technology and Science (BITS)},
year = {2025},
volume = {6},
number = {4},
pages = {2573--2581},
doi = {10.47065/bits.v6i4.6958}
}
EUVIMED