EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Penerapan CNN dan RNN untuk Pembuatan Deskripsi Konten Visual Menggunakan Deep Learning

Aldy Agil Hermanto, Giat Karyono, Imam Tahyudin

Building of Informatics, Technology and Science (BITS) · 16.03.2025 · 6 (4) · 2573-2581

DOI: 10.47065/bits.v6i4.6958 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Building of Informatics, Technology and Science (BITS), online erschienen am 16.03.2025. Verfasst von Aldy Agil Hermanto und 2 weiteren Autor:innen. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The development of technology in the field of image and sound processing has had a significant impact on increasing the accessibility of information for various groups, especially for individuals with visual impairments. One of the innovations that emerged was the image to speech system, which allows the conversion of images into sounds that can be understood by its users. The main problem lies in the low accuracy of object recognition in images with high variability, such as poor lighting or complex backgrounds, as well as the challenge of producing suitable text descriptions to be converted into audio. The method used involves extracting image features using InceptionV3-based CNN and forming a sequence of descriptive texts through RNN with an attention mechanism. The dataset consists of 40,455 captions and 8,091 images, processed using text and image pre-processing techniques before being trained using the teacher forcing technique. The evaluation results show a very low BLEU score (5.154827976372712e-153), indicating the model's inability to replicate the original caption well. However, the audio from the text-to-speech conversion using Google Text-to-Speech is quite clear. Future solutions include increasing the dataset, applying regularization, and adjusting the model architecture to improve the accuracy of caption prediction and audio relevance to the image. With these improvements, it is hoped that the system can provide more inclusive visual information accessibility for individuals with visual impairments.

Zitieren

APA

Hermanto, A. A., Karyono, G., & Tahyudin, I. (2025). Penerapan CNN dan RNN untuk Pembuatan Deskripsi Konten Visual Menggunakan Deep Learning. Building of Informatics, Technology and Science (BITS), 6(4), 2573-2581. https://doi.org/10.47065/bits.v6i4.6958

Vancouver

Hermanto AA, Karyono G, Tahyudin I. Penerapan CNN dan RNN untuk Pembuatan Deskripsi Konten Visual Menggunakan Deep Learning. Building of Informatics, Technology and Science (BITS). 2025;6(4):2573-2581. doi:10.47065/bits.v6i4.6958

BibTeX
@article{Hermanto2025,
  author = {Hermanto, Aldy Agil and Karyono, Giat and Tahyudin, Imam},
  title = {Penerapan CNN dan RNN untuk Pembuatan Deskripsi Konten Visual Menggunakan Deep Learning},
  journal = {Building of Informatics, Technology and Science (BITS)},
  year = {2025},
  volume = {6},
  number = {4},
  pages = {2573--2581},
  doi = {10.47065/bits.v6i4.6958}
}
Kostenlos starten →