EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Arabic Captioning for Images of Clothing Using Deep Learning

Rasha Saleh Al-Malki iD, Arwa Yousuf Al-Aama iD

Sensors · 07.04.2023 · 23 (8) · 3783

DOI: 10.3390/s23083783 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 07.04.2023. Verfasst von Rasha Saleh Al-Malki und 1 weiteren Autor:innen. Beteiligte Einrichtung: Computer Science Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia. Die Arbeit wurde bisher 15-mal zitiert (Crossref) und nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Fashion is one of the many fields of application that image captioning is being used in. For e-commerce websites holding tens of thousands of images of clothing, automated item descriptions are quite desirable. This paper addresses captioning images of clothing in the Arabic language using deep learning. Image captioning systems are based on Computer Vision and Natural Language Processing techniques because visual and textual understanding is needed for these systems. Many approaches have been proposed to build such systems. The most widely used methods are deep learning methods which use the image model to analyze the visual content of the image, and the language model to generate the caption. Generating the caption in the English language using deep learning algorithms received great attention from many researchers in their research, but there is still a gap in generating the caption in the Arabic language because public datasets are often not available in the Arabic language. In this work, we created an Arabic dataset for captioning images of clothing which we named “ArabicFashionData” because this model is the first model for captioning images of clothing in the Arabic language. Moreover, we classified the attributes of the images of clothing and used them as inputs to the decoder of our image captioning model to enhance Arabic caption quality. In addition, we used the attention mechanism. Our approach achieved a BLEU-1 score of 88.52. The experiment findings are encouraging and suggest that, with a bigger dataset, the attributes-based image captioning model can achieve excellent results for Arabic image captioning.

Schlagwörter

Stichwörter der Autor:innen

deep learningimage attributesimage captioningtransfer learning

Autor:innen und Institutionen

  • Computer Science Department, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah 21589, Saudi Arabia.

ORCID-Profile: Rasha Saleh Al-Malki, Arwa Yousuf Al-Aama

Zitieren

APA

Al-Malki, R. S., & Al-Aama, A. Y. (2023). Arabic Captioning for Images of Clothing Using Deep Learning. Sensors, 23(8), 3783. https://doi.org/10.3390/s23083783

Vancouver

Al-Malki RS, Al-Aama AY. Arabic Captioning for Images of Clothing Using Deep Learning. Sensors. 2023;23(8):3783. doi:10.3390/s23083783

BibTeX
@article{AlMalki2023,
  author = {Al-Malki, Rasha Saleh and Al-Aama, Arwa Yousuf},
  title = {Arabic Captioning for Images of Clothing Using Deep Learning},
  journal = {Sensors},
  year = {2023},
  volume = {23},
  number = {8},
  pages = {3783},
  doi = {10.3390/s23083783}
}
Kostenlos starten →