EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

A comprehensive dataset for Arabic word sense disambiguation

Sanaa Kaddoura, Reem Nassar

Data in Brief · 2024-08 · 55 · 110591

DOI: 10.1016/j.dib.2024.110591 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Data in Brief, 2024-08. Verfasst von Sanaa Kaddoura und 1 weiteren Autor:innen. Beteiligte Einrichtung: Computing and Applied Technology, College of Technological Innovation, Zayed University, UAE. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 20 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Zayed University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This data paper introduces a comprehensive dataset tailored for word sense disambiguation tasks, explicitly focusing on a hundred polysemous words frequently employed in Modern Standard Arabic. The dataset encompasses a diverse set of senses for each word, ranging from 3 to 8, resulting in 367 unique senses. Each word sense is accompanied by contextual sentences comprising ten sentence examples that feature the polysemous word in various contexts. The data collection resulted in a dataset of 3670 samples. Significantly, the dataset is in Arabic, which is known for its rich morphology, complex syntax, and extensive polysemy. The data was meticulously collected from various web sources, spanning news, medicine, finance, and more domains. This inclusivity ensures the dataset's applicability across diverse fields, positioning it as a pivotal resource for Arabic Natural Language Processing (NLP) applications. The data collection timeframe spans from the first of April 2023 to the first of May 2023. The dataset provides comprehensive model learning by including all senses for a frequently used Arabic polysemous term, even rare senses that are infrequently used in real-world contexts, thereby mitigating biases. The dataset comprises synthetic sentences generated by GPT3.5-turbo, addressing instances where rare senses lack sufficient real-world data. The dataset collection process involved initial web scraping, followed by manual sorting to distinguish word senses, supplemented by thorough searches by a human expert to fill in missing contextual sentences. Finally, in instances where online data for rare word senses was lacking or insufficient, synthetic samples were generated. Beyond its primary utility in word sense disambiguation, this dataset holds considerable value for scientists and researchers across various domains, extending its relevance to sentiment analysis applications.

Schlagwörter

Stichwörter der Autor:innen

Arabic languageDeep learningGPT3.5Labelled dataMachine learningNatural language processingWord sense disambiguation

Autor:innen und Institutionen

  • Computing and Applied Technology, College of Technological Innovation, Zayed University, UAE.

Förderung

  • Zayed University

Zitieren

APA

Kaddoura, S., & Nassar, R. (2024). A comprehensive dataset for Arabic word sense disambiguation. Data in Brief, 55, 110591. https://doi.org/10.1016/j.dib.2024.110591

Vancouver

Kaddoura S, Nassar R. A comprehensive dataset for Arabic word sense disambiguation. Data in Brief. 2024;55:110591. doi:10.1016/j.dib.2024.110591

BibTeX
@article{Kaddoura2024,
  author = {Kaddoura, Sanaa and Nassar, Reem},
  title = {A comprehensive dataset for Arabic word sense disambiguation},
  journal = {Data in Brief},
  year = {2024},
  volume = {55},
  pages = {110591},
  doi = {10.1016/j.dib.2024.110591}
}
Kostenlos starten →