EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

SiNFluD: A novel benchmark dataset for sindhi figurative language classification

Wazir Ali, Adeeb Noor, Saifullah Tumrani

Data in Brief · 2026-08 · 69 · 113294

DOI: 10.1016/j.dib.2026.113294 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Data in Brief, 2026-08. Verfasst von Wazir Ali und 2 weiteren Autor:innen. Beteiligte Einrichtung: Department of Data Science, Quaid-e-Awam University of Engineering, Science and Technology, Nawabshah, Pakistan. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: King Abdulaziz University.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In this article, we introduce SiNFluD, a novel benchmark dataset for Sindhi figurative language classification. We collect phrases from web raw text sourced from various blogs, social media platforms, and literary sources, and subsequently prepare the corpus for annotation. Two native annotators label the data using the Doccano text annotation tool, achieving an inter-annotator agreement of 0.81 (Cohen's Kappa). We then establish baseline results using 5-fold and 10-fold cross-validation. Finally, we evaluate mBERT, XLM-RoBERTa, and XLM-RoBERTa-XL models, along with SetFit. For the SetFit experiments, we exploited the sentence Transformer as the backbone encoder. This multilingual MPNet checkpoint provides cross-lingual sentence embeddings and was fine-tuned using SetFit's parameter-efficient contrastive learning approach, followed by training a lightweight classification head on the Sindhi few-shot dataset. Among these, the pretrained XLM-RoBERTa-XL achieves the best classification performance with an accuracy of 92.27%. The SiNFluD dataset, comprising 4451 annotated instances across five categories (literal, idiom, proverb, metaphor, and simile), provides a foundational resource for figurative language research in Sindhi and other low-resource South Asian languages.

Schlagwörter

Stichwörter der Autor:innen

Few-shot learningFigurative language classificationLow-resource NLPNon-literal expressionsSindhi languageSouth asian languages

Autor:innen und Institutionen

  • Department of Data Science, Quaid-e-Awam University of Engineering, Science and Technology, Nawabshah, Pakistan.
  • SoloGenAI Pvt. Ltd, Turku, Finland.
  • Department of Information Technology, Faculty of Computing and Information Technology, King Abdulaziz University, Jeddah, Saudi Arabia.
  • SDAIA-KFUPM Joint Research Center for Artificial Intelligence, King Fahd University of Petroleum & Minerals, Dhahran, Kingdom of Saudi Arabia.

Förderung

  • King Abdulaziz University

Zitieren

APA

Ali, W., Noor, A., & Tumrani, S. (2026). SiNFluD: A novel benchmark dataset for sindhi figurative language classification. Data in Brief, 69, 113294. https://doi.org/10.1016/j.dib.2026.113294

Vancouver

Ali W, Noor A, Tumrani S. SiNFluD: A novel benchmark dataset for sindhi figurative language classification. Data in Brief. 2026;69:113294. doi:10.1016/j.dib.2026.113294

BibTeX
@article{Ali2026,
  author = {Ali, Wazir and Noor, Adeeb and Tumrani, Saifullah},
  title = {SiNFluD: A novel benchmark dataset for sindhi figurative language classification},
  journal = {Data in Brief},
  year = {2026},
  volume = {69},
  pages = {113294},
  doi = {10.1016/j.dib.2026.113294}
}
Kostenlos starten →