EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

ZaQQ: A New Arabic Dataset for Automatic Essay Scoring via a Novel Human–AI Collaborative Framework

Yomna Elsayed, Emad Nabil, Marwan Torki, Safiullah Faizullah, Ayman Khalafallah

Data · 19.09.2025 · 10 (9) · 148

DOI: 10.3390/data10090148 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Data, online erschienen am 19.09.2025. Verfasst von Yomna Elsayed und 4 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deanship of Scientific Research, Islamic University of Madinah, Madinah, Saudi Arabia.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated essay scoring (AES) has become an essential tool in educational assessment. However, applying AES to the Arabic language presents notable challenges, primarily due to the lack of labeled datasets. This data scarcity hampers the development of reliable machine learning models and slows progress in Arabic natural language processing for educational use. While manual annotation by human experts remains the most accurate method for essay evaluation, it is often too costly and time-consuming to create large-scale datasets, especially for low-resource languages like Arabic. In this work, we introduce a human–AI collaborative framework designed to overcome the shortage of scored Arabic essays. Leveraging QAES, a high-quality annotated dataset, our approach uses Large Language Models (LLMs) to generate multidimensional essay evaluations across seven key writing traits: Relevance, Organization, Vocabulary, Style, Development, Mechanics, and Structure. To ensure accuracy and consistency, we design prompting strategies and validation procedures tailored to each trait. This system is then applied to two unannotated Arabic essay datasets: ZAEBUC and QALB. As a result, we introduce ZaQQ, a newly annotated dataset that merges ZAEBUC, QAES, and QALB. Our findings demonstrate that human–AI collaboration can significantly enhance the availability of labeled resources without compromising assessment quality. The proposed framework serves as a scalable and replicable model for addressing data annotation challenges in low-resource languages and supports the broader goal of expanding access to automated educational assessment tools where expert evaluation is limited.

Förderung

  • Deanship of Scientific Research, Islamic University of Madinah, Madinah, Saudi Arabia

Zitieren

APA

Elsayed, Y., Nabil, E., Torki, M., Faizullah, S., & Khalafallah, A. (2025). ZaQQ: A New Arabic Dataset for Automatic Essay Scoring via a Novel Human–AI Collaborative Framework. Data, 10(9), 148. https://doi.org/10.3390/data10090148

Vancouver

Elsayed Y, Nabil E, Torki M, Faizullah S, Khalafallah A. ZaQQ: A New Arabic Dataset for Automatic Essay Scoring via a Novel Human–AI Collaborative Framework. Data. 2025;10(9):148. doi:10.3390/data10090148

BibTeX
@article{Elsayed2025,
  author = {Elsayed, Yomna and Nabil, Emad and Torki, Marwan and Faizullah, Safiullah and Khalafallah, Ayman},
  title = {ZaQQ: A New Arabic Dataset for Automatic Essay Scoring via a Novel Human–AI Collaborative Framework},
  journal = {Data},
  year = {2025},
  volume = {10},
  number = {9},
  pages = {148},
  doi = {10.3390/data10090148}
}
Kostenlos starten →