ABWS: The Arabic Boundary-aware Word Segmentation Benchmarkfor Reproducible Evaluation
BenchCouncil Transactions on Benchmarks, Standards and Evaluations · 12.04.2026 · 6
DOI: 10.66834/9a7y0c13 ↗Kurz gefasst
Fachartikel in der Zeitschrift BenchCouncil Transactions on Benchmarks, Standards and Evaluations, online erschienen am 12.04.2026. Verfasst von Huda AlShuhayeb und 1 weiteren Autor:innen. Die Arbeit nennt 25 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).
Abstract (Originalsprache)
With the rapid adoption of natural language processing (NLP) systems for morphologically rich languages, it has become increasingly imperative to standardize a common set of measures and evaluation practices to ensure reproducibility and fair comparison. Arabic word segmentation serves as a foundational layer in the NLP software stack; however, the field remains fragmented due to inconsistent datasets and an overreliance on opaque, aggregate metrics that mask systemic architectural biases. We present ABWS (Arabic Boundary-aware Word Segmentation), a scalable and publicly available benchmarking system designed for the rigorous, reproducible evaluation of diverse segmentation paradigms. To enable paradigm-agnostic comparison across rule-based, statistical, and neural models, ABWS introduces a canonical boundary vector abstraction that normalizes disparate system outputs into a unified evaluation interface. The benchmarking harness includes a manually verified gold-standard workload of 212{,}873 words across diverse genres and integrates seven widely used segmentation systems as reproducible baselines. Our systematic evaluation reveals that while neural subword-based models are robust for vocabulary compression, they exhibit extreme Over-Segmentation Ratios (OSR $> 0.58$), leading to a significant drop in word-level exact match accuracy compared to rule-based engines. We further introduce Critical Boundary Accuracy (CBA), a linguistically weighted metric that prioritizes high-impact morphological boundaries. Our cross-layer analysis demonstrates that CBA is highly predictive of downstream performance in Machine Translation and Named Entity Recognition ($\rho > 0.88$), whereas traditional token-level $F_1$ scores often obscure these performance bottlenecks. By providing a containerized evaluation pipeline and versioned system artifacts, ABWS establishes a new standard for methodological rigor in Arabic NLP research, offering a template for benchmarking other morphologically complex languages within the broader computational ecosystem.
Zitieren
APA
AlShuhayeb, H., & Minae-Bidgoli, B. (2026). ABWS: The Arabic Boundary-aware Word Segmentation Benchmarkfor Reproducible Evaluation. BenchCouncil Transactions on Benchmarks, Standards and Evaluations, 6. https://doi.org/10.66834/9a7y0c13
Vancouver
AlShuhayeb H, Minae-Bidgoli B. ABWS: The Arabic Boundary-aware Word Segmentation Benchmarkfor Reproducible Evaluation. BenchCouncil Transactions on Benchmarks, Standards and Evaluations. 2026;6. doi:10.66834/9a7y0c13
BibTeX
@article{AlShuhayeb2026,
author = {AlShuhayeb, Huda and Minae-Bidgoli, Behrouz},
title = {ABWS: The Arabic Boundary-aware Word Segmentation Benchmarkfor Reproducible Evaluation},
journal = {BenchCouncil Transactions on Benchmarks, Standards and Evaluations},
year = {2026},
volume = {6},
doi = {10.66834/9a7y0c13}
}
EUVIMED