EUVIMEDEUVIMED entdecken
Crossref

AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification

Abdullah Alshanqiti

Islamic University Journal of Applied Sciences · 01.12.2026 · VIII (2) · 367-396

DOI: 10.63070/jesc.2026.047 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Islamic University Journal of Applied Sciences, online erschienen am 01.12.2026. Verfasst von Abdullah Alshanqiti.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Extreme quantization restricts Transformer weights to the ternary set {−1,0,+1}, but whether this transfers to morphologically rich languages is untested. Arabic is demanding, because its clitic-heavy, root-and-pattern morphology yields a vast inventory of surface forms that subword tokenizers segment at linguistically meaningless boundaries. AraBit-1.58 couples a Morphology-Aware Tokenization and Embedding layer (MATE) with a BitNet b1.58 ternary backbone. MATE decomposes each word into proclitics, root, morphosemantic pattern, and enclitics, embeds these separately, and gates to a subword fallback when analysis fails. We evaluate on the SAMER Arabic simplification corpus under a controlled two-by-two design over three seeds that varies only the front end and the weight precision. Ternary quantization compresses weight memory 2.85×, from 104.72 to 36.70 MB, but without a fused ternary kernel it cuts neither latency nor energy. The comparison confirms our pre-specified hypothesis: quantization costs 9.43 SARI with subword input against 7.49 SARI with morphological input, an interaction of +1.93 SARI significant across seeds (paired t(2) =4.55, one-tailed p=0.023). Morphological grounding therefore buys robustness to extreme quantization rather than higher absolute quality, measured on SARI at small scale.

Zitieren

APA

Alshanqiti, A. (2026). AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification. Islamic University Journal of Applied Sciences, VIII(2), 367-396. https://doi.org/10.63070/jesc.2026.047

Vancouver

Alshanqiti A. AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification. Islamic University Journal of Applied Sciences. 2026;VIII(2):367-396. doi:10.63070/jesc.2026.047

BibTeX
@article{Alshanqiti2026,
  author = {Alshanqiti, Abdullah},
  title = {AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification},
  journal = {Islamic University Journal of Applied Sciences},
  year = {2026},
  volume = {VIII},
  number = {2},
  pages = {367--396},
  doi = {10.63070/jesc.2026.047}
}
Kostenlos starten →