AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification
Islamic University Journal of Applied Sciences · 01.12.2026 · VIII (2) · 367-396
DOI: 10.63070/jesc.2026.047 ↗Kurz gefasst
Fachartikel in der Zeitschrift Islamic University Journal of Applied Sciences, online erschienen am 01.12.2026. Verfasst von Abdullah Alshanqiti.
Abstract (Originalsprache)
Extreme quantization restricts Transformer weights to the ternary set {−1,0,+1}, but whether this transfers to morphologically rich languages is untested. Arabic is demanding, because its clitic-heavy, root-and-pattern morphology yields a vast inventory of surface forms that subword tokenizers segment at linguistically meaningless boundaries. AraBit-1.58 couples a Morphology-Aware Tokenization and Embedding layer (MATE) with a BitNet b1.58 ternary backbone. MATE decomposes each word into proclitics, root, morphosemantic pattern, and enclitics, embeds these separately, and gates to a subword fallback when analysis fails. We evaluate on the SAMER Arabic simplification corpus under a controlled two-by-two design over three seeds that varies only the front end and the weight precision. Ternary quantization compresses weight memory 2.85×, from 104.72 to 36.70 MB, but without a fused ternary kernel it cuts neither latency nor energy. The comparison confirms our pre-specified hypothesis: quantization costs 9.43 SARI with subword input against 7.49 SARI with morphological input, an interaction of +1.93 SARI significant across seeds (paired t(2) =4.55, one-tailed p=0.023). Morphological grounding therefore buys robustness to extreme quantization rather than higher absolute quality, measured on SARI at small scale.
Zitieren
APA
Alshanqiti, A. (2026). AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification. Islamic University Journal of Applied Sciences, VIII(2), 367-396. https://doi.org/10.63070/jesc.2026.047
Vancouver
Alshanqiti A. AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification. Islamic University Journal of Applied Sciences. 2026;VIII(2):367-396. doi:10.63070/jesc.2026.047
BibTeX
@article{Alshanqiti2026,
author = {Alshanqiti, Abdullah},
title = {AraBit-1.58: Morphology-Aware Embeddings Reduce the Cost of Ternary Quantization in Arabic Text Simplification},
journal = {Islamic University Journal of Applied Sciences},
year = {2026},
volume = {VIII},
number = {2},
pages = {367--396},
doi = {10.63070/jesc.2026.047}
}
EUVIMED