A Statistical Comparison of Multi-Architecture Models for Retention-Period Classification of Chinese Electronic Official Documents
Journal of Computer Science and Artificial Intelligence · 31.08.2026 · 8 (2) · 37-49
DOI: 10.54097/0bpxr973 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computer Science and Artificial Intelligence, online erschienen am 31.08.2026. Verfasst von Haoran Zhang und 2 weiteren Autor:innen. Die Arbeit nennt 29 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Electronic document archiving requires automatic retention-period classification (permanent/30-year/10-year). To evaluate architectures on weakly structured Chinese official texts—texts lacking clear semantic boundaries whose key cues appear as scattered keywords—we benchmark six models across four paradigms: Qwen3 (0.6B/1.7B/4B) with LoRA, BERT-base-Chinese, FastText, and BERT-Embedding-TextCNN (frozen BERT character embeddings + TextCNN). On 2,118 test samples we conduct pairwise McNemar exact binomial tests with Benjamini-Hochberg correction over the 15 comparisons (FDR q=0.05). BERT-Embedding-TextCNN (75.50%) and FastText (75.07%) achieve the highest accuracy, ahead of Qwen3-4B (73.94%), but their Wilson 95% confidence intervals (approximately ±1.9 percentage points) overlap substantially. After correction, only two differences remain significant: BERT-Embedding-TextCNN and FastText each outperform Qwen3-0.6B (adjusted p=0.002 and p=0.006); the other 13 pairwise differences do not reach significance. The accuracies thus form descriptive clusters rather than statistically verified tiers. A leakage-controlled evaluation on the 1,690 test documents that are neither exact nor near-duplicates of training documents preserves this ranking and both significant differences, with accuracies 1.7–2.5 percentage points lower across models. Feature-weight inspection shows that archival keywords (e.g., bidding and state-asset terms, which skew toward permanent retention) are important predictive features for FastText, supporting a keyword-driven explanation of task success. For resource-constrained enterprise deployment, FastText offers near-top accuracy with CPU-only inference at roughly 26,800× the throughput of the 4B LLM under the evaluated hardware configurations.
Zitieren
APA
Zhang, H., Shi, L., & Pan, T. (2026). A Statistical Comparison of Multi-Architecture Models for Retention-Period Classification of Chinese Electronic Official Documents. Journal of Computer Science and Artificial Intelligence, 8(2), 37-49. https://doi.org/10.54097/0bpxr973
Vancouver
Zhang H, Shi L, Pan T. A Statistical Comparison of Multi-Architecture Models for Retention-Period Classification of Chinese Electronic Official Documents. Journal of Computer Science and Artificial Intelligence. 2026;8(2):37-49. doi:10.54097/0bpxr973
BibTeX
@article{Zhang2026,
author = {Zhang, Haoran and Shi, Lili and Pan, Tuochen},
title = {A Statistical Comparison of Multi-Architecture Models for Retention-Period Classification of Chinese Electronic Official Documents},
journal = {Journal of Computer Science and Artificial Intelligence},
year = {2026},
volume = {8},
number = {2},
pages = {37--49},
doi = {10.54097/0bpxr973}
}
EUVIMED