EUVIMEDEUVIMED entdecken
Crossref

General and Domain-adaptive Chinese Spelling Check with Error-consistent Pretraining

Qi Lv, Ziqiang Cao, Lei Geng, Chunhui Ai, Xu Yan, Guohong Fu

ACM Transactions on Asian and Low-Resource Language Information Processing · 31.05.2023 · 22 (5) · 1-18

DOI: 10.1145/3564271 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Asian and Low-Resource Language Information Processing, online erschienen am 09.05.2023. Verfasst von Qi Lv und 5 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 37 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The lack of label data is one of the significant bottlenecks for Chinese Spelling Check. Existing researches use the automatic generation method by exploiting unlabeled data to expand the supervised corpus. However, there is a big gap between the real input scenario and automatically generated corpus. Thus, we develop a competitive general speller ECSpell, which adopts the Error-consistent masking strategy to create data for pretraining. This error-consistency masking strategy is used to specify the error types of automatically generated sentences consistent with the real scene. The experimental result indicates that our model outperforms previous state-of-the-art models on the general benchmark. Moreover, spellers often work within a particular domain in real life. Due to many uncommon domain terms, experiments on our built domain-specific datasets show that general models perform terribly. Inspired by the common practice of input methods, we propose to add an alterable user dictionary to handle the zero-shot domain-adaption problem. Specifically, we attach a User Dictionary guided inference module (UD) to a general token classification-based speller. Our experiments demonstrate that ECSpell UD , namely, ECSpell combined with UD, surpasses all the other baselines broadly, even approaching the performance on the general benchmark. 1

Zitieren

APA

Lv, Q., Cao, Z., Geng, L., Ai, C., Yan, X., & Fu, G. (2023). General and Domain-adaptive Chinese Spelling Check with Error-consistent Pretraining. ACM Transactions on Asian and Low-Resource Language Information Processing, 22(5), 1-18. https://doi.org/10.1145/3564271

Vancouver

Lv Q, Cao Z, Geng L, Ai C, Yan X, Fu G. General and Domain-adaptive Chinese Spelling Check with Error-consistent Pretraining. ACM Transactions on Asian and Low-Resource Language Information Processing. 2023;22(5):1-18. doi:10.1145/3564271

BibTeX
@article{Lv2023,
  author = {Lv, Qi and Cao, Ziqiang and Geng, Lei and Ai, Chunhui and Yan, Xu and Fu, Guohong},
  title = {General and Domain-adaptive Chinese Spelling Check with Error-consistent Pretraining},
  journal = {ACM Transactions on Asian and Low-Resource Language Information Processing},
  year = {2023},
  volume = {22},
  number = {5},
  pages = {1--18},
  doi = {10.1145/3564271}
}
Kostenlos starten →