BUILDING AND VALIDATING A SILVER-STANDARD BILINGUAL DATASET FOR MULTILABEL SOFTWARE REQUIREMENTS CLASSIFICATION
International Journal on Natural Language Computing · 28.04.2026 · 15 (2) · 01-19
DOI: 10.5121/ijnlc.2026.15201 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal on Natural Language Computing, online erschienen am 28.04.2026. Verfasst von Truong Dac Dien und 1 weiteren Autor:innen.
Abstract (Originalsprache)
This paper presents a reproducible workflow for building and validating a silver-standard bilingual dataset for multilabel software requirements classification. The corpus contains 8,832 aligned EnglishVietnamese requirement pairs with 12 labels, while a separate gold benchmark contains 622 aligned pairs. A blind audit of 500 silver instances gives a macro-averaged Cohen's kappa of 0.7427, indicating generally reliable annotations, with lower agreement for broader labels such as Look & Feel and Operability. Classical and transformer-based models are trained on the silver corpus, with threshold tuning performed only on silver validation folds. On the English gold benchmark, RoBERTa-base obtains the best micro-F1 without tuning (0.7766 ± 0.0040). On Vietnamese gold, PhoBERT-base-v2 performs best after tuning (0.7433 ± 0.0091). Threshold tuning benefits classical models more than transformers. Overall, silver data supports scalable training, but gold data remains necessary for reliable comparison.
Zitieren
APA
Dien, T. D., & Huong, N. T. X. (2026). BUILDING AND VALIDATING A SILVER-STANDARD BILINGUAL DATASET FOR MULTILABEL SOFTWARE REQUIREMENTS CLASSIFICATION. International Journal on Natural Language Computing, 15(2), 01-19. https://doi.org/10.5121/ijnlc.2026.15201
Vancouver
Dien TD, Huong NTX. BUILDING AND VALIDATING A SILVER-STANDARD BILINGUAL DATASET FOR MULTILABEL SOFTWARE REQUIREMENTS CLASSIFICATION. International Journal on Natural Language Computing. 2026;15(2):01-19. doi:10.5121/ijnlc.2026.15201
BibTeX
@article{Dien2026,
author = {Dien, Truong Dac and Huong, Nguyen Thi Xuan},
title = {BUILDING AND VALIDATING A SILVER-STANDARD BILINGUAL DATASET FOR MULTILABEL SOFTWARE REQUIREMENTS CLASSIFICATION},
journal = {International Journal on Natural Language Computing},
year = {2026},
volume = {15},
number = {2},
pages = {01--19},
doi = {10.5121/ijnlc.2026.15201}
}
EUVIMED