Multi-dimensional Constraint-based Test Case Generation and Evaluation Framework for Large Language Models
International Journal of Emerging Technologies and Advanced Applications · 2025
DOI: 10.62677/ijetaa.2504134 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Emerging Technologies and Advanced Applications, 2025. Verfasst von Xuebing Wang. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).
Abstract (Originalsprache)
Addressing the challenges of complex test case design and insufficient coverage in functional testing of large language models, this paper presents a multi-dimensional constraint-based test case generation framework. The framework defines constraint rules across four dimensions: syntactic correctness, semantic consistency, task relevance, and boundary conditions, employing reinforcement learning methods to optimize the test case generation process. Through the design of reward function-based generation strategies, the system can automatically produce high-quality functional test samples covering core tasks including text classification, sentiment analysis, and machine translation. Experimental results demonstrate that test cases generated by this method achieve a 42% improvement in functional coverage compared to random generation methods and a 28% increase in defect detection rate. Further ablation experiments validate the effectiveness of each dimensional constraint, providing a systematic solution for large language model quality assurance.
Zitieren
APA
Wang, X. (2025). Multi-dimensional Constraint-based Test Case Generation and Evaluation Framework for Large Language Models. International Journal of Emerging Technologies and Advanced Applications. https://doi.org/10.62677/ijetaa.2504134
Vancouver
Wang X. Multi-dimensional Constraint-based Test Case Generation and Evaluation Framework for Large Language Models. International Journal of Emerging Technologies and Advanced Applications. 2025. doi:10.62677/ijetaa.2504134
BibTeX
@article{Wang2025,
author = {Wang, Xuebing},
title = {Multi-dimensional Constraint-based Test Case Generation and Evaluation Framework for Large Language Models},
journal = {International Journal of Emerging Technologies and Advanced Applications},
year = {2025},
doi = {10.62677/ijetaa.2504134}
}
EUVIMED