EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC 4.0

Multi-dimensional Constraint-based Test Case Generation and Evaluation Framework for Large Language Models

Xuebing Wang

International Journal of Emerging Technologies and Advanced Applications · 2025

DOI: 10.62677/ijetaa.2504134 ↗

Kurz gefasst

Fachartikel in der Zeitschrift International Journal of Emerging Technologies and Advanced Applications, 2025. Verfasst von Xuebing Wang. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Addressing the challenges of complex test case design and insufficient coverage in functional testing of large language models, this paper presents a multi-dimensional constraint-based test case generation framework. The framework defines constraint rules across four dimensions: syntactic correctness, semantic consistency, task relevance, and boundary conditions, employing reinforcement learning methods to optimize the test case generation process. Through the design of reward function-based generation strategies, the system can automatically produce high-quality functional test samples covering core tasks including text classification, sentiment analysis, and machine translation. Experimental results demonstrate that test cases generated by this method achieve a 42% improvement in functional coverage compared to random generation methods and a 28% increase in defect detection rate. Further ablation experiments validate the effectiveness of each dimensional constraint, providing a systematic solution for large language model quality assurance.

Zitieren

APA

Wang, X. (2025). Multi-dimensional Constraint-based Test Case Generation and Evaluation Framework for Large Language Models. International Journal of Emerging Technologies and Advanced Applications. https://doi.org/10.62677/ijetaa.2504134

Vancouver

Wang X. Multi-dimensional Constraint-based Test Case Generation and Evaluation Framework for Large Language Models. International Journal of Emerging Technologies and Advanced Applications. 2025. doi:10.62677/ijetaa.2504134

BibTeX
@article{Wang2025,
  author = {Wang, Xuebing},
  title = {Multi-dimensional Constraint-based Test Case Generation and Evaluation Framework for Large Language Models},
  journal = {International Journal of Emerging Technologies and Advanced Applications},
  year = {2025},
  doi = {10.62677/ijetaa.2504134}
}
Kostenlos starten →