Semi-supervised Crowdsourced Test Report Clustering via Screenshot-Text Binding Rules
Proceedings of the ACM on Software Engineering · 12.07.2024 · 1 (FSE) · 1540-1563
DOI: 10.1145/3660776 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 12.07.2024. Verfasst von Shengcheng Yu und 5 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 66 Literaturangaben. Gefördert von: National Natural Science Foundation of China, The Science, Technology, and Innovation Commission of Shenzhen Municipality.
Abstract (Originalsprache)
Due to the openness of the crowdsourced testing paradigm, crowdworkers submit massive spotty duplicate test reports, which hinders developers from effectively reviewing the reports and detecting bugs. Test report clustering is widely used to alleviate this problem and improve the effectiveness of crowdsourced testing. Existing clustering methods basically rely on the analysis of textual descriptions. A few methods are independently supplemented by analyzing screenshots in test reports as pixel sets, leaving out the semantics of app screenshots from the widget perspective. Further, ignoring the semantic relationships between screenshots and textual descriptions may lead to the imprecise analysis of test reports, which in turn negatively affects the clustering effectiveness. This paper proposes a semi-supervised crowdsourced test report clustering approach, namely SemCluster . SemCluster respectively extracts features from app screenshots and textual descriptions and forms the structure feature, the content feature, the bug feature, and reproduction steps. The clustering is principally conducted on the basis of the four features. Further, in order to avoid bias of specific individual features, SemCluster exploits the semantic relationships between app screenshots and textual descriptions to form the semantic binding rules as guidance for clustering crowdsourced test reports. Experiment results show that SemCluster outperforms state-of-the-art approaches on six widely used metrics by 10.49% – 200.67%, illustrating the excellent effectiveness.
Förderung
- National Natural Science Foundation of China
- The Science, Technology, and Innovation Commission of Shenzhen Municipality
Zitieren
APA
Yu, S., Fang, C., Zhang, Q., Du, M., Liu, J., & Chen, Z. (2024). Semi-supervised Crowdsourced Test Report Clustering via Screenshot-Text Binding Rules. Proceedings of the ACM on Software Engineering, 1(FSE), 1540-1563. https://doi.org/10.1145/3660776
Vancouver
Yu S, Fang C, Zhang Q, Du M, Liu J, Chen Z. Semi-supervised Crowdsourced Test Report Clustering via Screenshot-Text Binding Rules. Proceedings of the ACM on Software Engineering. 2024;1(FSE):1540-1563. doi:10.1145/3660776
BibTeX
@article{Yu2024,
author = {Yu, Shengcheng and Fang, Chunrong and Zhang, Quanjun and Du, Mingzhe and Liu, Jia and Chen, Zhenyu},
title = {Semi-supervised Crowdsourced Test Report Clustering via Screenshot-Text Binding Rules},
journal = {Proceedings of the ACM on Software Engineering},
year = {2024},
volume = {1},
number = {FSE},
pages = {1540--1563},
doi = {10.1145/3660776}
}
EUVIMED