What Happened in This Pipeline? Diffing Build Logs with CiDiff
Proceedings of the ACM on Software Engineering · 22.06.2025 · 2 (ISSTA) · 2023-2044
DOI: 10.1145/3728966 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the ACM on Software Engineering, online erschienen am 22.06.2025. Verfasst von Nicolas Hubner und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 37 Literaturangaben. Gefördert von: Agence Nationale de la Recherche.
Abstract (Originalsprache)
Continuous integration (CI) is widely used by developers to ensure the quality and reliability of their software projects. However, diagnosing a CI regression is a tedious process that involves the manual analysis of lengthy build logs. In this paper, we explore how textual differencing can support the debugging of CI regressions. As off-the-shelf diff algorithms produce suboptimal results, in this work we introduce a new diff algorithm specifically tailored to build logs called CiDiff. We evaluate CiDiff against several baselines on a novel dataset of 17 906 CI regressions, performing an accuracy study, a quantitative study and a user-study. Notably, our algorithm reduces the number of lines to inspect by about 60 % in the median case, with reasonable overhead compared to the state-of-practice LCS-diff. Finally, our algorithm is preferred by the majority of participants in 70 % of the regression cases, whereas LCS-diff is preferred in only 5 % of the cases.
Förderung
- Agence Nationale de la Recherche
Zitieren
APA
Hubner, N., Falleri, J., Uricaru, R., Degueule, T., & Durieux, T. (2025). What Happened in This Pipeline? Diffing Build Logs with CiDiff. Proceedings of the ACM on Software Engineering, 2(ISSTA), 2023-2044. https://doi.org/10.1145/3728966
Vancouver
Hubner N, Falleri J, Uricaru R, Degueule T, Durieux T. What Happened in This Pipeline? Diffing Build Logs with CiDiff. Proceedings of the ACM on Software Engineering. 2025;2(ISSTA):2023-2044. doi:10.1145/3728966
BibTeX
@article{Hubner2025,
author = {Hubner, Nicolas and Falleri, Jean-Rémy and Uricaru, Raluca and Degueule, Thomas and Durieux, Thomas},
title = {What Happened in This Pipeline? Diffing Build Logs with CiDiff},
journal = {Proceedings of the ACM on Software Engineering},
year = {2025},
volume = {2},
number = {ISSTA},
pages = {2023--2044},
doi = {10.1145/3728966}
}
EUVIMED