Beyond Methods: An Empirical Study of File-Level Production-Test Co-evolution and Its Implications for Automation
ACM Transactions on Software Engineering and Methodology · 10.11.2026
DOI: 10.1145/3861344 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 10.11.2026. Verfasst von Guoqing Wang und 4 weiteren Autor:innen. Die Arbeit nennt 77 Literaturangaben.
Abstract (Originalsprache)
The co-evolution of production and test code is a critical yet challenging software maintenance activity. However, a persistent paradigm gap exists in the literature. While the identification of co-evolution is advancing to a realistic file-level scope, the automation of test updates predominantly remains focused on an oversimplified method-level view. To bridge this gap, we conduct the first multi-project, empirically grounded taxonomy of file-level change propagation patterns that also quantifies the automation paradigm gap using representative tools. We construct a dataset of over 300,000 co-evolution pairs from 128 Java projects and perform a qualitative analysis on a statistically justified sample set. Our analysis yields a comprehensive, hierarchical taxonomy of four high-level Change Propagation Patterns that explains the mechanisms of file-level co-evolution. It reveals that simple one-to-one method changes—the primary target of current tools—constitute only a minority (2.15%) of cases. Our quantitative analysis then measures the profound impact of this gap. We show that the operational scope of state-of-the-art, method-level automation tools covers only a fraction of these real-world patterns, resulting in a performance mismatch of up to 69% when applied to the broader file-level context. Our work provides both a new theoretical lens and a challenging public benchmark to steer the community towards building the next generation of automation tools that address how co-evolution happens in practice.
Zitieren
APA
Wang, G., Li, M., Zhao, Y., Gong, Z., & Hao, D. (2026). Beyond Methods: An Empirical Study of File-Level Production-Test Co-evolution and Its Implications for Automation. ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3861344
Vancouver
Wang G, Li M, Zhao Y, Gong Z, Hao D. Beyond Methods: An Empirical Study of File-Level Production-Test Co-evolution and Its Implications for Automation. ACM Transactions on Software Engineering and Methodology. 2026. doi:10.1145/3861344
BibTeX
@article{Wang2026,
author = {Wang, Guoqing and Li, Mincan and Zhao, Yifan and Gong, Zhihao and Hao, Dan},
title = {Beyond Methods: An Empirical Study of File-Level Production-Test Co-evolution and Its Implications for Automation},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2026},
doi = {10.1145/3861344}
}
EUVIMED