Reproducibility of Experiments in Networking
IEEE Access · 2026 · 14 · 54053-54065
DOI: 10.1109/access.2026.3680994 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Nikolas Wehner und 4 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Deutsche Forschungsgemeinschaft (DFG) in the Project NFDIxCS.
Abstract (Originalsprache)
Reproducibility is a cornerstone of good scientific practice, enabling validation of experimental results and fostering progress by building upon prior work. The importance of reproducibility in networking research has gained traction in recent years. Notably, the Dagstuhl beginner’s guide to reproducible experimental networking research has provided valuable best practices for documentation, data handling, and experiment design. However, the identification of specific networking components and aspects that prevent experiment reproducibility has not been investigated yet. This work addresses this gap by systematically identifying such components, constructing a taxonomy based on the findings, and proposing guidelines to increase experiment reproducibility. For this purpose, we discuss and analyze several networking use cases: 5G measurement experiments, Internet measurements, AI/ML-based networking experiments, and subjective QoE studies. Through targeted experiments and a review of existing studies, we identify some key sources of variability and discuss strategies to reduce variability and thus increase reproducibility. Our analysis highlights the importance of clearly defining research questions and expected outcomes as they form the foundation for assessing reproducibility. Additionally, our findings show the need for documenting potential sources of randomness, e.g., platform-specific effects introduced by operating systems, prior to experimental design. Minimizing unnecessary variability, e.g., by abstracting or replacing such components, further enhances reproducibility. While not all variability can be controlled due to the inherent complexity of networked systems, the proposed guidelines offer practical steps toward more reproducible networking experiments.
Förderung
- Deutsche Forschungsgemeinschaft (DFG) in the Project NFDIxCS
Zitieren
APA
Wehner, N., Grigorjew, A., Raffeck, S., Goedicke, M., & Hoßfeld, T. (2026). Reproducibility of Experiments in Networking. IEEE Access, 14, 54053-54065. https://doi.org/10.1109/access.2026.3680994
Vancouver
Wehner N, Grigorjew A, Raffeck S, Goedicke M, Hoßfeld T. Reproducibility of Experiments in Networking. IEEE Access. 2026;14:54053-54065. doi:10.1109/access.2026.3680994
BibTeX
@article{Wehner2026,
author = {Wehner, Nikolas and Grigorjew, Alexej and Raffeck, Simon and Goedicke, Michael and Hoßfeld, Tobias},
title = {Reproducibility of Experiments in Networking},
journal = {IEEE Access},
year = {2026},
volume = {14},
pages = {54053--54065},
doi = {10.1109/access.2026.3680994}
}
EUVIMED