EUVIMEDEUVIMED entdecken
Open Access · CC BY-SA 4.0

Communicating Study Design Trade-offs in Software Engineering

Martin P. Robillard, Deeksha M. Arya, Neil A. Ernst, Jin L. C. Guo, Maxime Lamothe, Mathieu Nassif, Nicole Novielli, Alexander Serebrenik, Igor Steinmacher, Klaas-Jan Stol

ACM Transactions on Software Engineering and Methodology · 30.06.2024 · 33 (5) · 1-10

DOI: 10.1145/3649598 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 04.06.2024. Verfasst von Martin P. Robillard und 9 weiteren Autor:innen. Die Arbeit wurde bisher 42-mal zitiert (Crossref) und nennt 41 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-SA 4.0). Gefördert von: Natural Sciences and Engineering Research Council of Canada, European Union—NextGenerationEU through the Italian Ministry of University, U.S. National Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Reflecting on the limitations of a study is a crucial part of the research process. In software engineering studies, this reflection is typically conveyed through discussions of study limitations or threats to validity. In current practice, such discussions seldom provide sufficient insight to understand the rationale for decisions taken before and during the study, and their implications. We revisit the practice of discussing study limitations and threats to validity and identify its weaknesses. We propose to refocus this practice of self-reflection to a discussion centered on the notion of trade-offs . We argue that documenting trade-offs allows researchers to clarify how the benefits of their study design decisions outweigh the costs of possible alternatives. We present guidelines for reporting trade-offs in a way that promotes a fair and dispassionate assessment of researchers’ work.

Förderung

  • Natural Sciences and Engineering Research Council of Canada
  • European Union—NextGenerationEU through the Italian Ministry of University
  • U.S. National Science Foundation
  • Science Foundation Ireland

Zitieren

APA

Robillard, M. P., Arya, D. M., Ernst, N. A., Guo, J. L. C., Lamothe, M., Nassif, M., Novielli, N., Serebrenik, A., Steinmacher, I., & Stol, K. (2024). Communicating Study Design Trade-offs in Software Engineering. ACM Transactions on Software Engineering and Methodology, 33(5), 1-10. https://doi.org/10.1145/3649598

Vancouver

Robillard MP, Arya DM, Ernst NA, Guo JLC, Lamothe M, Nassif M, et al. Communicating Study Design Trade-offs in Software Engineering. ACM Transactions on Software Engineering and Methodology. 2024;33(5):1-10. doi:10.1145/3649598

BibTeX
@article{Robillard2024,
  author = {Robillard, Martin P. and Arya, Deeksha M. and Ernst, Neil A. and Guo, Jin L. C. and Lamothe, Maxime and Nassif, Mathieu and Novielli, Nicole and Serebrenik, Alexander and Steinmacher, Igor and Stol, Klaas-Jan},
  title = {Communicating Study Design Trade-offs in Software Engineering},
  journal = {ACM Transactions on Software Engineering and Methodology},
  year = {2024},
  volume = {33},
  number = {5},
  pages = {1--10},
  doi = {10.1145/3649598}
}
Kostenlos starten →