EUVIMEDEUVIMED entdecken
Qualitative Studie

Organization Matters: A Qualitative Study of Organizational Dynamics in Red Teaming Practices For Generative AI

Bixuan Ren, EunJeong Cheon, Jianghui Li

Proceedings of the ACM on Human-Computer Interaction · 18.10.2025 · 9 (7) · 1-26

DOI: 10.1145/3757641 ↗

Kurz gefasst

Qualitative Studie in der Zeitschrift Proceedings of the ACM on Human-Computer Interaction, online erschienen am 16.10.2025. Verfasst von Bixuan Ren und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 91 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid integration of generative artificial intelligence (GenAI) across diverse fields underscores the critical need for red teaming efforts to proactively identify and mitigate associated risks. While previous research primarily addresses technical aspects, this paper highlights organizational factors that hinder the effectiveness of red teaming in real-world settings. Through qualitative analysis of 17 semi-structured interviews with red teamers from various organizations, we uncover challenges such as the marginalization of vulnerable red teamers, the invisibility of nuanced AI risks to vulnerable users until post-deployment, and the lack of user-centered red teaming approaches. These issues often arise from underlying organizational dynamics, including organizational resistance, organizational inertia, and organizational mediocracy. To mitigate these dynamics, we discuss the implications of user research for red teaming and the importance of embedding red teaming throughout the entire development cycle of GenAI systems.

Zitieren

APA

Ren, B., Cheon, E., & Li, J. (2025). Organization Matters: A Qualitative Study of Organizational Dynamics in Red Teaming Practices For Generative AI. Proceedings of the ACM on Human-Computer Interaction, 9(7), 1-26. https://doi.org/10.1145/3757641

Vancouver

Ren B, Cheon E, Li J. Organization Matters: A Qualitative Study of Organizational Dynamics in Red Teaming Practices For Generative AI. Proceedings of the ACM on Human-Computer Interaction. 2025;9(7):1-26. doi:10.1145/3757641

BibTeX
@article{Ren2025,
  author = {Ren, Bixuan and Cheon, EunJeong and Li, Jianghui},
  title = {Organization Matters: A Qualitative Study of Organizational Dynamics in Red Teaming Practices For Generative AI},
  journal = {Proceedings of the ACM on Human-Computer Interaction},
  year = {2025},
  volume = {9},
  number = {7},
  pages = {1--26},
  doi = {10.1145/3757641}
}
Kostenlos starten →