Unpacking Bias in LLMs: A Causal Testing Perspective
ACM Transactions on Software Engineering and Methodology · 05.11.2026
DOI: 10.1145/3858420 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Transactions on Software Engineering and Methodology, online erschienen am 05.11.2026. Verfasst von Roberto Pietrantuono und 4 weiteren Autor:innen. Die Arbeit nennt 54 Literaturangaben.
Abstract (Originalsprache)
Large Language Models (LLMs) – the backbone of modern Natural Language Processing applications (NLP) - are notoriously subject to biases that reflect stereotypes present in their training. Fairness testing typically aims to expose bias by generating texts that should yield equivalent outputs, yet differ only in protected attributes such as gender or religion. However, fairness testing for LLMs is more complex than it seems. Bias depends not only on variations in the protected attribute, but also on its causal interactions with non-protected attributes and their combined influence on the output. Ignoring these dependencies risks producing unrealistic scenarios or misleading conclusions about bias. We introduce CFTA ( Causal Fairness Testing and Analysis ), a causality-driven technique for generating test datasets that uncover multiple forms of bias while enabling fine-grained decomposition of (real or apparent) bias-inducing paths. We evaluate CFTA on nine LLMs on a sentiment analysis task, exposing contributions of both obvious and hidden biases between models.
Zitieren
APA
Pietrantuono, R., Ciniglio, L., Meglio, S., Picariello, I., & Spasiano, C. (2026). Unpacking Bias in LLMs: A Causal Testing Perspective. ACM Transactions on Software Engineering and Methodology. https://doi.org/10.1145/3858420
Vancouver
Pietrantuono R, Ciniglio L, Meglio S, Picariello I, Spasiano C. Unpacking Bias in LLMs: A Causal Testing Perspective. ACM Transactions on Software Engineering and Methodology. 2026. doi:10.1145/3858420
BibTeX
@article{Pietrantuono2026,
author = {Pietrantuono, Roberto and Ciniglio, Luisa and Meglio, Sara and Picariello, Ilaria and Spasiano, Claudio},
title = {Unpacking Bias in LLMs: A Causal Testing Perspective},
journal = {ACM Transactions on Software Engineering and Methodology},
year = {2026},
doi = {10.1145/3858420}
}
EUVIMED