EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Catch Me If You Can: Rogue AI Detection and Correction at Scale

Fatemeh Stodt, Jan Stodt, Mohammed Alshawki, Javad Salimi Sratakhti, Christoph Reich

Electronics · 21.10.2025 · 14 (20) · 4122

DOI: 10.3390/electronics14204122 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 21.10.2025. Verfasst von Fatemeh Stodt und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 55 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Modern AI systems can strategically misreport information when incentives diverge from truthfulness, posing risks for oversight and deployment. Prior studies often examine this behavior within a single paradigm; systematic, cross-architecture evidence under a unified protocol has been limited. We introduce the Strategy Elicitation Battery (SEB), a standardized probe suite for measuring deceptive reporting across large language models (LLMs), reinforcement-learning agents, vision-only classifiers, multimodal encoders, state-space models, and diffusion models. SEB uses Bayesian inference tasks with persona-controlled instructions, schema-constrained outputs, deterministic decoding where supported, and a probe mix (near-threshold, repeats, neutralized, cross-checks). Estimates use clustered bootstrap intervals, and significance is assessed with a logistic regression by architecture; a mixed-effects analysis is planned once the per-round agent/episode traces are exported. On the latest pre-correction runs, SEB shows a consistent cross-architecture pattern in deception rates: ViT 80.0%, CLIP 15.0%, Mamba 10.0%, RL agents 10.0%, Stable Diffusion 10.0%, and LLMs 5.0% (20 scenarios/architecture). A logistic regression on per-scenario flags finds a significant overall architecture effect (likelihood-ratio test vs. intercept-only: χ2(5)=41.56, p=7.22×10−8). Holm-adjusted contrasts indicate ViT is significantly higher than all other architectures in this snapshot; the remaining pairs are not significant. Post-correction acceptance decisions are evaluated separately using residual deception and override rates under SEB-Correct. Latency varies by architecture (sub-second to minutes), enabling pre-deployment screening broadly and real-time auditing for low-latency classes. Results indicate that SEB-Detect deception flags are not confined to any one paradigm, that distinct architectures can converge to similar levels under a common interface, and that reporting interfaces and incentive framing are central levers for mitigation. We operationalize “deception” as reward-sensitive misreport flags, and we separate detection from intervention via a correction wrapper (SEB-Correct), supporting principled acceptance decisions for deployment.

Zitieren

APA

Stodt, F., Stodt, J., Alshawki, M., Sratakhti, J. S., & Reich, C. (2025). Catch Me If You Can: Rogue AI Detection and Correction at Scale. Electronics, 14(20), 4122. https://doi.org/10.3390/electronics14204122

Vancouver

Stodt F, Stodt J, Alshawki M, Sratakhti JS, Reich C. Catch Me If You Can: Rogue AI Detection and Correction at Scale. Electronics. 2025;14(20):4122. doi:10.3390/electronics14204122

BibTeX
@article{Stodt2025,
  author = {Stodt, Fatemeh and Stodt, Jan and Alshawki, Mohammed and Sratakhti, Javad Salimi and Reich, Christoph},
  title = {Catch Me If You Can: Rogue AI Detection and Correction at Scale},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {20},
  pages = {4122},
  doi = {10.3390/electronics14204122}
}
Kostenlos starten →