EUVIMEDEUVIMED entdecken
Crossref

Echo Systems and the Consequence Boundary: A Runnable Delegation Gate for High-Rapport AI Without Assuming Machine Consciousness

Paul LaPosta

Proceedings of the AAAI Symposium Series · 18.05.2026 · 8 (1) · 272-279

DOI: 10.1609/aaaiss.v8i1.42554 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Symposium Series, online erschienen am 18.05.2026. Verfasst von Paul LaPosta.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

High-rapport conversational systems can elicit attachment, over-trust, and implicit delegation while providing no stable evidence of accountable agency. This creates a governance failure mode in which persuasive fluency becomes a decision surface, yet liability remains fully human when harm occurs. We propose the consequence boundary, a deployable delegation threshold that does not depend on consciousness attribution. Crossing the boundary requires three properties. First, persistent identity, meaning a stable accountable unit across reset surfaces. Second, internal tension, meaning constraint stability under adversarial temptation across framings and reinstantiation. Third, internalized consequence, meaning a non-erasable binding consequence under a declared operator threat model. We provide the CB-3 Gate, a boxed evaluation procedure that specifies inputs, steps, pass and fail criteria, stop-ship rules, outputs, and a falsifier. We ground the framework in observed deployment patterns that include liability snapback in the Air Canada chatbot case, verification collapse in Mata v. Avianca, and reliance proxies in action paths via Copilot-style suggestion acceptance. We close with a practical posture. Below the consequence boundary, systems may advise, but they may not hold irreversible authority without human-held keys.

Zitieren

APA

LaPosta, P. (2026). Echo Systems and the Consequence Boundary: A Runnable Delegation Gate for High-Rapport AI Without Assuming Machine Consciousness. Proceedings of the AAAI Symposium Series, 8(1), 272-279. https://doi.org/10.1609/aaaiss.v8i1.42554

Vancouver

LaPosta P. Echo Systems and the Consequence Boundary: A Runnable Delegation Gate for High-Rapport AI Without Assuming Machine Consciousness. Proceedings of the AAAI Symposium Series. 2026;8(1):272-279. doi:10.1609/aaaiss.v8i1.42554

BibTeX
@article{LaPosta2026,
  author = {LaPosta, Paul},
  title = {Echo Systems and the Consequence Boundary: A Runnable Delegation Gate for High-Rapport AI Without Assuming Machine Consciousness},
  journal = {Proceedings of the AAAI Symposium Series},
  year = {2026},
  volume = {8},
  number = {1},
  pages = {272--279},
  doi = {10.1609/aaaiss.v8i1.42554}
}
Kostenlos starten →