EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

OrthoEdit: Principled and Stable Knowledge Editing via Orthogonal Subspace Projection

Shanbao Qiao, Xuebing Liu, Akshat Gupta, Seung-Hoon Na

Transactions of the Association for Computational Linguistics · 01.06.2026 · 14 · 1140-1162

DOI: 10.1162/tacl.a.700 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 01.06.2026. Verfasst von Shanbao Qiao und 3 weiteren Autor:innen. Die Arbeit nennt 59 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large language models (LLMs) encode extensive factual knowledge through pretraining, yet often require targeted updates to correct errors, incorporate new information, or revise outdated facts. Recent approaches to knowledge editing, such as projection-based constraints, parameter pruning, and regularization, have proven effective in improving editing accuracy and stability. However, these methods often fail to maintain a clear separation between new edits and existing knowledge, leading to interference and degradation over time. We propose OrthoEdit, a principled framework for stable and scalable knowledge editing that ensures each parameter update is orthogonal to both pre-existing and previously edited knowledge, remains strictly non-interfering and preserving the integrity of prior edits. OrthoEdit enables exact subspace control through three coordinated steps: progressive null space refinement, principal subspace extraction, and orthogonal projection. This yields compact and well-aligned updates that systematically satisfy all accumulated constraints. Comprehensive experiments across diverse models and benchmarks demonstrate that OrthoEdit consistently enhances editing accuracy and robustness while preserving general capabilities—even through extended sequences of batched edits. Our code is available at https://github.com/JoveReCode/OrthoEdit.git.

Zitieren

APA

Qiao, S., Liu, X., Gupta, A., & Na, S. (2026). OrthoEdit: Principled and Stable Knowledge Editing via Orthogonal Subspace Projection. Transactions of the Association for Computational Linguistics, 14, 1140-1162. https://doi.org/10.1162/tacl.a.700

Vancouver

Qiao S, Liu X, Gupta A, Na S. OrthoEdit: Principled and Stable Knowledge Editing via Orthogonal Subspace Projection. Transactions of the Association for Computational Linguistics. 2026;14:1140-1162. doi:10.1162/tacl.a.700

BibTeX
@article{Qiao2026,
  author = {Qiao, Shanbao and Liu, Xuebing and Gupta, Akshat and Na, Seung-Hoon},
  title = {OrthoEdit: Principled and Stable Knowledge Editing via Orthogonal Subspace Projection},
  journal = {Transactions of the Association for Computational Linguistics},
  year = {2026},
  volume = {14},
  pages = {1140--1162},
  doi = {10.1162/tacl.a.700}
}
Kostenlos starten →