SDA: Steering-Driven Distribution Alignment for Open LLMs Without Fine-Tuning
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (40) · 34025-34033
DOI: 10.1609/aaai.v40i40.40696 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Wei Xia und 1 weiteren Autor:innen.
Abstract (Originalsprache)
With the rapid advancement of large language models (LLMs), their deployment in real-world applications has become increasingly widespread. LLMs are expected to deliver robust performance across diverse tasks, user preferences, and practical scenarios. However, as demands grow, ensuring that LLMs produce responses aligned with human intent remains a foundational challenge. In particular, aligning model behavior effectively and efficiently during inference, without costly retraining or extensive supervision, is both a critical requirement and a non-trivial technical endeavor. To address the challenge, we propose SDA (Steering-Driven Distribution Alignment), a training-free and model-agnostic alignment framework designed for open-source LLMs. SDA dynamically redistributes model output probabilities based on user-defined alignment instructions, enhancing alignment between model behavior and human intents without fine-tuning. The method is lightweight, resource-efficient, and compatible with a wide range of open-source LLMs. It can function independently during inference or be integrated with training-based alignment strategies. Moreover, SDA supports personalized preference alignment, enabling flexible control over the model’s response behavior. Empirical results demonstrate that SDA consistently improves alignment performance across 8 open-source LLMs with varying scales and diverse origins, evaluated on three key alignment dimensions, helpfulness, harmlessness, and honesty (3H). Specifically, SDA achieves average gains of 64.4% in helpfulness, 30% in honesty and 11.5% in harmlessness across the tested models, indicating its effectiveness and generalization across diverse models and application scenarios.
Zitieren
APA
Xia, W., & Deng, Z. (2026). SDA: Steering-Driven Distribution Alignment for Open LLMs Without Fine-Tuning. Proceedings of the AAAI Conference on Artificial Intelligence, 40(40), 34025-34033. https://doi.org/10.1609/aaai.v40i40.40696
Vancouver
Xia W, Deng Z. SDA: Steering-Driven Distribution Alignment for Open LLMs Without Fine-Tuning. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(40):34025-34033. doi:10.1609/aaai.v40i40.40696
BibTeX
@article{Xia2026,
author = {Xia, Wei and Deng, Zhi-Hong},
title = {SDA: Steering-Driven Distribution Alignment for Open LLMs Without Fine-Tuning},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {40},
pages = {34025--34033},
doi = {10.1609/aaai.v40i40.40696}
}
EUVIMED