EUVIMEDEUVIMED entdecken
Crossref

Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer

Zheng Liu, Jinchao Zhu, Nannan Li, Gao Huang

IEEE Transactions on Circuits and Systems for Video Technology · 2026-02 · 36 (2) · 2123-2136

DOI: 10.1109/tcsvt.2025.3609549 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Circuits and Systems for Video Technology, 2026-02. Verfasst von Zheng Liu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 66 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Postdoctoral Fellowship Program of China Postdoctoral Science Foundation, China Postdoctoral Science Foundation.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Parameter-efficient transfer learning (PETL) has shown great potential in adapting vision transformers (ViTs) pre-trained on large-scale datasets to various downstream tasks. Existing studies primarily focus on minimizing the number of learnable parameters. Although these methods are storage-efficient, they allocate excessive computational resources to easy samples, leading to inefficient inference. To address this issue, we introduce an inference-efficient tuning method termed multiple-exit tuning (MET). MET integrates multiple exits into the pre-trained ViT backbone. Since the predictions of the adapted ViTs are typically made by linear classifiers, each exit is equipped with a linear prediction head. During inference, easy samples exit at early exits and only hard enough samples flow to the final exit, thus reducing the computational cost for easy samples. MET consists of exit-specific adapters (E-adapters) and graph regularization. E-adapters are designed to extract suitable representations for different exits. To maintain parameter efficiency, all E-adapters share the same base down-projection and up-projection matrices. As the performances of linear classifiers are influenced by the relationships among samples, we employ graph regularization to improve the representations fed into the classifiers at early exits. We conduct extensive experiments to evaluate the performance of MET. Experimental results show that MET has a clear advantage over the state-of-the-art methods in terms of both accuracy and inference efficiency.

Förderung

  • National Natural Science Foundation of China
  • Postdoctoral Fellowship Program of China Postdoctoral Science Foundation
  • China Postdoctoral Science Foundation

Zitieren

APA

Liu, Z., Zhu, J., Li, N., & Huang, G. (2026). Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer. IEEE Transactions on Circuits and Systems for Video Technology, 36(2), 2123-2136. https://doi.org/10.1109/tcsvt.2025.3609549

Vancouver

Liu Z, Zhu J, Li N, Huang G. Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer. IEEE Transactions on Circuits and Systems for Video Technology. 2026;36(2):2123-2136. doi:10.1109/tcsvt.2025.3609549

BibTeX
@article{Liu2026,
  author = {Liu, Zheng and Zhu, Jinchao and Li, Nannan and Huang, Gao},
  title = {Multiple-Exit Tuning: Towards Inference-Efficient Adaptation for Vision Transformer},
  journal = {IEEE Transactions on Circuits and Systems for Video Technology},
  year = {2026},
  volume = {36},
  number = {2},
  pages = {2123--2136},
  doi = {10.1109/tcsvt.2025.3609549}
}
Kostenlos starten →