EUVIMEDEUVIMED entdecken
Crossref

CATP: Contextually Adaptive Token Pruning for Efficient and Enhanced Multimodal In-Context Learning

Yanshu Li, Jianjiang Yang, Zhennan Shen, Ligong Han, Haoyan Xu, Ruixiang Tang

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (8) · 6619-6627

DOI: 10.1609/aaai.v40i8.37592 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Yanshu Li und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Modern large vision-language models (LVLMs) convert each input image into a large set of tokens that far outnumber the text tokens. Although this improves visual perception, it also introduces severe image token redundancy. Because image tokens contain sparse information, many contribute little to reasoning but greatly increase inference cost. Recent image token pruning methods address this issue by identifying important tokens and removing the rest. These methods improve efficiency with only small performance drops. However, most of them focus on single-image tasks and overlook multimodal in-context learning (ICL), where redundancy is higher and efficiency is more important. Redundant tokens weaken the advantage of multimodal ICL for rapid domain adaptation and lead to unstable performance. When existing pruning methods are applied in this setting, they cause large accuracy drops, which exposes a clear gap and the need for new approaches. To address this, we propose Contextually Adaptive Token Pruning (CATP), a training-free pruning method designed for multimodal ICL. CATP uses two stages of progressive pruning that fully reflect the complex cross-modal interactions in the input sequence. After removing 77.8% of the image tokens, CATP achieves an average performance gain of 0.6% over the vanilla model on four LVLMs and eight benchmarks, clearly outperforming all baselines. At the same time, it improves efficiency by reducing inference latency by an average of 10.78%. CATP strengthens the practical value of multimodal ICL and lays the foundation for future progress in interleaved image-text settings.

Zitieren

APA

Li, Y., Yang, J., Shen, Z., Han, L., Xu, H., & Tang, R. (2026). CATP: Contextually Adaptive Token Pruning for Efficient and Enhanced Multimodal In-Context Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 40(8), 6619-6627. https://doi.org/10.1609/aaai.v40i8.37592

Vancouver

Li Y, Yang J, Shen Z, Han L, Xu H, Tang R. CATP: Contextually Adaptive Token Pruning for Efficient and Enhanced Multimodal In-Context Learning. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(8):6619-6627. doi:10.1609/aaai.v40i8.37592

BibTeX
@article{Li2026,
  author = {Li, Yanshu and Yang, Jianjiang and Shen, Zhennan and Han, Ligong and Xu, Haoyan and Tang, Ruixiang},
  title = {CATP: Contextually Adaptive Token Pruning for Efficient and Enhanced Multimodal In-Context Learning},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {8},
  pages = {6619--6627},
  doi = {10.1609/aaai.v40i8.37592}
}
Kostenlos starten →