Large Language Models Meet Extreme Multi-label Classification: Scaling and Multi-modal Framework
Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (29) · 24630-24638
DOI: 10.1609/aaai.v40i29.39647 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Diego Ortego und 5 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref).
Abstract (Originalsprache)
Foundation models have revolutionized artificial intelligence across numerous domains, yet their transformative potential remains largely untapped in Extreme Multi-label Classification (XMC). Queries in XMC are associated with relevant labels from extremely large label spaces, where it is critical to strike a balance between efficiency and performance. Therefore, many recent approaches efficiently pose XMC as a maximum inner product search between embeddings learned from small encoder-only transformer architectures. In this paper, we address two important aspects in XMC: how to effectively harness larger decoder-only models, and how to exploit visual information while maintaining computational efficiency. We demonstrate that both play a critical role in XMC separately and can be combined for improved performance. We show that a few billion-size decoder can deliver substantial improvements while keeping computational overhead manageable. Furthermore, our Vision-enhanced eXtreme Multi-label Learning framework (ViXML) efficiently integrates foundation vision models by pooling a single embedding per image. This limits computational growth while unlocking multi-modal capabilities. Remarkably, ViXML with small encoders outperforms text-only decoder in most cases, showing that an image is worth billions of parameters. Finally, we present an extension of existing text-only datasets to exploit visual metadata and make them available for future benchmarking. Comprehensive experiments across four public text-only datasets and their corresponding image enhanced versions validate our proposals' effectiveness, surpassing previous state-of-the-art by up to +8.21% in P@1 on the largest dataset.
Zitieren
APA
Ortego, D., Rodríguez, M., Almagro, M., Dahiya, K., Jimenez, D., & SanMiguel, J. C. (2026). Large Language Models Meet Extreme Multi-label Classification: Scaling and Multi-modal Framework. Proceedings of the AAAI Conference on Artificial Intelligence, 40(29), 24630-24638. https://doi.org/10.1609/aaai.v40i29.39647
Vancouver
Ortego D, Rodríguez M, Almagro M, Dahiya K, Jimenez D, SanMiguel JC. Large Language Models Meet Extreme Multi-label Classification: Scaling and Multi-modal Framework. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(29):24630-24638. doi:10.1609/aaai.v40i29.39647
BibTeX
@article{Ortego2026,
author = {Ortego, Diego and Rodríguez, Marlon and Almagro, Mario and Dahiya, Kunal and Jimenez, David and SanMiguel, Juan C.},
title = {Large Language Models Meet Extreme Multi-label Classification: Scaling and Multi-modal Framework},
journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
year = {2026},
volume = {40},
number = {29},
pages = {24630--24638},
doi = {10.1609/aaai.v40i29.39647}
}
EUVIMED