EUVIMEDEUVIMED entdecken
Crossref

iCD: An Implicit Clustering Distillation Method for Structural Information Mining (Student Abstract)

Xiang Xue, Yatu Ji, Qing-Dao-Er-Ji Ren, Bao Shi, Min Lu, Nier Wu, Xufei Zhuang, Haiteng Xu, Gan-Qi-Qi-Ge Cha

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (48) · 41436-41438

DOI: 10.1609/aaai.v40i48.42297 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Xiang Xue und 8 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Logit Knowledge Distillation has gained substantial research interest in recent years due to its simplicity and lack of requirement for intermediate feature alignment; however, it suffers from limited interpretability in its decision-making process. To address this, we propose implicit Clustering Distillation (iCD): a simple and effective method that mines and transfers interpretable structural knowledge from logits, without requiring ground-truth labels or feature-space alignment. iCD leverages Gram matrices over decoupled local logit representations to enable student models to learn latent semantic structural patterns. Extensive experiments on benchmark datasets demonstrate the effectiveness of iCD across diverse teacher-student architectures, with particularly strong performance in fine-grained classification tasks---achieving a peak improvement of +5.08% over the baseline.

Zitieren

APA

Xue, X., Ji, Y., Ren, Q., Shi, B., Lu, M., Wu, N., Zhuang, X., Xu, H., & Cha, G. (2026). iCD: An Implicit Clustering Distillation Method for Structural Information Mining (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence, 40(48), 41436-41438. https://doi.org/10.1609/aaai.v40i48.42297

Vancouver

Xue X, Ji Y, Ren Q, Shi B, Lu M, Wu N, et al. iCD: An Implicit Clustering Distillation Method for Structural Information Mining (Student Abstract). Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(48):41436-41438. doi:10.1609/aaai.v40i48.42297

BibTeX
@article{Xue2026,
  author = {Xue, Xiang and Ji, Yatu and Ren, Qing-Dao-Er-Ji and Shi, Bao and Lu, Min and Wu, Nier and Zhuang, Xufei and Xu, Haiteng and Cha, Gan-Qi-Qi-Ge},
  title = {iCD: An Implicit Clustering Distillation Method for Structural Information Mining (Student Abstract)},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {48},
  pages = {41436--41438},
  doi = {10.1609/aaai.v40i48.42297}
}
Kostenlos starten →