EUVIMEDEUVIMED entdecken
Crossref

Correspondence Coverage Matters for Multi-Modal Dataset Distillation

Zhuohang Dang, Minnan Luo, Chengyou Jia, Hangwei Qian, Xinyu Zhang, Xiaojun Chang, Ivor Tsang

Proceedings of the AAAI Conference on Artificial Intelligence · 14.03.2026 · 40 (25) · 20693-20701

DOI: 10.1609/aaai.v40i25.39207 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 14.03.2026. Verfasst von Zhuohang Dang und 6 weiteren Autor:innen.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multi-modal dataset distillation (DD) condenses large datasets into compact ones that retain task efficacy by capturing correspondence patterns, i.e., shared semantics between paired modalities. However, such patterns rely on cross-modal similarity and cannot be faithfully captured by intra-modal similarity of current unimodal strategies. As a result, current multi-modal DD methods tend to over-concentrate, redundantly encoding similar correspondence patterns and thus limiting generalizability. To this end, we propose a novel multi-modal DD framework to systematically Promote Correspondence coverage, i.e., ProCo. Initially, we develop a correspondence consistency metric based on cross-modal retrieval distributions to cluster correspondence patterns. These clusters capture the underlying correspondence distribution, enabling ProCo to initialize distilled data with representative patterns while regularizing optimization to promote correspondence representativeness and diversity. Moreover, we employ conditional neural fields for efficient distilled data parameterization, enhancing fine-grained pattern capture while allowing more distilled data under a fixed budget to boost correspondence coverage. Extensive experiments verify that our ProCo achieves superior and elastic budget-efficacy trade-offs, surpassing prior methods by over 15% with 10x distillation budget reduction, highlighting its real-world practicality.

Zitieren

APA

Dang, Z., Luo, M., Jia, C., Qian, H., Zhang, X., Chang, X., & Tsang, I. (2026). Correspondence Coverage Matters for Multi-Modal Dataset Distillation. Proceedings of the AAAI Conference on Artificial Intelligence, 40(25), 20693-20701. https://doi.org/10.1609/aaai.v40i25.39207

Vancouver

Dang Z, Luo M, Jia C, Qian H, Zhang X, Chang X, et al. Correspondence Coverage Matters for Multi-Modal Dataset Distillation. Proceedings of the AAAI Conference on Artificial Intelligence. 2026;40(25):20693-20701. doi:10.1609/aaai.v40i25.39207

BibTeX
@article{Dang2026,
  author = {Dang, Zhuohang and Luo, Minnan and Jia, Chengyou and Qian, Hangwei and Zhang, Xinyu and Chang, Xiaojun and Tsang, Ivor},
  title = {Correspondence Coverage Matters for Multi-Modal Dataset Distillation},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2026},
  volume = {40},
  number = {25},
  pages = {20693--20701},
  doi = {10.1609/aaai.v40i25.39207}
}
Kostenlos starten →