EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MiRA: Multi‐Granularity Consensus Representation Alignment for Unsupervised Cross‐Modal Retrieval

Xin He, Tingting Xiao, Hongxu Jin, Xiaoyun Ren, Qingchuan Tao

Electronics Letters · 2026-01 · 62 (1)

DOI: 10.1049/ell2.70599 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics Letters, online erschienen am 19.05.2026. Verfasst von Xin He und 4 weiteren Autor:innen. Die Arbeit nennt 15 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The rapid growth of generative artificial intelligence has led to an explosion of multimodal data, intensifying the demand for adaptive cross‐modal retrieval systems. However, persistent semantic and distributional gaps across modalities continue to hinder effective alignment. To alleviate these challenges without incurring prohibitive annotation costs, unsupervised cross‐modal retrieval (UCMR) has emerged as an attractive alternative; nevertheless, it often struggles to establish reliable semantic correspondences due to the absence of supervision. To address this limitation, we propose m ult i ‐granularity consensus r epresentation a lignment (MiRA), an unsupervised framework that enhances semantic consistency and representation robustness via hierarchical, noise‐aware learning. MiRA progressively refines multi‐granular features and aligns cross‐modal representations through consensus‐driven optimization. Specifically, it comprises two key components: (1) progressive agreement clustering (PAC), which improves pseudo‐label reliability by enforcing cross‐layer consistency and reducing uncertainty from single‐granularity representations; and (2) cross‐modal robust association (CRA), which leverages the refined pseudo‐labels to guide representation learning under a hybrid contrastive‐consistency objective, promoting discriminative alignment while suppressing noisy associations. Extensive experiments on four benchmark datasets demonstrate that MiRA consistently surpasses nine state‐of‐the‐art UCMR methods, confirming its effectiveness in capturing hierarchical semantics and achieving robust cross‐modal alignment without supervision.

Zitieren

APA

He, X., Xiao, T., Jin, H., Ren, X., & Tao, Q. (2026). MiRA: Multi‐Granularity Consensus Representation Alignment for Unsupervised Cross‐Modal Retrieval. Electronics Letters, 62(1). https://doi.org/10.1049/ell2.70599

Vancouver

He X, Xiao T, Jin H, Ren X, Tao Q. MiRA: Multi‐Granularity Consensus Representation Alignment for Unsupervised Cross‐Modal Retrieval. Electronics Letters. 2026;62(1). doi:10.1049/ell2.70599

BibTeX
@article{He2026,
  author = {He, Xin and Xiao, Tingting and Jin, Hongxu and Ren, Xiaoyun and Tao, Qingchuan},
  title = {MiRA: Multi‐Granularity Consensus Representation Alignment for Unsupervised Cross‐Modal Retrieval},
  journal = {Electronics Letters},
  year = {2026},
  volume = {62},
  number = {1},
  doi = {10.1049/ell2.70599}
}
Kostenlos starten →