EUVIMEDEUVIMED entdecken
Crossref

A Reliable Multimodal Method Considering Modality-Specific Subspace Learning

Gu Zhou, Yinan Han, Wei Sun

The European Journal on Artificial Intelligence · 11.06.2026

DOI: 10.1177/30504554261444935 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The European Journal on Artificial Intelligence, online erschienen am 11.06.2026. Verfasst von Gu Zhou und 2 weiteren Autor:innen. Die Arbeit nennt 42 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Representation learning is critical for multimodal methods; traditional consistency-based multimodal methods always constrain the disagreements among different modality embeddings or predictions as an extra regularization. However, these methods may appear to cause performance degeneration in open environments. This is mainly attributed to the interference of asymmetric information, that is, different modality information exists divergence, whereas consistency regularization prefers to simply minimize the divergence rather than optimal classifiers. Therefore, it is unsafe to directly use consistency regularization. To this end, we propose modality-specific subspace learning (MSSL). It learns the modality-specific subspace representations by treating modality divergence and consistency separately. In particular, MSSL is a semi-supervised framework that maps different modality feature embeddings into shared and independent subspaces. The shared subspace applies reliable consistency regularization by measuring intermodality structural similarities. The independent subspace uses a discriminative modality-separation network to emphasize modality complementary information. Finally, labeled instances from different modalities are classified with weighted predictions over concatenated embeddings. Consequently, MSSL improves both the single modal and ensemble classification results and acquires more robust mapping among different modalities. Empirical studies show the superior performance of MSSL on real-world datasets.

Zitieren

APA

Zhou, G., Han, Y., & Sun, W. (2026). A Reliable Multimodal Method Considering Modality-Specific Subspace Learning. The European Journal on Artificial Intelligence. https://doi.org/10.1177/30504554261444935

Vancouver

Zhou G, Han Y, Sun W. A Reliable Multimodal Method Considering Modality-Specific Subspace Learning. The European Journal on Artificial Intelligence. 2026. doi:10.1177/30504554261444935

BibTeX
@article{Zhou2026,
  author = {Zhou, Gu and Han, Yinan and Sun, Wei},
  title = {A Reliable Multimodal Method Considering Modality-Specific Subspace Learning},
  journal = {The European Journal on Artificial Intelligence},
  year = {2026},
  doi = {10.1177/30504554261444935}
}
Kostenlos starten →