EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

An Optimal-Transport-Based Multimodal Big Data Clustering

Zheng Yang, Chongyang Shi, Ying Guan

Electronics · 08.02.2025 · 14 (4) · 666

DOI: 10.3390/electronics14040666 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Electronics, online erschienen am 08.02.2025. Verfasst von Zheng Yang und 2 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Liaoning Provincial Department of Education Scientific Research Fund Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Multimodal clustering achieves outstanding performance in various applications by aggregating information from heterogeneous devices. However, previous methods rely on strong-notion distances to fuse crossmodal complementary knowledge, established on a fragile assumption about the existence of a ubiquitous non-negligible intersection between heterogeneous manifolds of modalities. Due to this unstable theoretical basis, previous methods are essentially challenged by limited performance on general multimodal data. To address this challenge, an optimal-transport-based multimodal clustering (OTMC) method is defined as the optimal transport (OT) from multimodal data distributions to clustering distributions, which leverages a weak-topology measure to capture complementary knowledge with clear discriminative structures. OTMC consists of a modality-specific OT delivering private structures and a modality-common OT delivering shared structures, which transports category structures scattered in manifolds of each modality and all modalities to common prototypes, respectively. Furthermore, variational solutions to OTMC are derived by matching the data-prototype joint distribution, which induces the multimodal OT clustering network, to capture discriminative structures. Finally, the experimental results from four real-world datasets demonstrate the superiority of OTMC, helped by never relying on the phantom of heterogeneous manifold intersections. In particular, OTMC obtains 92.15% ACC, 84.96% NMI, and 83.35% ARI on Handwritten, improving by 2.25%, 2.82%, and 3.28%, respectively.

Förderung

  • Liaoning Provincial Department of Education Scientific Research Fund Project

Zitieren

APA

Yang, Z., Shi, C., & Guan, Y. (2025). An Optimal-Transport-Based Multimodal Big Data Clustering. Electronics, 14(4), 666. https://doi.org/10.3390/electronics14040666

Vancouver

Yang Z, Shi C, Guan Y. An Optimal-Transport-Based Multimodal Big Data Clustering. Electronics. 2025;14(4):666. doi:10.3390/electronics14040666

BibTeX
@article{Yang2025,
  author = {Yang, Zheng and Shi, Chongyang and Guan, Ying},
  title = {An Optimal-Transport-Based Multimodal Big Data Clustering},
  journal = {Electronics},
  year = {2025},
  volume = {14},
  number = {4},
  pages = {666},
  doi = {10.3390/electronics14040666}
}
Kostenlos starten →