EUVIMEDEUVIMED entdecken
Crossref

Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models

Hao Dong, Moru Liu, Kaiyang Zhou, Eleni Chatzi, Juho Kannala, Cyrill Stachniss, Olga Fink

IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-05 · 48 (5) · 5672-5691

DOI: 10.1109/tpami.2026.3651319 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-05. Verfasst von Hao Dong und 6 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 232 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Domain adaptation and generalization are crucial for real-world applications, such as autonomous driving and medical imaging where the model must operate reliably across environments with distinct data distributions. However, these tasks are challenging because the model needs to overcome various domain gaps caused by variations in, for example, lighting, weather, sensor configurations, and so on. Addressing domain gaps simultaneously in different modalities, known as multimodal domain adaptation and generalization, is even more challenging due to unique challenges in different modalities. Over the past few years, significant progress has been made in these areas, with applications ranging from action recognition to semantic segmentation, and more. Recently, the emergence of large-scale pre-trained multimodal foundation models, such as CLIP, has inspired numerous research studies, which leverage these models to enhance downstream adaptation and generalization. This survey summarizes recent advances in multimodal adaptation and generalization, particularly how these areas evolve from traditional approaches to foundation models. Specifically, this survey covers (1) multimodal domain adaptation, (2) multimodal test-time adaptation, (3) multimodal domain generalization, (4) domain adaptation and generalization with the help of multimodal foundation models, and (5) adaptation of multimodal foundation models. For each topic, we formally define the problem and give a thorough review of existing methods. Additionally, we analyze relevant datasets and applications, highlighting open challenges and potential future research directions.

Zitieren

APA

Dong, H., Liu, M., Zhou, K., Chatzi, E., Kannala, J., Stachniss, C., & Fink, O. (2026). Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(5), 5672-5691. https://doi.org/10.1109/tpami.2026.3651319

Vancouver

Dong H, Liu M, Zhou K, Chatzi E, Kannala J, Stachniss C, et al. Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(5):5672-5691. doi:10.1109/tpami.2026.3651319

BibTeX
@article{Dong2026,
  author = {Dong, Hao and Liu, Moru and Zhou, Kaiyang and Chatzi, Eleni and Kannala, Juho and Stachniss, Cyrill and Fink, Olga},
  title = {Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models},
  journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
  year = {2026},
  volume = {48},
  number = {5},
  pages = {5672--5691},
  doi = {10.1109/tpami.2026.3651319}
}
Kostenlos starten →