Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2026-05 · 48 (5) · 5672-5691
DOI: 10.1109/tpami.2026.3651319 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2026-05. Verfasst von Hao Dong und 6 weiteren Autor:innen. Die Arbeit wurde bisher 19-mal zitiert (Crossref) und nennt 232 Literaturangaben.
Abstract (Originalsprache)
Domain adaptation and generalization are crucial for real-world applications, such as autonomous driving and medical imaging where the model must operate reliably across environments with distinct data distributions. However, these tasks are challenging because the model needs to overcome various domain gaps caused by variations in, for example, lighting, weather, sensor configurations, and so on. Addressing domain gaps simultaneously in different modalities, known as multimodal domain adaptation and generalization, is even more challenging due to unique challenges in different modalities. Over the past few years, significant progress has been made in these areas, with applications ranging from action recognition to semantic segmentation, and more. Recently, the emergence of large-scale pre-trained multimodal foundation models, such as CLIP, has inspired numerous research studies, which leverage these models to enhance downstream adaptation and generalization. This survey summarizes recent advances in multimodal adaptation and generalization, particularly how these areas evolve from traditional approaches to foundation models. Specifically, this survey covers (1) multimodal domain adaptation, (2) multimodal test-time adaptation, (3) multimodal domain generalization, (4) domain adaptation and generalization with the help of multimodal foundation models, and (5) adaptation of multimodal foundation models. For each topic, we formally define the problem and give a thorough review of existing methods. Additionally, we analyze relevant datasets and applications, highlighting open challenges and potential future research directions.
Zitieren
APA
Dong, H., Liu, M., Zhou, K., Chatzi, E., Kannala, J., Stachniss, C., & Fink, O. (2026). Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models. IEEE Transactions on Pattern Analysis and Machine Intelligence, 48(5), 5672-5691. https://doi.org/10.1109/tpami.2026.3651319
Vancouver
Dong H, Liu M, Zhou K, Chatzi E, Kannala J, Stachniss C, et al. Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2026;48(5):5672-5691. doi:10.1109/tpami.2026.3651319
BibTeX
@article{Dong2026,
author = {Dong, Hao and Liu, Moru and Zhou, Kaiyang and Chatzi, Eleni and Kannala, Juho and Stachniss, Cyrill and Fink, Olga},
title = {Advances in Multimodal Adaptation and Generalization: From Traditional Approaches to Foundation Models},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2026},
volume = {48},
number = {5},
pages = {5672--5691},
doi = {10.1109/tpami.2026.3651319}
}
EUVIMED