Multimodal Classification: Current Landscape, Taxonomy and Future Directions
ACM Computing Surveys · 31.07.2023 · 55 (7) · 1-31
DOI: 10.1145/3543848 ↗Kurz gefasst
Fachartikel in der Zeitschrift ACM Computing Surveys, online erschienen am 15.12.2022. Verfasst von William C. Sleeman und 2 weiteren Autor:innen. Die Arbeit wurde bisher 106-mal zitiert (Crossref) und nennt 125 Literaturangaben.
Abstract (Originalsprache)
Multimodal classification research has been gaining popularity with new datasets in domains such as satellite imagery, biometrics, and medicine. Prior research has shown the benefits of combining data from multiple sources compared to traditional unimodal data that has led to the development of many novel multimodal architectures. However, the lack of consistent terminologies and architectural descriptions makes it difficult to compare different solutions. We address these challenges by proposing a new taxonomy for describing multimodal classification models based on trends found in recent publications. Examples of how this taxonomy could be applied to existing models are presented as well as a checklist to aid in the clear and complete presentation of future models. Many of the most difficult aspects of unimodal classification have not yet been fully addressed for multimodal datasets, including big data, class imbalance, and instance-level difficulty. We also provide a discussion of these challenges and future directions of research.
Zitieren
APA
Sleeman, W. C., Kapoor, R., & Ghosh, P. (2023). Multimodal Classification: Current Landscape, Taxonomy and Future Directions. ACM Computing Surveys, 55(7), 1-31. https://doi.org/10.1145/3543848
Vancouver
Sleeman WC, Kapoor R, Ghosh P. Multimodal Classification: Current Landscape, Taxonomy and Future Directions. ACM Computing Surveys. 2023;55(7):1-31. doi:10.1145/3543848
BibTeX
@article{Sleeman2023,
author = {Sleeman, William C. and Kapoor, Rishabh and Ghosh, Preetam},
title = {Multimodal Classification: Current Landscape, Taxonomy and Future Directions},
journal = {ACM Computing Surveys},
year = {2023},
volume = {55},
number = {7},
pages = {1--31},
doi = {10.1145/3543848}
}
EUVIMED