Multi-Modal Machine Learning in Engineering Design: A Review and Future Directions
Journal of Computing and Information Science in Engineering · 01.01.2024 · 24 (1)
DOI: 10.1115/1.4063954 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 24.11.2023. Verfasst von Binyang Song und 2 weiteren Autor:innen. Die Arbeit wurde bisher 81-mal zitiert (Crossref) und nennt 285 Literaturangaben.
Abstract (Originalsprache)
In the rapidly advancing field of multi-modal machine learning (MMML), the convergence of multiple data modalities has the potential to reshape various applications. This paper presents a comprehensive overview of the current state, advancements, and challenges of MMML within the sphere of engineering design. The review begins with a deep dive into five fundamental concepts of MMML: multi-modal information representation, fusion, alignment, translation, and co-learning. Following this, we explore the cutting-edge applications of MMML, placing a particular emphasis on tasks pertinent to engineering design, such as cross-modal synthesis, multi-modal prediction, and cross-modal information retrieval. Through this comprehensive overview, we highlight the inherent challenges in adopting MMML in engineering design, and proffer potential directions for future research. To spur on the continued evolution of MMML in engineering design, we advocate for concentrated efforts to construct extensive multi-modal design datasets, develop effective data-driven MMML techniques tailored to design applications, and enhance the scalability and interpretability of MMML models. MMML models, as the next generation of intelligent design tools, hold a promising future to impact how products are designed.
Zitieren
APA
Song, B., Zhou, R., & Ahmed, F. (2024). Multi-Modal Machine Learning in Engineering Design: A Review and Future Directions. Journal of Computing and Information Science in Engineering, 24(1). https://doi.org/10.1115/1.4063954
Vancouver
Song B, Zhou R, Ahmed F. Multi-Modal Machine Learning in Engineering Design: A Review and Future Directions. Journal of Computing and Information Science in Engineering. 2024;24(1). doi:10.1115/1.4063954
BibTeX
@article{Song2024,
author = {Song, Binyang and Zhou, Rui and Ahmed, Faez},
title = {Multi-Modal Machine Learning in Engineering Design: A Review and Future Directions},
journal = {Journal of Computing and Information Science in Engineering},
year = {2024},
volume = {24},
number = {1},
doi = {10.1115/1.4063954}
}
EUVIMED