A Review of State-of-the-art Mixed-Precision Neural Network Frameworks
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-12 · 46 (12) · 7793-7812
DOI: 10.1109/tpami.2024.3394390 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-12. Verfasst von Mariam Rakka und 3 weiteren Autor:innen. Die Arbeit wurde bisher 33-mal zitiert (Crossref) und nennt 157 Literaturangaben. Gefördert von: King Abdullah University of Science and Technology CRG.
Abstract (Originalsprache)
Mixed-precision Deep Neural Networks (DNNs) provide an efficient solution for hardware deployment, especially under resource constraints, while maintaining model accuracy. Identifying the ideal bit precision for each layer, however, remains a challenge given the vast array of models, datasets, and quantization schemes, leading to an expansive search space. Recent literature has addressed this challenge, resulting in several promising frameworks. This paper offers a comprehensive overview of the standard quantization classifications prevalent in existing studies. A detailed survey of current mixed-precision frameworks is provided, with an in-depth comparative analysis highlighting their respective merits and limitations. The paper concludes with insights into potential avenues for future research in this domain.
Förderung
- King Abdullah University of Science and Technology CRG
Zitieren
APA
Rakka, M., Fouda, M. E., Khargonekar, P., & Kurdahi, F. (2024). A Review of State-of-the-art Mixed-Precision Neural Network Frameworks. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(12), 7793-7812. https://doi.org/10.1109/tpami.2024.3394390
Vancouver
Rakka M, Fouda ME, Khargonekar P, Kurdahi F. A Review of State-of-the-art Mixed-Precision Neural Network Frameworks. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(12):7793-7812. doi:10.1109/tpami.2024.3394390
BibTeX
@article{Rakka2024,
author = {Rakka, Mariam and Fouda, Mohammed E and Khargonekar, Pramod and Kurdahi, Fadi},
title = {A Review of State-of-the-art Mixed-Precision Neural Network Frameworks},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {12},
pages = {7793--7812},
doi = {10.1109/tpami.2024.3394390}
}
EUVIMED