EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multi-objective Hardware-aware Neural Architecture Search with Pareto Rank-preserving Surrogate Models

Hadjer Benmeziane, Hamza Ouarnoughi, Kaoutar El Maghraoui, Smail Niar

ACM Transactions on Architecture and Code Optimization · 30.06.2023 · 20 (2) · 1-21

DOI: 10.1145/3579853 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Architecture and Code Optimization, online erschienen am 15.04.2023. Verfasst von Hadjer Benmeziane und 3 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep learning (DL) models such as convolutional neural networks (ConvNets) are being deployed to solve various computer vision and natural language processing tasks at the edge. It is a challenge to find the right DL architecture that simultaneously meets the accuracy, power, and performance budgets of such resource-constrained devices. Hardware-aware Neural Architecture Search (HW-NAS) has recently gained steam by automating the design of efficient DL models for a variety of target hardware platforms. However, such algorithms require excessive computational resources. Thousands of GPU days are required to evaluate and explore an architecture search space such as FBNet [ 45 ]. State-of-the-art approaches propose using surrogate models to predict architecture accuracy and hardware performance to speed up HW-NAS. Existing approaches use independent surrogate models to estimate each objective, resulting in non-optimal Pareto fronts. In this article, HW-PR-NAS, 1 a novel Pareto rank-preserving surrogate model for edge computing platforms, is presented. Our model integrates a new loss function that ranks the architectures according to their Pareto rank, regardless of the actual values of the various objectives. We employ a simple yet effective surrogate model architecture that can be generalized to any standard DL model. We then present an optimized evolutionary algorithm that uses and validates our surrogate model. Our approach has been evaluated on seven edge hardware platforms from various classes, including ASIC, FPGA, GPU, and multi-core CPU. The evaluation results show that HW-PR-NAS achieves up to 2.5× speedup compared to state-of-the-art methods while achieving 98% near the actual Pareto front.

Zitieren

APA

Benmeziane, H., Ouarnoughi, H., Maghraoui, K. E., & Niar, S. (2023). Multi-objective Hardware-aware Neural Architecture Search with Pareto Rank-preserving Surrogate Models. ACM Transactions on Architecture and Code Optimization, 20(2), 1-21. https://doi.org/10.1145/3579853

Vancouver

Benmeziane H, Ouarnoughi H, Maghraoui KE, Niar S. Multi-objective Hardware-aware Neural Architecture Search with Pareto Rank-preserving Surrogate Models. ACM Transactions on Architecture and Code Optimization. 2023;20(2):1-21. doi:10.1145/3579853

BibTeX
@article{Benmeziane2023,
  author = {Benmeziane, Hadjer and Ouarnoughi, Hamza and Maghraoui, Kaoutar El and Niar, Smail},
  title = {Multi-objective Hardware-aware Neural Architecture Search with Pareto Rank-preserving Surrogate Models},
  journal = {ACM Transactions on Architecture and Code Optimization},
  year = {2023},
  volume = {20},
  number = {2},
  pages = {1--21},
  doi = {10.1145/3579853}
}
Kostenlos starten →