EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

PERTINENCE: Input-Based Opportunistic Neural Network Dynamic Execution

Omkar Shende, Gayathri Ananthanarayanan, Marcello Traiola

IEEE Access · 2026 · 14 · 100477-100495

DOI: 10.1109/access.2026.3707342 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2026. Verfasst von Omkar Shende und 2 weiteren Autor:innen. Die Arbeit nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Inria through the Associate Team Approximation-aware Training of DNNs for Edge AI Hardware, French National Research Agency (ANR) through the project Resource-Aware DYnamically Adaptable machine Learning, project Runtime Self-adaptable Approximate Hardware Accelerators for Deep Learning.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Deep neural networks (DNNs) have become ubiquitous thanks to their remarkable ability to model complex patterns across various domains such as computer vision, speech recognition, robotics, etc. While large DNN models are often more accurate than simpler, lightweight models, they are also resource- and energy-hungry. Hence, it is imperative to design methods to reduce reliance on such large models without significant degradation in output accuracy. The high computational cost of these models is often necessary only for a reduced set of challenging inputs, while lighter models can handle most simple ones. Thus, carefully combining properties of existing DNN models in a dynamic and input-based way opens opportunities to improve efficiency without compromising accuracy. In this work, we introduce PERTINENCE, a novel runtime method to dynamically select, from a set of pre-trained models, the most lightweight one that correctly processes a given input. To achieve this, we use an ML-based input dispatcher that chooses the model to process the current input. We explore the training space of the input dispatcher using a genetic algorithm to identify the Pareto front of training solutions that offer trade-offs between overall accuracy and computational efficiency. We showcase our approach on state-of-the-art Convolutional Neural Networks (CNNs) trained on the CIFAR-10 and CIFAR-100 datasets, as well as Vision Transformers (ViTs) trained on the TinyImageNet dataset. Furthermore, we showcase PERTINENCE in a YOLO-based road occupancy estimation application that processes real-time video feeds from cameras installed at the road’s intersection. We report results showing PERTINENCE’s ability to provide alternative solutions to existing state-of-the-art models, balancing accuracy and the number of operations. The results show that, thanks to dynamic selection of pre-trained models, PERTINENCE achieves comparable or higher accuracy compared to the best pre-trained model, with up to 36% fewer operations with equivalent or lower end-to-end inference time using tunable invocation intervals.

Förderung

  • Inria through the Associate Team Approximation-aware Training of DNNs for Edge AI Hardware
  • French National Research Agency (ANR) through the project Resource-Aware DYnamically Adaptable machine Learning
  • project Runtime Self-adaptable Approximate Hardware Accelerators for Deep Learning

Zitieren

APA

Shende, O., Ananthanarayanan, G., & Traiola, M. (2026). PERTINENCE: Input-Based Opportunistic Neural Network Dynamic Execution. IEEE Access, 14, 100477-100495. https://doi.org/10.1109/access.2026.3707342

Vancouver

Shende O, Ananthanarayanan G, Traiola M. PERTINENCE: Input-Based Opportunistic Neural Network Dynamic Execution. IEEE Access. 2026;14:100477-100495. doi:10.1109/access.2026.3707342

BibTeX
@article{Shende2026,
  author = {Shende, Omkar and Ananthanarayanan, Gayathri and Traiola, Marcello},
  title = {PERTINENCE: Input-Based Opportunistic Neural Network Dynamic Execution},
  journal = {IEEE Access},
  year = {2026},
  volume = {14},
  pages = {100477--100495},
  doi = {10.1109/access.2026.3707342}
}
Kostenlos starten →