EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating and accelerating vision transformers on GPU-based embedded edge AI systems

Ignacio Martin-Salinas, Jose M. Badia, Oscar Valls, German Leon, Rocio del Amor, Jose A. Belloch, Adrian Amor-Martin, Valery Naranjo

The Journal of Supercomputing · 2025-01 · 81 (1)

DOI: 10.1007/s11227-024-06807-1 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The Journal of Supercomputing, online erschienen am 27.12.2024. Verfasst von Ignacio Martin-Salinas und 7 weiteren Autor:innen. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 21 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministerio de Ciencia, Innovación y Universidades, Universitat Jaume I.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Many current embedded systems comprise heterogeneous computing components including quite powerful GPUs, which enables their application across diverse sectors. This study demonstrates the efficient execution of a medium-sized self-supervised audio spectrogram transformer (SSAST) model on a low-power system-on-chip (SoC). Through comprehensive evaluation, including real time inference scenarios, we show that GPUs outperform multi-core CPUs in inference processes. Optimization techniques such as adjusting batch size, model compilation with TensorRT, and reducing data precision significantly enhance inference time, energy consumption, and memory usage. In particular, negligible accuracy degradation is observed, with post-training quantization to 8-bit integers showing less than 1% loss. This research underscores the feasibility of deploying transformer neural networks on low-power embedded devices, ensuring efficiency in time, energy, and memory, while maintaining the accuracy of the results.

Förderung

  • Ministerio de Ciencia, Innovación y Universidades
  • Universitat Jaume I

Zitieren

APA

Martin-Salinas, I., Badia, J. M., Valls, O., Leon, G., Amor, R. D., Belloch, J. A., Amor-Martin, A., & Naranjo, V. (2025). Evaluating and accelerating vision transformers on GPU-based embedded edge AI systems. The Journal of Supercomputing, 81(1). https://doi.org/10.1007/s11227-024-06807-1

Vancouver

Martin-Salinas I, Badia JM, Valls O, Leon G, Amor RD, Belloch JA, et al. Evaluating and accelerating vision transformers on GPU-based embedded edge AI systems. The Journal of Supercomputing. 2025;81(1). doi:10.1007/s11227-024-06807-1

BibTeX
@article{MartinSalinas2025,
  author = {Martin-Salinas, Ignacio and Badia, Jose M. and Valls, Oscar and Leon, German and Amor, Rocio del and Belloch, Jose A. and Amor-Martin, Adrian and Naranjo, Valery},
  title = {Evaluating and accelerating vision transformers on GPU-based embedded edge AI systems},
  journal = {The Journal of Supercomputing},
  year = {2025},
  volume = {81},
  number = {1},
  doi = {10.1007/s11227-024-06807-1}
}
Kostenlos starten →