EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Lightweight Hybrid Model with Location-Preserving ViT for Efficient Food Recognition

Guorui Sheng iD, Weiqing Min iD, Xiangyi Zhu, Liang Xu, Qingshuo Sun, Yancun Yang, Lili Wang, Shuqiang Jiang

Nutrients · 2024

DOI: 10.3390/nu16020200 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Nutrients, 2024. Verfasst von Guorui Sheng und 7 weiteren Autor:innen. Beteiligte Einrichtung: School of Information and Electrical Engineering, Ludong University, Yantai 264025, China. Hauptthemen laut MEDLINE: Food, Extracellular Traps. Die Arbeit wurde bisher 27-mal zitiert (Crossref) und nennt 51 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Food-image recognition plays a pivotal role in intelligent nutrition management, and lightweight recognition methods based on deep learning are crucial for enabling mobile deployment. This capability empowers individuals to effectively manage their daily diet and nutrition using devices such as smartphones. In this study, we propose an Efficient Hybrid Food Recognition Net (EHFR–Net), a novel neural network that integrates Convolutional Neural Networks (CNN) and Vision Transformer (ViT). We find that in the context of food-image recognition tasks, while ViT demonstrates superiority in extracting global information, its approach of disregarding the initial spatial information hampers its efficacy. Therefore, we designed a ViT method termed Location-Preserving Vision Transformer (LP–ViT), which retains positional information during the global information extraction process. To ensure the lightweight nature of the model, we employ an inverted residual block on the CNN side to extract local features. Global and local features are seamlessly integrated by directly summing and concatenating the outputs from the convolutional and ViT structures, resulting in the creation of a unified Hybrid Block (HBlock) in a coherent manner. Moreover, we optimize the hierarchical layout of EHFR–Net to accommodate the unique characteristics of HBlock, effectively reducing the model size. Our extensive experiments on three well-known food image-recognition datasets demonstrate the superiority of our approach. For instance, on the ETHZ Food–101 dataset, our method achieves an outstanding recognition accuracy of 90.7%, which is 3.5% higher than the state-of-the-art ViT-based lightweight network MobileViTv2 (87.2%), which has an equivalent number of parameters and calculations.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

FoodExtracellular TrapsHumansNutritional StatusCognitionIntelligenceReceptor Protein-Tyrosine Kinases

Stichwörter der Autor:innen

ViTfood recognitionglobal featurelightweightnutrition management

Substanzen

Receptor Protein-Tyrosine Kinases

Autor:innen und Institutionen

  • School of Information and Electrical Engineering, Ludong University, Yantai 264025, China.
  • Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100190, China.
  • School of Computer Science and Technology, University of Chinese Academy of Sciences, Beijing 100190, China.

ORCID-Profile: Guorui Sheng, Weiqing Min

Zitieren

APA

Sheng, G., Min, W., Zhu, X., Xu, L., Sun, Q., Yang, Y., Wang, L., & Jiang, S. (2024). A Lightweight Hybrid Model with Location-Preserving ViT for Efficient Food Recognition. Nutrients. https://doi.org/10.3390/nu16020200

Vancouver

Sheng G, Min W, Zhu X, Xu L, Sun Q, Yang Y, et al. A Lightweight Hybrid Model with Location-Preserving ViT for Efficient Food Recognition. Nutrients. 2024. doi:10.3390/nu16020200

BibTeX
@article{Sheng2024,
  author = {Sheng, Guorui and Min, Weiqing and Zhu, Xiangyi and Xu, Liang and Sun, Qingshuo and Yang, Yancun and Wang, Lili and Jiang, Shuqiang},
  title = {A Lightweight Hybrid Model with Location-Preserving ViT for Efficient Food Recognition},
  journal = {Nutrients},
  year = {2024},
  doi = {10.3390/nu16020200}
}
Kostenlos starten →