EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

IGSMNet: Ingredient-Guided Semantic Modeling Network for Food Nutrition Estimation

Donglin Zhang, Weixiang Shi, Boyuan Ma, Weiqing Min iD, Xiao-Jun Wu

Foods · 30.10.2025 · 14 (21) · 3697

DOI: 10.3390/foods14213697 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Foods, online erschienen am 30.10.2025. Verfasst von Donglin Zhang und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122, China. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: This work was supported by the National Key Research and Development Program of China., National Key Research and Development Program of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In recent years, food nutrition estimation has received growing attention due to its critical role in dietary analysis and public health. Traditional nutrition assessment methods often rely on manual measurements and expert knowledge, which are time-consuming and not easily scalable. With the advancement of computer vision, RGB-based methods have been proposed, and more recently, RGB-D-based approaches have further improved performance by incorporating depth information to capture spatial cues. While these methods have shown promising results, they still face challenges in complex food scenes, such as limited ability to distinguish visually similar items with different ingredients and insufficient modeling of spatial or semantic relationships. To solve these issues, we propose an Ingredient-Guided Semantic Modeling Network (IGSMNet) for food nutrition estimation. The method introduces an ingredient-guided module that encodes ingredient information using a pre-trained language model and aligns it with visual features via cross-modal attention. At the same time, an internal semantic modeling component is designed to enhance structural understanding through dynamic positional encoding and localized attention, allowing for fine-grained relational reasoning. On the Nutrition5k dataset, our method achieves PMAE values of 12.2% for Calories, 9.4% for Mass, 19.1% for Fat, 18.3% for Carb, and 16.0% for Protein. These results demonstrate that our IGSMNet consistently outperforms existing baselines, validating its effectiveness.

Schlagwörter

Stichwörter der Autor:innen

RGB-D fusionfeature learningfood nutrition estimationingredient-guided modeling

Autor:innen und Institutionen

  • School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi 214122, China.
  • Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences, Beijing 100086, China.

ORCID-Profile: Weiqing Min

Förderung

  • This work was supported by the National Key Research and Development Program of China.
  • National Key Research and Development Program of China

Zitieren

APA

Zhang, D., Shi, W., Ma, B., Min, W., & Wu, X. J. (2025). IGSMNet: Ingredient-Guided Semantic Modeling Network for Food Nutrition Estimation. Foods, 14(21), 3697. https://doi.org/10.3390/foods14213697

Vancouver

Zhang D, Shi W, Ma B, Min W, Wu XJ. IGSMNet: Ingredient-Guided Semantic Modeling Network for Food Nutrition Estimation. Foods. 2025;14(21):3697. doi:10.3390/foods14213697

BibTeX
@article{Zhang2025,
  author = {Zhang, Donglin and Shi, Weixiang and Ma, Boyuan and Min, Weiqing and Wu, Xiao-Jun},
  title = {IGSMNet: Ingredient-Guided Semantic Modeling Network for Food Nutrition Estimation},
  journal = {Foods},
  year = {2025},
  volume = {14},
  number = {21},
  pages = {3697},
  doi = {10.3390/foods14213697}
}
Kostenlos starten →