EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Visual nutrition analysis: leveraging segmentation and regression for food nutrient estimation

Yaping Zhao, Ping Zhu, Yizhang Jiang, Kaijian Xia

Frontiers in Nutrition · 17.12.2024 · 11

DOI: 10.3389/fnut.2024.1469878 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Nutrition, online erschienen am 17.12.2024. Verfasst von Yaping Zhao und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu, China. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Introduction

Nutrition is closely related to body health. A reasonable diet structure not only meets the body’s needs for various nutrients but also effectively prevents many chronic diseases. However, due to the general lack of systematic nutritional knowledge, people often find it difficult to accurately assess the nutritional content of food. In this context, image-based nutritional evaluation technology can provide significant assistance. Therefore, we are dedicated to directly predicting the nutritional content of dishes through images. Currently, most related research focuses on estimating the volume or area of food through image segmentation tasks and then calculating its nutritional content based on the food category. However, this method often lacks real nutritional content labels as a reference, making it difficult to ensure the accuracy of the predictions.

Methods

To address this issue, we combined segmentation and regression tasks and used the Nutrition5k dataset, which contains detailed nutritional content labels but no segmentation labels, for manual segmentation annotation. Based on these annotated data, we developed a nutritional content prediction model that performs segmentation first and regression afterward. Specifically, we first applied the UNet model to segment the food, then used a backbone network to extract features, and enhanced the feature expression capability through the Squeeze-and-Excitation structure. Finally, the extracted features were processed through several fully connected layers to obtain predictions for the weight, calories, fat, carbohydrates, and protein content. Results and discussion Our model achieved an outstanding average percentage mean absolute error (PMAE) of 17.06% for these components. All manually annotated segmentation labels can be found at https://doi.org/10.6084/m9.figshare.26252048.v1 .

Schlagwörter

Stichwörter der Autor:innen

Nutrition5kdeep learningimage segmentationnutrition estimationregression

Autor:innen und Institutionen

  • School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu, China.
  • Changshu Key Laboratory of Medical Artificial Intelligence and Big Data, Suzhou, Jiangsu, China.
  • Department of Scientific Research, The Changshu Affiliated Hospital of Soochow University, Suzhou, Jiangsu, China.

Zitieren

APA

Zhao, Y., Zhu, P., Jiang, Y., & Xia, K. (2024). Visual nutrition analysis: leveraging segmentation and regression for food nutrient estimation. Frontiers in Nutrition, 11. https://doi.org/10.3389/fnut.2024.1469878

Vancouver

Zhao Y, Zhu P, Jiang Y, Xia K. Visual nutrition analysis: leveraging segmentation and regression for food nutrient estimation. Frontiers in Nutrition. 2024;11. doi:10.3389/fnut.2024.1469878

BibTeX
@article{Zhao2024,
  author = {Zhao, Yaping and Zhu, Ping and Jiang, Yizhang and Xia, Kaijian},
  title = {Visual nutrition analysis: leveraging segmentation and regression for food nutrient estimation},
  journal = {Frontiers in Nutrition},
  year = {2024},
  volume = {11},
  doi = {10.3389/fnut.2024.1469878}
}
Kostenlos starten →