Visual nutrition analysis: leveraging segmentation and regression for food nutrient estimation
Frontiers in Nutrition · 17.12.2024 · 11
DOI: 10.3389/fnut.2024.1469878 ↗Kurz gefasst
Fachartikel in der Zeitschrift Frontiers in Nutrition, online erschienen am 17.12.2024. Verfasst von Yaping Zhao und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu, China. Die Arbeit wurde bisher 22-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Introduction
Nutrition is closely related to body health. A reasonable diet structure not only meets the body’s needs for various nutrients but also effectively prevents many chronic diseases. However, due to the general lack of systematic nutritional knowledge, people often find it difficult to accurately assess the nutritional content of food. In this context, image-based nutritional evaluation technology can provide significant assistance. Therefore, we are dedicated to directly predicting the nutritional content of dishes through images. Currently, most related research focuses on estimating the volume or area of food through image segmentation tasks and then calculating its nutritional content based on the food category. However, this method often lacks real nutritional content labels as a reference, making it difficult to ensure the accuracy of the predictions.
Methods
To address this issue, we combined segmentation and regression tasks and used the Nutrition5k dataset, which contains detailed nutritional content labels but no segmentation labels, for manual segmentation annotation. Based on these annotated data, we developed a nutritional content prediction model that performs segmentation first and regression afterward. Specifically, we first applied the UNet model to segment the food, then used a backbone network to extract features, and enhanced the feature expression capability through the Squeeze-and-Excitation structure. Finally, the extracted features were processed through several fully connected layers to obtain predictions for the weight, calories, fat, carbohydrates, and protein content. Results and discussion Our model achieved an outstanding average percentage mean absolute error (PMAE) of 17.06% for these components. All manually annotated segmentation labels can be found at https://doi.org/10.6084/m9.figshare.26252048.v1 .
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- School of Artificial Intelligence and Computer Science, Jiangnan University, Wuxi, Jiangsu, China.
- Changshu Key Laboratory of Medical Artificial Intelligence and Big Data, Suzhou, Jiangsu, China.
- Department of Scientific Research, The Changshu Affiliated Hospital of Soochow University, Suzhou, Jiangsu, China.
Zitieren
APA
Zhao, Y., Zhu, P., Jiang, Y., & Xia, K. (2024). Visual nutrition analysis: leveraging segmentation and regression for food nutrient estimation. Frontiers in Nutrition, 11. https://doi.org/10.3389/fnut.2024.1469878
Vancouver
Zhao Y, Zhu P, Jiang Y, Xia K. Visual nutrition analysis: leveraging segmentation and regression for food nutrient estimation. Frontiers in Nutrition. 2024;11. doi:10.3389/fnut.2024.1469878
BibTeX
@article{Zhao2024,
author = {Zhao, Yaping and Zhu, Ping and Jiang, Yizhang and Xia, Kaijian},
title = {Visual nutrition analysis: leveraging segmentation and regression for food nutrient estimation},
journal = {Frontiers in Nutrition},
year = {2024},
volume = {11},
doi = {10.3389/fnut.2024.1469878}
}
EUVIMED