Surveying Nutrient Assessment with Photographs of Meals (SNAPMe): A Benchmark Dataset of Food Photos for Dietary Assessment
Nutrients · 2023
DOI: 10.3390/nu15234972 ↗Kurz gefasst
Fachartikel in der Zeitschrift Nutrients, 2023. Verfasst von Jules A Larke und 8 weiteren Autor:innen. Beteiligte Einrichtung: United States Department of Agriculture, Agricultural Research Service, Western Human Nutrition Research Center, Davis, CA 95616, USA. Hauptthemen laut MEDLINE: Nutrition Assessment, Artificial Intelligence. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 47 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: United States Department of Agriculture, United States Department of Agriculture (USDA)/NSF AI Institute, USDA ARS.
Abstract (Originalsprache)
Photo-based dietary assessment is becoming more feasible as artificial intelligence methods improve. However, advancement of these methods for dietary assessment in research settings has been hindered by the lack of an appropriate dataset against which to benchmark algorithm performance. We conducted the Surveying Nutrient Assessment with Photographs of Meals (SNAPMe) study (ClinicalTrials ID: NCT05008653) to pair meal photographs with traditional food records. Participants were recruited nationally, and 110 enrollment meetings were completed via web-based video conferencing. Participants uploaded and annotated their meal photos using a mobile phone app called Bitesnap and completed food records using the Automated Self-Administered 24-h Dietary Assessment Tool (ASA24®) version 2020. Participants included photos before and after eating non-packaged and multi-serving packaged meals, as well as photos of the front and ingredient labels for single-serving packaged foods. The SNAPMe Database (DB) contains 3311 unique food photos linked with 275 ASA24 food records from 95 participants who photographed all foods consumed and recorded food records in parallel for up to 3 study days each. The use of the SNAPMe DB to evaluate ingredient prediction demonstrated that the publicly available algorithms FB Inverse Cooking and Im2Recipe performed poorly, especially for single-ingredient foods and beverages. Correlations between nutrient estimates common to the Bitesnap and ASA24 dietary assessment tools indicated a range in predictive capacity across nutrients (cholesterol, adjusted R2 = 0.85, p < 0.0001; food folate, adjusted R2 = 0.21, p < 0.05). SNAPMe DB is a publicly available benchmark for photo-based dietary assessment in nutrition research. Its demonstrated utility suggested areas of needed improvement, especially the prediction of single-ingredient foods and beverages.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- United States Department of Agriculture, Agricultural Research Service, Western Human Nutrition Research Center, Davis, CA 95616, USA.
- Department of Nutrition, University of California Davis, Davis, CA 95616, USA.
- Department of Computer Science, University of California Davis, Davis, CA 95616, USA.
ORCID-Profile: Yasmine Y Bouzid, Danielle G Lemay
Förderung
- United States Department of Agriculture
- United States Department of Agriculture (USDA)/NSF AI Institute
- USDA ARS
- SCINet
- AI Center of Excellence of the USDA Agricultural Research Service
Zitieren
APA
Larke, J. A., Chin, E. L., Bouzid, Y. Y., Nguyen, T., Vainberg, Y., Lee, D. H., Pirsiavash, H., Smilowitz, J. T., & Lemay, D. G. (2023). Surveying Nutrient Assessment with Photographs of Meals (SNAPMe): A Benchmark Dataset of Food Photos for Dietary Assessment. Nutrients. https://doi.org/10.3390/nu15234972
Vancouver
Larke JA, Chin EL, Bouzid YY, Nguyen T, Vainberg Y, Lee DH, et al. Surveying Nutrient Assessment with Photographs of Meals (SNAPMe): A Benchmark Dataset of Food Photos for Dietary Assessment. Nutrients. 2023. doi:10.3390/nu15234972
BibTeX
@article{Larke2023,
author = {Larke, Jules A and Chin, Elizabeth L and Bouzid, Yasmine Y and Nguyen, Tu and Vainberg, Yael and Lee, Dong Hee and Pirsiavash, Hamed and Smilowitz, Jennifer T and Lemay, Danielle G},
title = {Surveying Nutrient Assessment with Photographs of Meals (SNAPMe): A Benchmark Dataset of Food Photos for Dietary Assessment},
journal = {Nutrients},
year = {2023},
doi = {10.3390/nu15234972}
}
EUVIMED