RDINet: A Deep Learning Model Integrating RGB-D and Ingredient Features for Food Nutrition Estimation
Applied Sciences · 01.01.2026 · 16 (1) · 454
DOI: 10.3390/app16010454 ↗Kurz gefasst
Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 01.01.2026. Verfasst von Zhejun Kuang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jilin Provincial Department of Science and Technology.
Abstract (Originalsprache)
With growing public health awareness, accurate food nutrition estimation plays an increasingly important role in dietary management and disease prevention. The main bottleneck lies in how to effectively integrate multi-source heterogeneous information. We propose RDINet, a multimodal network that fuses RGB appearance, depth geometry, and ingredient semantics for food nutrition estimation. It comprises two core modules: The RGB-D fusion module integrates the textural appearance of RGB images and the 3D shape information conveyed by depth images through a channel–spatial attention mechanism, achieving a joint understanding of food appearance and geometric morphology without explicit 3D reconstruction; the ingredient fusion module embeds ingredient information into visual features via attention mechanisms, enabling the model to fully leverage components that are visually difficult to discern or prone to confusion, thereby activating corresponding nutritional reasoning pathways and achieving cross-modal inference from explicit observations to latent attributes. Experimental results on the Nutrition5k dataset show that RDINet achieves percentage mean absolute errors (PMAE) of 14.9%, 11.2%, 19.7%, 18.9%, and 19.5% for estimating calories, mass, fat, carbohydrates, and protein, respectively, with a mean PMAE of 16.8% across all metrics, outperforming existing mainstream methods. The results demonstrate that the appearance–geometry–semantics fusion framework is effective.
Förderung
- Jilin Provincial Department of Science and Technology
Zitieren
APA
Kuang, Z., Gao, H., Yu, J., Sun, D., Zhao, J., & Sun, L. (2026). RDINet: A Deep Learning Model Integrating RGB-D and Ingredient Features for Food Nutrition Estimation. Applied Sciences, 16(1), 454. https://doi.org/10.3390/app16010454
Vancouver
Kuang Z, Gao H, Yu J, Sun D, Zhao J, Sun L. RDINet: A Deep Learning Model Integrating RGB-D and Ingredient Features for Food Nutrition Estimation. Applied Sciences. 2026;16(1):454. doi:10.3390/app16010454
BibTeX
@article{Kuang2026,
author = {Kuang, Zhejun and Gao, Haobo and Yu, Jiaxuan and Sun, Dawen and Zhao, Jian and Sun, Lei},
title = {RDINet: A Deep Learning Model Integrating RGB-D and Ingredient Features for Food Nutrition Estimation},
journal = {Applied Sciences},
year = {2026},
volume = {16},
number = {1},
pages = {454},
doi = {10.3390/app16010454}
}
EUVIMED