EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

RDINet: A Deep Learning Model Integrating RGB-D and Ingredient Features for Food Nutrition Estimation

Zhejun Kuang, Haobo Gao, Jiaxuan Yu, Dawen Sun, Jian Zhao, Lei Sun

Applied Sciences · 01.01.2026 · 16 (1) · 454

DOI: 10.3390/app16010454 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 01.01.2026. Verfasst von Zhejun Kuang und 5 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 50 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Jilin Provincial Department of Science and Technology.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

With growing public health awareness, accurate food nutrition estimation plays an increasingly important role in dietary management and disease prevention. The main bottleneck lies in how to effectively integrate multi-source heterogeneous information. We propose RDINet, a multimodal network that fuses RGB appearance, depth geometry, and ingredient semantics for food nutrition estimation. It comprises two core modules: The RGB-D fusion module integrates the textural appearance of RGB images and the 3D shape information conveyed by depth images through a channel–spatial attention mechanism, achieving a joint understanding of food appearance and geometric morphology without explicit 3D reconstruction; the ingredient fusion module embeds ingredient information into visual features via attention mechanisms, enabling the model to fully leverage components that are visually difficult to discern or prone to confusion, thereby activating corresponding nutritional reasoning pathways and achieving cross-modal inference from explicit observations to latent attributes. Experimental results on the Nutrition5k dataset show that RDINet achieves percentage mean absolute errors (PMAE) of 14.9%, 11.2%, 19.7%, 18.9%, and 19.5% for estimating calories, mass, fat, carbohydrates, and protein, respectively, with a mean PMAE of 16.8% across all metrics, outperforming existing mainstream methods. The results demonstrate that the appearance–geometry–semantics fusion framework is effective.

Förderung

  • Jilin Provincial Department of Science and Technology

Zitieren

APA

Kuang, Z., Gao, H., Yu, J., Sun, D., Zhao, J., & Sun, L. (2026). RDINet: A Deep Learning Model Integrating RGB-D and Ingredient Features for Food Nutrition Estimation. Applied Sciences, 16(1), 454. https://doi.org/10.3390/app16010454

Vancouver

Kuang Z, Gao H, Yu J, Sun D, Zhao J, Sun L. RDINet: A Deep Learning Model Integrating RGB-D and Ingredient Features for Food Nutrition Estimation. Applied Sciences. 2026;16(1):454. doi:10.3390/app16010454

BibTeX
@article{Kuang2026,
  author = {Kuang, Zhejun and Gao, Haobo and Yu, Jiaxuan and Sun, Dawen and Zhao, Jian and Sun, Lei},
  title = {RDINet: A Deep Learning Model Integrating RGB-D and Ingredient Features for Food Nutrition Estimation},
  journal = {Applied Sciences},
  year = {2026},
  volume = {16},
  number = {1},
  pages = {454},
  doi = {10.3390/app16010454}
}
Kostenlos starten →