Extract Nutritional Information from Bilingual Food Labels Using Large Language Models
Journal of Imaging · 13.08.2025 · 11 (8) · 271
DOI: 10.3390/jimaging11080271 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 13.08.2025. Verfasst von Fatmah Y Assiri und 3 weiteren Autor:innen. Beteiligte Einrichtung: Software Engineering Department, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education in Saudi Arabia, Deputyship for Research & Innovation, Ministry of Education, in Saudi Arabia.
Abstract (Originalsprache)
Food product labels serve as a critical source of information, providing details about nutritional content, ingredients, and health implications. These labels enable Food and Drug Authorities (FDA) to ensure compliance and take necessary health-related and logistics actions. Additionally, product labels are essential for online grocery stores to offer reliable nutrition facts and empower customers to make informed dietary decisions. Unfortunately, product labels are typically available in image formats, requiring organizations and online stores to manually transcribe them—a process that is not only time-consuming but also highly prone to human error, especially with multilingual labels that add complexity to the task. Our study investigates the challenges and effectiveness of leveraging large language models (LLMs) to extract nutritional elements and values from multilingual food product labels, with a specific focus on Arabic and English. A comprehensive empirical analysis was conducted using a manually curated dataset of 294 food product labels, comprising 588 transcribed nutritional elements and values in both languages, which served as the ground truth for evaluation. The findings reveal that while LLMs performed better in extracting English elements and values compared to Arabic, our post-processing techniques significantly enhanced their accuracy, with GPT-4o outperforming GPT-4V and Gemini.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Software Engineering Department, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia.
- Computer Science and Artificial Intelligence Department, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia.
- Saudi Food and Drug Authority (SFDA), Riyadh 11671, Saudi Arabia.
ORCID-Profile: Fatmah Y Assiri, Mohammad D Alahmadi, Ayidh M Almansour
Förderung
- Ministry of Education in Saudi Arabia
- Deputyship for Research & Innovation, Ministry of Education, in Saudi Arabia
Zitieren
APA
Assiri, F. Y., Alahmadi, M. D., Almuashi, M. A., & Almansour, A. M. (2025). Extract Nutritional Information from Bilingual Food Labels Using Large Language Models. Journal of Imaging, 11(8), 271. https://doi.org/10.3390/jimaging11080271
Vancouver
Assiri FY, Alahmadi MD, Almuashi MA, Almansour AM. Extract Nutritional Information from Bilingual Food Labels Using Large Language Models. Journal of Imaging. 2025;11(8):271. doi:10.3390/jimaging11080271
BibTeX
@article{Assiri2025,
author = {Assiri, Fatmah Y and Alahmadi, Mohammad D and Almuashi, Mohammed A and Almansour, Ayidh M},
title = {Extract Nutritional Information from Bilingual Food Labels Using Large Language Models},
journal = {Journal of Imaging},
year = {2025},
volume = {11},
number = {8},
pages = {271},
doi = {10.3390/jimaging11080271}
}
EUVIMED