EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Extract Nutritional Information from Bilingual Food Labels Using Large Language Models

Fatmah Y Assiri iD, Mohammad D Alahmadi iD, Mohammed A Almuashi, Ayidh M Almansour iD

Journal of Imaging · 13.08.2025 · 11 (8) · 271

DOI: 10.3390/jimaging11080271 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Imaging, online erschienen am 13.08.2025. Verfasst von Fatmah Y Assiri und 3 weiteren Autor:innen. Beteiligte Einrichtung: Software Engineering Department, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 39 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Education in Saudi Arabia, Deputyship for Research & Innovation, Ministry of Education, in Saudi Arabia.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Food product labels serve as a critical source of information, providing details about nutritional content, ingredients, and health implications. These labels enable Food and Drug Authorities (FDA) to ensure compliance and take necessary health-related and logistics actions. Additionally, product labels are essential for online grocery stores to offer reliable nutrition facts and empower customers to make informed dietary decisions. Unfortunately, product labels are typically available in image formats, requiring organizations and online stores to manually transcribe them—a process that is not only time-consuming but also highly prone to human error, especially with multilingual labels that add complexity to the task. Our study investigates the challenges and effectiveness of leveraging large language models (LLMs) to extract nutritional elements and values from multilingual food product labels, with a specific focus on Arabic and English. A comprehensive empirical analysis was conducted using a manually curated dataset of 294 food product labels, comprising 588 transcribed nutritional elements and values in both languages, which served as the ground truth for evaluation. The findings reveal that while LLMs performed better in extracting English elements and values compared to Arabic, our post-processing techniques significantly enhanced their accuracy, with GPT-4o outperforming GPT-4V and Gemini.

Schlagwörter

Stichwörter der Autor:innen

LLM (large language model)OCR (optical character recognition)computer vision (CV) text extractionnutrition label

Autor:innen und Institutionen

  • Software Engineering Department, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia.
  • Computer Science and Artificial Intelligence Department, College of Computer Science and Engineering, University of Jeddah, Jeddah 21493, Saudi Arabia.
  • Saudi Food and Drug Authority (SFDA), Riyadh 11671, Saudi Arabia.

ORCID-Profile: Fatmah Y Assiri, Mohammad D Alahmadi, Ayidh M Almansour

Förderung

  • Ministry of Education in Saudi Arabia
  • Deputyship for Research & Innovation, Ministry of Education, in Saudi Arabia

Zitieren

APA

Assiri, F. Y., Alahmadi, M. D., Almuashi, M. A., & Almansour, A. M. (2025). Extract Nutritional Information from Bilingual Food Labels Using Large Language Models. Journal of Imaging, 11(8), 271. https://doi.org/10.3390/jimaging11080271

Vancouver

Assiri FY, Alahmadi MD, Almuashi MA, Almansour AM. Extract Nutritional Information from Bilingual Food Labels Using Large Language Models. Journal of Imaging. 2025;11(8):271. doi:10.3390/jimaging11080271

BibTeX
@article{Assiri2025,
  author = {Assiri, Fatmah Y and Alahmadi, Mohammad D and Almuashi, Mohammed A and Almansour, Ayidh M},
  title = {Extract Nutritional Information from Bilingual Food Labels Using Large Language Models},
  journal = {Journal of Imaging},
  year = {2025},
  volume = {11},
  number = {8},
  pages = {271},
  doi = {10.3390/jimaging11080271}
}
Kostenlos starten →