EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Evaluating the use of LLM-based multi-agent systems for internal information sharing and access within manufacturing

Ngoc Bach Nguyen, Sam Brooks, Zhengyang Ling

The International Journal of Advanced Manufacturing Technology · 06.11.2026

DOI: 10.1007/s00170-026-19467-7 ↗

Kurz gefasst

Fachartikel in der Zeitschrift The International Journal of Advanced Manufacturing Technology, online erschienen am 06.11.2026. Verfasst von Ngoc Bach Nguyen und 2 weiteren Autor:innen. Die Arbeit nennt 48 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Internal information sharing in manufacturing remains constrained by data silos, heterogeneous systems, poor data quality, and limited interoperability across ISA-95 levels. While Large Language Models (LLMs) are increasingly proposed for manufacturing information access and for integrating information with operational technology, there is limited empirical evidence comparing their performance with unassisted human users on representative manufacturing tasks. This paper evaluates a modular LLM-based multi-agent system (MAS) for retrieving and synthesising information across heterogeneous data sources from a 3D-printing factory demonstrator. The system was benchmarked against human participants and other LLM systems (Retrieval-Augmented Generation, Single Agent, Zero-Shot, and rule-based deterministic system) on traceability and certification tasks involving packing lists, relationship-tracking records, machine logs, location-tracking data, and Authorised Release Certificates (ARCs; FAA Form 8130-3). Three task types under four data-quality conditions were tested, including: unaltered baseline data, whitespace injection, truncated identifiers, and severed relational links. Under the bounded experimental conditions, the highest-performing LLMs achieved higher mean accuracy and shorter completion times than the average unassisted participant, with Claude Sonnet-4 achieving 94.1% mean accuracy compared with 62.2% for humans. However, this advantage was conditional: some smaller models fell below the human average, and the best human participants outperformed all models. The MAS system was robust to whitespace errors and severed relational links, but vulnerable to truncated identifiers and verbose prompt scaffolding. These findings offer a preliminary indication that multi-agent LLM systems can support bounded manufacturing information-access tasks as a decision-support layer, but require careful model selection, tool design, data validation, prompt design, and human oversight.

Zitieren

APA

Nguyen, N. B., Brooks, S., & Ling, Z. (2026). Evaluating the use of LLM-based multi-agent systems for internal information sharing and access within manufacturing. The International Journal of Advanced Manufacturing Technology. https://doi.org/10.1007/s00170-026-19467-7

Vancouver

Nguyen NB, Brooks S, Ling Z. Evaluating the use of LLM-based multi-agent systems for internal information sharing and access within manufacturing. The International Journal of Advanced Manufacturing Technology. 2026. doi:10.1007/s00170-026-19467-7

BibTeX
@article{Nguyen2026,
  author = {Nguyen, Ngoc Bach and Brooks, Sam and Ling, Zhengyang},
  title = {Evaluating the use of LLM-based multi-agent systems for internal information sharing and access within manufacturing},
  journal = {The International Journal of Advanced Manufacturing Technology},
  year = {2026},
  doi = {10.1007/s00170-026-19467-7}
}
Kostenlos starten →