EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

PaperOrchestrator: An LLM-Orchestrated multi-agent pipeline for automated end-to-end scientific paper writing

Chunhong Yuan, Tianshi Wei, Chuangqi Li, Xing Yi, Shengrui Liu, Zixin Zhang, Yule Cai, Xinke Du

Journal of King Saud University Computer and Information Sciences · 2026-07 · 38 (5)

DOI: 10.1007/s44443-026-00708-4 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of King Saud University Computer and Information Sciences, online erschienen am 06.04.2026. Verfasst von Chunhong Yuan und 7 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 40 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: Victoria University of Wellington.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Academic paper writing is a time-consuming and demanding component of the scientific research workflow. Although large language models (LLMs) have achieved remarkable advances in text generation, single-turn direct generation strategies face critical challenges when applied to long-form, multi-section academic papers, including incomplete sections, content truncation, formatting irregularities, and reference hallucinations. We propose PaperOrchestrator, an LLM-orchestrated multi-agent pipeline system that decomposes automatic academic paper writing into seven collaborative stages: outline generation, section-by-section content generation, length-adaptive control, full-text consistency polishing, BibTeX reference generation, section-by-section robust LaTeX conversion, and journal template rendering, with inter-stage information transfer and state management achieved through a shared context data structure. On an evaluation set of 60 papers spanning natural language processing, computer vision, and biomedical AI, we compare against 11 baseline systems including GPT-4o, GPT-4-Turbo, Gemini 1.5 Pro, Claude 3.5 Sonnet (single-turn), Llama-3.1-70B, Qwen2.5-72B, and ChatPaper. PaperOrchestrator achieves state-of-the-art performance on BERTScore F1 (0.674), ROUGE-L (0.223), section completeness (96.7%), LaTeX compilation rate (90.0%), and human-evaluated overall quality (3.85/5.00, Krippendorff’s α=0.73\documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\alpha =0.73$$\end{document}), with all differences reaching statistical significance after Bonferroni correction. Ablation experiments validate the necessity of core components including the Continue Mechanism and the Section-by-Section LaTeX Conversion strategy. This work provides a reproducible, systematic framework and a comprehensive empirical benchmark for LLM-driven automated academic writing.

Förderung

  • Victoria University of Wellington

Zitieren

APA

Yuan, C., Wei, T., Li, C., Yi, X., Liu, S., Zhang, Z., Cai, Y., & Du, X. (2026). PaperOrchestrator: An LLM-Orchestrated multi-agent pipeline for automated end-to-end scientific paper writing. Journal of King Saud University Computer and Information Sciences, 38(5). https://doi.org/10.1007/s44443-026-00708-4

Vancouver

Yuan C, Wei T, Li C, Yi X, Liu S, Zhang Z, et al. PaperOrchestrator: An LLM-Orchestrated multi-agent pipeline for automated end-to-end scientific paper writing. Journal of King Saud University Computer and Information Sciences. 2026;38(5). doi:10.1007/s44443-026-00708-4

BibTeX
@article{Yuan2026,
  author = {Yuan, Chunhong and Wei, Tianshi and Li, Chuangqi and Yi, Xing and Liu, Shengrui and Zhang, Zixin and Cai, Yule and Du, Xinke},
  title = {PaperOrchestrator: An LLM-Orchestrated multi-agent pipeline for automated end-to-end scientific paper writing},
  journal = {Journal of King Saud University Computer and Information Sciences},
  year = {2026},
  volume = {38},
  number = {5},
  doi = {10.1007/s44443-026-00708-4}
}
Kostenlos starten →