EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

LLM-Linked Chatbot Platforms for Seeded Clinical Trial Randomization Workflows: A Benchmarking Study of Reproducibility, Allocation Integrity, and Operational Traceability

Carlos Fernando Mourão, Luiz Eduardo Juliasse, Adam Lowenstein, Bruno César de Vasconcelos Gurgel, Rodrigo dos Santos Pereira, Gutemberg Gomes Alves

Algorithms · 06.07.2026 · 19 (7) · 551

DOI: 10.3390/a19070551 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Algorithms, online erschienen am 06.07.2026. Verfasst von Carlos Fernando Mourão und 5 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Randomization sequence generation is essential in randomized controlled trials, but access to trial-management systems or statistical support may be limited in some settings. This in silico technical benchmarking study evaluated whether four LLM-linked chatbot interfaces can faithfully execute pre-specified deterministic Python code to generate a randomized sequence under fixed-seed conditions. In Experiment 1, four investigators performed 1200 fixed-seed Python runs across two sample-size scenarios (n = 30 and n = 50), benchmarked against seeded Excel/VBA and R Console workflows. In Experiment 2, the same investigators performed 320 NL-only runs without code submission or seed specification. A supplementary permuted block benchmark (n = 60; blocks of six) added 640 runs across both prompting conditions. Fixed-seed code execution achieved 100% exact reproducibility, allocation integrity, format compliance, and operational completion across all platforms. NL-only prompting preserved allocation integrity, format compliance, and operational completion (100%) but yielded 0% exact reproducibility in both simple and permuted block randomization. These findings support only a constrained interpretation: chatbot-mediated reproducibility depends on executable code, fixed-seed specification, preserved documentation, and human verification. These interfaces should not replace dedicated randomization software or validated trial-management systems.

Zitieren

APA

Mourão, C. F., Juliasse, L. E., Lowenstein, A., Gurgel, B. C. D. V., Pereira, R. D. S., & Alves, G. G. (2026). LLM-Linked Chatbot Platforms for Seeded Clinical Trial Randomization Workflows: A Benchmarking Study of Reproducibility, Allocation Integrity, and Operational Traceability. Algorithms, 19(7), 551. https://doi.org/10.3390/a19070551

Vancouver

Mourão CF, Juliasse LE, Lowenstein A, Gurgel BCDV, Pereira RDS, Alves GG. LLM-Linked Chatbot Platforms for Seeded Clinical Trial Randomization Workflows: A Benchmarking Study of Reproducibility, Allocation Integrity, and Operational Traceability. Algorithms. 2026;19(7):551. doi:10.3390/a19070551

BibTeX
@article{Mouro2026,
  author = {Mourão, Carlos Fernando and Juliasse, Luiz Eduardo and Lowenstein, Adam and Gurgel, Bruno César de Vasconcelos and Pereira, Rodrigo dos Santos and Alves, Gutemberg Gomes},
  title = {LLM-Linked Chatbot Platforms for Seeded Clinical Trial Randomization Workflows: A Benchmarking Study of Reproducibility, Allocation Integrity, and Operational Traceability},
  journal = {Algorithms},
  year = {2026},
  volume = {19},
  number = {7},
  pages = {551},
  doi = {10.3390/a19070551}
}
Kostenlos starten →