LLM-Linked Chatbot Platforms for Seeded Clinical Trial Randomization Workflows: A Benchmarking Study of Reproducibility, Allocation Integrity, and Operational Traceability
Algorithms · 06.07.2026 · 19 (7) · 551
DOI: 10.3390/a19070551 ↗Kurz gefasst
Fachartikel in der Zeitschrift Algorithms, online erschienen am 06.07.2026. Verfasst von Carlos Fernando Mourão und 5 weiteren Autor:innen. Die Arbeit nennt 18 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
Randomization sequence generation is essential in randomized controlled trials, but access to trial-management systems or statistical support may be limited in some settings. This in silico technical benchmarking study evaluated whether four LLM-linked chatbot interfaces can faithfully execute pre-specified deterministic Python code to generate a randomized sequence under fixed-seed conditions. In Experiment 1, four investigators performed 1200 fixed-seed Python runs across two sample-size scenarios (n = 30 and n = 50), benchmarked against seeded Excel/VBA and R Console workflows. In Experiment 2, the same investigators performed 320 NL-only runs without code submission or seed specification. A supplementary permuted block benchmark (n = 60; blocks of six) added 640 runs across both prompting conditions. Fixed-seed code execution achieved 100% exact reproducibility, allocation integrity, format compliance, and operational completion across all platforms. NL-only prompting preserved allocation integrity, format compliance, and operational completion (100%) but yielded 0% exact reproducibility in both simple and permuted block randomization. These findings support only a constrained interpretation: chatbot-mediated reproducibility depends on executable code, fixed-seed specification, preserved documentation, and human verification. These interfaces should not replace dedicated randomization software or validated trial-management systems.
Zitieren
APA
Mourão, C. F., Juliasse, L. E., Lowenstein, A., Gurgel, B. C. D. V., Pereira, R. D. S., & Alves, G. G. (2026). LLM-Linked Chatbot Platforms for Seeded Clinical Trial Randomization Workflows: A Benchmarking Study of Reproducibility, Allocation Integrity, and Operational Traceability. Algorithms, 19(7), 551. https://doi.org/10.3390/a19070551
Vancouver
Mourão CF, Juliasse LE, Lowenstein A, Gurgel BCDV, Pereira RDS, Alves GG. LLM-Linked Chatbot Platforms for Seeded Clinical Trial Randomization Workflows: A Benchmarking Study of Reproducibility, Allocation Integrity, and Operational Traceability. Algorithms. 2026;19(7):551. doi:10.3390/a19070551
BibTeX
@article{Mouro2026,
author = {Mourão, Carlos Fernando and Juliasse, Luiz Eduardo and Lowenstein, Adam and Gurgel, Bruno César de Vasconcelos and Pereira, Rodrigo dos Santos and Alves, Gutemberg Gomes},
title = {LLM-Linked Chatbot Platforms for Seeded Clinical Trial Randomization Workflows: A Benchmarking Study of Reproducibility, Allocation Integrity, and Operational Traceability},
journal = {Algorithms},
year = {2026},
volume = {19},
number = {7},
pages = {551},
doi = {10.3390/a19070551}
}
EUVIMED