EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Leveraging large language models for data analysis automation

Jacqueline A Jansen, Artür Manukyan, Nour Al Khoury, Altuna Akalin iD

PLOS ONE · 21.02.2025 · 20 (2) · e0317084

DOI: 10.1371/journal.pone.0317084 ↗

Kurz gefasst

Fachartikel in der Zeitschrift PLOS ONE, online erschienen am 21.02.2025. Verfasst von Jacqueline A Jansen und 3 weiteren Autor:innen. Beteiligte Einrichtung: Max Delbrück Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany. Hauptthemen laut MEDLINE: Data Analysis, Programming Languages, Automation. Die Arbeit wurde bisher 34-mal zitiert (Crossref) und nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Data analysis is constrained by a shortage of skilled experts, particularly in biology, where detailed data analysis and subsequent interpretation is vital for understanding complex biological processes and developing new treatments and diagnostics. One possible solution to this shortage in experts would be making use of Large Language Models (LLMs) for generating data analysis pipelines. However, although LLMs have shown great potential when used for code generation tasks, questions regarding the accuracy of LLMs when prompted with domain expert questions such as omics related data analysis questions, remain unanswered. To address this, we developed mergen , an R package that leverages LLMs for data analysis code generation and execution. We evaluated the performance of this data analysis system using various data analysis tasks for genomics. Our primary goal is to enable researchers to conduct data analysis by simply describing their objectives and the desired analyses for specific datasets through clear text. Our approach improves code generation via specialized prompt engineering and error feedback mechanisms. In addition, our system can execute the data analysis workflows prescribed by the LLM providing the results of the data analysis workflow for human review. Our evaluation of this system reveals that while LLMs effectively generate code for some data analysis tasks, challenges remain in executable code generation, especially for complex data analysis tasks. The best performance was seen with the self-correction mechanism, in which self-correct was able to increase the percentage of executable code when compared to the simple strategy by 22.5% for tasks of complexity 2. For tasks for complexity 3, 4 and 5, this increase was 52.5%, 27.5% and 15% respectively. Using a chi-squared test, it was shown that significant differences could be found using the different prompting strategies. Our study contributes to a better understanding of LLM capabilities and limitations, providing software infrastructure and practical insights for their effective integration into data analysis workflows.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Data AnalysisProgramming LanguagesAutomationHumansSoftwareGenomicsLarge Language Models

Autor:innen und Institutionen

  • Max Delbrück Center for Molecular Medicine in the Helmholtz Association (MDC), Berlin, Germany.
  • Bioinformatics and Omics Data Science Platform, Berlin, Germany.
  • University of Potsdam, Potsdam, Brandenburg, Germany.
  • Free University of Berlin, Berlin, Germany.

ORCID-Profile: Altuna Akalin

Zitieren

APA

Jansen, J. A., Manukyan, A., Al Khoury, N., & Akalin, A. (2025). Leveraging large language models for data analysis automation. PLOS ONE, 20(2), e0317084. https://doi.org/10.1371/journal.pone.0317084

Vancouver

Jansen JA, Manukyan A, Al Khoury N, Akalin A. Leveraging large language models for data analysis automation. PLOS ONE. 2025;20(2):e0317084. doi:10.1371/journal.pone.0317084

BibTeX
@article{Jansen2025,
  author = {Jansen, Jacqueline A and Manukyan, Artür and Al Khoury, Nour and Akalin, Altuna},
  title = {Leveraging large language models for data analysis automation},
  journal = {PLOS ONE},
  year = {2025},
  volume = {20},
  number = {2},
  pages = {e0317084},
  doi = {10.1371/journal.pone.0317084}
}
Kostenlos starten →