EUVIMEDEUVIMED entdecken
Crossref

LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning

Wei Huang, Anda Cheng, Yinggui Wang, Lei Wang, Tao Wei

Proceedings of the VLDB Endowment · 01.01.2026 · 19 (5) · 794-807

DOI: 10.14778/3796195.3796196 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the VLDB Endowment, online erschienen am 05.05.2026. Verfasst von Wei Huang und 4 weiteren Autor:innen. Die Arbeit nennt 59 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Large Language Models (LLMs) can be fine-tuned on domain-specific data to enhance their performance in specialized fields. However, such data often contains numerous low-quality samples, necessitating effective data processing (DP). In practice, DP strategies are typically developed through iterative manual analysis and trial-and-error adjustment. These processes inevitably incur high labor costs and may lead to privacy issues in high-privacy domains like healthcare due to direct human access to sensitive data. Thus, achieving automated data processing without exposing the raw data has become a critical challenge. To address this challenge, we propose LLM-AutoDP , a novel framework that leverages LLMs as agents to automatically generate and optimize data processing strategies. Starting from an initial prompt, our method generates multiple candidate strategies and iteratively refines them using feedback signals and comparative evaluations. This iterative in-context learning mechanism enables the agent to converge toward high-quality processing pipelines without requiring direct human intervention or access to the underlying data. To further accelerate strategy search, we introduce three key techniques: (1) Distribution Preserving Sampling , which reduces data volume while maintaining distributional integrity; (2) Processing Target Selection , which uses a binary classifier to identify low-quality samples for focused processing; and (3) Cache-and-Reuse Mechanism , which minimizes redundant computations by reusing prior processing results. We evaluate LLM-AutoDP on five medical datasets across three model architectures. Results show that models trained on data processed by our framework achieve over 80% win rates against models trained on unprocessed data. Compared to AutoML baselines based on LLM agents, LLM-AutoDP achieves approximately a 65% win rate. Moreover, our acceleration techniques reduce the total searching time by up to 10×, demonstrating both effectiveness and efficiency.

Zitieren

APA

Huang, W., Cheng, A., Wang, Y., Wang, L., & Wei, T. (2026). LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning. Proceedings of the VLDB Endowment, 19(5), 794-807. https://doi.org/10.14778/3796195.3796196

Vancouver

Huang W, Cheng A, Wang Y, Wang L, Wei T. LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning. Proceedings of the VLDB Endowment. 2026;19(5):794-807. doi:10.14778/3796195.3796196

BibTeX
@article{Huang2026,
  author = {Huang, Wei and Cheng, Anda and Wang, Yinggui and Wang, Lei and Wei, Tao},
  title = {LLM-AutoDP: Automatic Data Processing via LLM Agents for Model Fine-tuning},
  journal = {Proceedings of the VLDB Endowment},
  year = {2026},
  volume = {19},
  number = {5},
  pages = {794--807},
  doi = {10.14778/3796195.3796196}
}
Kostenlos starten →