EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A human-centered automated machine learning agent with large language models for multimodal data management and analysis

Rong Huang, Su Tao

Frontiers in Artificial Intelligence · 08.10.2025 · 8

DOI: 10.3389/frai.2025.1680845 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Frontiers in Artificial Intelligence, online erschienen am 08.10.2025. Verfasst von Rong Huang und 1 weiteren Autor:innen. Beteiligte Einrichtung: Tawa Supermarket, Inc., Buena Park, CA, United States. Die Arbeit wurde bisher 13-mal zitiert (Crossref) und nennt 67 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Automated Machine Learning (AutoML) aims to streamline the end-to-end process of ML models, yet current approaches remain constrained by rigid rule-based frameworks and structured input requirements that create barriers for non-expert users. Despite advances in Large Language Models (LLMs) demonstrating capabilities in code generation and natural language understanding, their potential to improve AutoML accessibility has not been fully realized. We present an innovative LLM-driven AI agent that enables natural language interaction throughout the entire ML workflow while maintaining high performance standards, reducing the need for predefined rules and minimizing technical expertise requirements. The proposed agent implements an end-to-end ML pipeline, incorporating automatic data loading and pre-processing, task identification, neural architecture selection, hyperparameter optimization, and training automation. Additionally, we propose a novel data processing approach that leverages LLMs to automatically interpret and handle diverse data formats without requiring manual pre-processing or format conversion. Moreover, we propose an adaptive hyperparameter optimization strategy that combines LLMs' knowledge of ML best practices with dynamic performance feedback to intelligently adjust search spaces. Extensive evaluation on 10 diverse datasets spanning classification and regression tasks across multiple data modalities demonstrates that our approach consistently achieves superior performance compared to traditional rule-based AutoML frameworks. By bridging the gap between human intent and ML implementation, our approach contributes to the development of a more accessible AutoML framework.

Schlagwörter

Stichwörter der Autor:innen

AutoMLLLMagentdeep learningmultimodal data analysis

Autor:innen und Institutionen

  • Tawa Supermarket, Inc., Buena Park, CA, United States.
  • University of California, Los Angeles, Los Angeles, CA, United States.

Zitieren

APA

Huang, R., & Tao, S. (2025). A human-centered automated machine learning agent with large language models for multimodal data management and analysis. Frontiers in Artificial Intelligence, 8. https://doi.org/10.3389/frai.2025.1680845

Vancouver

Huang R, Tao S. A human-centered automated machine learning agent with large language models for multimodal data management and analysis. Frontiers in Artificial Intelligence. 2025;8. doi:10.3389/frai.2025.1680845

BibTeX
@article{Huang2025,
  author = {Huang, Rong and Tao, Su},
  title = {A human-centered automated machine learning agent with large language models for multimodal data management and analysis},
  journal = {Frontiers in Artificial Intelligence},
  year = {2025},
  volume = {8},
  doi = {10.3389/frai.2025.1680845}
}
Kostenlos starten →