EUVIMEDEUVIMED entdecken
Open Access · CC BY-NC-ND 4.0

Evaluation and Optimization Methods for Applicability Domain Methods and Their Hyperparameters, Considering the Prediction Performance of Machine Learning Models

Hiromasa Kaneko iD

ACS Omega · 12.03.2024 · 9 (10) · 11453-11458

DOI: 10.1021/acsomega.3c08036 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACS Omega, online erschienen am 26.02.2024. Verfasst von Hiromasa Kaneko. Beteiligte Einrichtung: Department of Applied Chemistry, School of Science and Technology, Meiji University, 1-1-1 Higashi-Mita, Tama-ku, Kawasaki, Kanagawa 214-8571, Japan. Die Arbeit wurde bisher 29-mal zitiert (Crossref) und nennt 27 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

In molecular, material, and process design and control, the applicability domain (AD) of a mathematical model y = f(x) between properties, activities, and features x is constructed. As there are multiple AD methods, each with its own set of hyperparameters, it is necessary to select an appropriate AD method and hyperparameters for each data set and mathematical model. However, there is no method for optimizing the AD model. This study proposes a method for evaluating and optimizing the AD model for each data set and a mathematical model. Using the predictions of double cross-validation with all samples, the relationship between coverage and root-mean-squared error (RMSE) was calculated for all combinations of AD methods and their hyperparameters, and the area under the coverage and RMSE curve (AUCR) was calculated. The AD model with the lowest AUCR value was selected as the optimal fit for the mathematical model. The proposed method was validated using eight data sets, including molecules, materials, and spectra, demonstrating that the proposed method could generate optimal AD models for all data sets. The Python code for the proposed method is available at https://github.com/hkaneko1985/dcekit.

Autor:innen und Institutionen

  • Department of Applied Chemistry, School of Science and Technology, Meiji University, 1-1-1 Higashi-Mita, Tama-ku, Kawasaki, Kanagawa 214-8571, Japan.

ORCID-Profile: Hiromasa Kaneko

Zitieren

APA

Kaneko, H. (2024). Evaluation and Optimization Methods for Applicability Domain Methods and Their Hyperparameters, Considering the Prediction Performance of Machine Learning Models. ACS Omega, 9(10), 11453-11458. https://doi.org/10.1021/acsomega.3c08036

Vancouver

Kaneko H. Evaluation and Optimization Methods for Applicability Domain Methods and Their Hyperparameters, Considering the Prediction Performance of Machine Learning Models. ACS Omega. 2024;9(10):11453-11458. doi:10.1021/acsomega.3c08036

BibTeX
@article{Kaneko2024,
  author = {Kaneko, Hiromasa},
  title = {Evaluation and Optimization Methods for Applicability Domain Methods and Their Hyperparameters, Considering the Prediction Performance of Machine Learning Models},
  journal = {ACS Omega},
  year = {2024},
  volume = {9},
  number = {10},
  pages = {11453--11458},
  doi = {10.1021/acsomega.3c08036}
}
Kostenlos starten →