EUVIMEDEUVIMED entdecken
Crossref

TFRegNCI: Interpretable Noncovalent Interaction Correction Multimodal Based on Transformer Encoder Fusion

Donghan Wang iD, Wenze Li, Xu Dong, Hongzhi Li, LiHong Hu iD

Journal of Chemical Information and Modeling · 2023

DOI: 10.1021/acs.jcim.2c01283 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Chemical Information and Modeling, 2023. Verfasst von Donghan Wang und 4 weiteren Autor:innen. Beteiligte Einrichtung: School of Information Science and Technology, Northeast Normal University, Changchun130117, China. Hauptthemen laut MEDLINE: Algorithms. Die Arbeit wurde bisher 9-mal zitiert (Crossref) und nennt 59 Literaturangaben. Gefördert von: Department of Science and Technology of Jilin Province, National Natural Science Foundation of China.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The interpretability is an important issue for end-to-end learning models. Motivated by computer vision algorithms, an interpretable noncovalent interaction (NCI) correction multimodal (TFRegNCI) is proposed for NCI prediction. TFRegNCI is based on RegNet feature extraction and a transformer encoder fusion strategy. RegNet is a network design paradigm that mainly focuses on local features. Meanwhile, the Vision Transformer is also leveraged for feature extraction, because it can capture global features better than RegNet while lowering the computational cost. Using a transformer encoder as the fusion strategy rather than multilayer perceptron can enhance model performance, due to its emphasis on important features with less parameters. Therefore, the proposed TFRegNCI achieved high accurate prediction (mean absolute error of ∼0.1 kcal/mol) comparing with the coupled cluster single double (triple) (CCSD(T)) benchmark. To further improve the model efficiency, TFRegNCI applies two-dimensional (2D) inputs transformed from three-dimensional (3D) electron density cubes, which saves time (30%), while the model accuracy remains. To improve model interpretability, a visualization module, Gradient-weighted Regression Activation Mapping (Grad-RAM) has been embedded. Grad-RAM is promoted from the classification algorithm, Gradient-weighted Class Activation Mapping, to perform feature visualization for the regression task. With Grad-RAM, the visual location map for features in deep learning models can be displayed. The feature map visualizations suggest that the 2D model has the similar performance as the 3D model, because of equally effective feature extractions from electron density. Moreover, the valid feature region on the location map by the 3D model is consistent with the NCIPLOT NCI isosurface. It is confirmed that the model does extract significant features related to the NCI interaction. The interpretable analyses are carried out through molecular orbital contribution on effective features. Thereby, the proposed model is likely to be a promising tool to reveal some essential information on NCIs, with regard to the level of electronic theory.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

AlgorithmsElectric Power SuppliesElectronicsNeural Networks, Computer

Autor:innen und Institutionen

  • School of Information Science and Technology, Northeast Normal University, Changchun130117, China.
  • College of Computer and Information Engineering, Henan Normal University, Henan, Xinxiang453007, China.

ORCID-Profile: Donghan Wang, LiHong Hu

Förderung

  • Department of Science and Technology of Jilin Province
  • National Natural Science Foundation of China

Zitieren

APA

Wang, D., Li, W., Dong, X., Li, H., & Hu, L. (2023). TFRegNCI: Interpretable Noncovalent Interaction Correction Multimodal Based on Transformer Encoder Fusion. Journal of Chemical Information and Modeling. https://doi.org/10.1021/acs.jcim.2c01283

Vancouver

Wang D, Li W, Dong X, Li H, Hu L. TFRegNCI: Interpretable Noncovalent Interaction Correction Multimodal Based on Transformer Encoder Fusion. Journal of Chemical Information and Modeling. 2023. doi:10.1021/acs.jcim.2c01283

BibTeX
@article{Wang2023,
  author = {Wang, Donghan and Li, Wenze and Dong, Xu and Li, Hongzhi and Hu, LiHong},
  title = {TFRegNCI: Interpretable Noncovalent Interaction Correction Multimodal Based on Transformer Encoder Fusion},
  journal = {Journal of Chemical Information and Modeling},
  year = {2023},
  doi = {10.1021/acs.jcim.2c01283}
}
Kostenlos starten →