EUVIMEDEUVIMED entdecken
Crossref

Energy-Motivated Equivariant Pretraining for 3D Molecular Graphs

Rui Jiao, Jiaqi Han, Wenbing Huang, Yu Rong, Yang Liu

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (7) · 8096-8104

DOI: 10.1609/aaai.v37i7.25978 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Rui Jiao und 4 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Pretraining molecular representation models without labels is fundamental to various applications. Conventional methods mainly process 2D molecular graphs and focus solely on 2D tasks, making their pretrained models incapable of characterizing 3D geometry and thus defective for downstream 3D tasks. In this work, we tackle 3D molecular pretraining in a complete and novel sense. In particular, we first propose to adopt an equivariant energy-based model as the backbone for pretraining, which enjoys the merits of fulfilling the symmetry of 3D space. Then we develop a node-level pretraining loss for force prediction, where we further exploit the Riemann-Gaussian distribution to ensure the loss to be E(3)-invariant, enabling more robustness. Moreover, a graph-level noise scale prediction task is also leveraged to further promote the eventual performance. We evaluate our model pretrained from a large-scale 3D dataset GEOM-QM9 on two challenging 3D benchmarks: MD17 and QM9. Experimental results demonstrate the efficacy of our method against current state-of-the-art pretraining approaches, and verify the validity of our design for each proposed component. Code is available at https://github.com/jiaor17/3D-EMGP.

Zitieren

APA

Jiao, R., Han, J., Huang, W., Rong, Y., & Liu, Y. (2023). Energy-Motivated Equivariant Pretraining for 3D Molecular Graphs. Proceedings of the AAAI Conference on Artificial Intelligence, 37(7), 8096-8104. https://doi.org/10.1609/aaai.v37i7.25978

Vancouver

Jiao R, Han J, Huang W, Rong Y, Liu Y. Energy-Motivated Equivariant Pretraining for 3D Molecular Graphs. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(7):8096-8104. doi:10.1609/aaai.v37i7.25978

BibTeX
@article{Jiao2023,
  author = {Jiao, Rui and Han, Jiaqi and Huang, Wenbing and Rong, Yu and Liu, Yang},
  title = {Energy-Motivated Equivariant Pretraining for 3D Molecular Graphs},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {7},
  pages = {8096--8104},
  doi = {10.1609/aaai.v37i7.25978}
}
Kostenlos starten →