EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Cross‐Modal Graph Contrastive Learning with Cellular Images

Shuangjia Zheng iD, Jiahua Rao iD, Jixian Zhang, Lianyu Zhou, Jiancong Xie, Ethan Cohen, Wei Lu, Chengtao Li, Yuedong Yang

Advanced Science · 2024

DOI: 10.1002/advs.202404845 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Advanced Science, 2024. Verfasst von Shuangjia Zheng und 8 weiteren Autor:innen. Beteiligte Einrichtung: Global Institute of Future Technology, Shanghai Jiaotong University University, Shanghai, 200240, China. Hauptthemen laut MEDLINE: Neural Networks, Computer. Die Arbeit wurde bisher 18-mal zitiert (Crossref) und nennt 70 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Key Research and Development Program of China, National Natural Science Foundation of China, Guangdong Key Field R&D Plan.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Constructing discriminative representations of molecules lies at the core of a number of domains such as drug discovery, chemistry, and medicine. State‐of‐the‐art methods employ graph neural networks and self‐supervised learning (SSL) to learn unlabeled data for structural representations, which can then be fine‐tuned for downstream tasks. Albeit powerful, these methods are pre‐trained solely on molecular structures and thus often struggle with tasks involved in intricate biological processes. Here, it is proposed to assist the learning of molecular representation by using the perturbed high‐content cell microscopy images at the phenotypic level. To incorporate the cross‐modal pre‐training, a unified framework is constructed to align them through multiple types of contrastive loss functions, which is proven effective in the formulated novel tasks to retrieve the molecules and corresponding images mutually. More importantly, the model can infer functional molecules according to cellular images generated by genetic perturbations. In parallel, the proposed model can transfer non‐trivially to molecular property predictions, and has shown great improvement over clinical outcome predictions. These results suggest that such cross‐modality learning can bridge molecules and phenotype to play important roles in drug discovery.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Neural Networks, ComputerHumansImage Processing, Computer-AssistedMicroscopyAlgorithmsMachine Learning

Stichwörter der Autor:innen

cellular imagecross‐modal learningdrug discoverygraph neural networksself‐supervised learning

Autor:innen und Institutionen

  • Global Institute of Future Technology, Shanghai Jiaotong University University, Shanghai, 200240, China.
  • School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, 510000, China.
  • Galixir Technologies, Shanghai, 200100, China.
  • School of Informatics, Xiamen University, Xiamen, 361005, China.
  • IBENS, Ecole Normale Supérieure, PSL Research Institute, Paris, France.

ORCID-Profile: Shuangjia Zheng, Jiahua Rao

Förderung

  • National Key Research and Development Program of China
  • National Natural Science Foundation of China
  • Guangdong Key Field R&D Plan

Zitieren

APA

Zheng, S., Rao, J., Zhang, J., Zhou, L., Xie, J., Cohen, E., Lu, W., Li, C., & Yang, Y. (2024). Cross‐Modal Graph Contrastive Learning with Cellular Images. Advanced Science. https://doi.org/10.1002/advs.202404845

Vancouver

Zheng S, Rao J, Zhang J, Zhou L, Xie J, Cohen E, et al. Cross‐Modal Graph Contrastive Learning with Cellular Images. Advanced Science. 2024. doi:10.1002/advs.202404845

BibTeX
@article{Zheng2024,
  author = {Zheng, Shuangjia and Rao, Jiahua and Zhang, Jixian and Zhou, Lianyu and Xie, Jiancong and Cohen, Ethan and Lu, Wei and Li, Chengtao and Yang, Yuedong},
  title = {Cross‐Modal Graph Contrastive Learning with Cellular Images},
  journal = {Advanced Science},
  year = {2024},
  doi = {10.1002/advs.202404845}
}
Kostenlos starten →