In-context operator learning with data prompts for differential equation problems
Proceedings of the National Academy of Sciences · 26.09.2023 · 120 (39)
DOI: 10.1073/pnas.2310142120 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the National Academy of Sciences, online erschienen am 19.09.2023. Verfasst von Liu Yang und 3 weiteren Autor:innen. Beteiligte Einrichtung: Department of Mathematics, University of California, Los Angeles, CA 90095. Die Arbeit wurde bisher 62-mal zitiert (Crossref) und nennt 62 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC-ND 4.0). Gefördert von: DOD | USAF | AMC | Air Force Office of Scientific Research (AFOSR), DOD | USN | Office of Naval Research (ONR).
Abstract (Originalsprache)
This paper introduces the paradigm of “in-context operator learning” and the corresponding model “In-Context Operator Networks” to simultaneously learn operators from the prompted data and apply it to new questions during the inference stage, without any weight update. Existing methods are limited to using a neural network to approximate a specific equation solution or a specific operator, requiring retraining when switching to a new problem with different equations. By training a single neural network as an operator learner, rather than a solution/operator approximator, we can not only get rid of retraining (even fine-tuning) the neural network for new problems but also leverage the commonalities shared across operators so that only a few examples in the prompt are needed when learning a new operator. Our numerical results show the capability of a single neural network as a few-shot operator learner for a diversified type of differential equation problems, including forward and inverse problems of ordinary differential equations, partial differential equations, and mean-field control problems, and also show that it can generalize its learning capability to operators beyond the training distribution.
Schlagwörter
Stichwörter der Autor:innen
Autor:innen und Institutionen
- Department of Mathematics, University of California, Los Angeles, CA 90095.
ORCID-Profile: Liu Yang, Siting Liu, Tingwei Meng, Stanley J Osher
Förderung
- DOD | USAF | AMC | Air Force Office of Scientific Research (AFOSR)
- DOD | USN | Office of Naval Research (ONR)
Zitieren
APA
Yang, L., Liu, S., Meng, T., & Osher, S. J. (2023). In-context operator learning with data prompts for differential equation problems. Proceedings of the National Academy of Sciences, 120(39). https://doi.org/10.1073/pnas.2310142120
Vancouver
Yang L, Liu S, Meng T, Osher SJ. In-context operator learning with data prompts for differential equation problems. Proceedings of the National Academy of Sciences. 2023;120(39). doi:10.1073/pnas.2310142120
BibTeX
@article{Yang2023,
author = {Yang, Liu and Liu, Siting and Meng, Tingwei and Osher, Stanley J},
title = {In-context operator learning with data prompts for differential equation problems},
journal = {Proceedings of the National Academy of Sciences},
year = {2023},
volume = {120},
number = {39},
doi = {10.1073/pnas.2310142120}
}
EUVIMED