Benchmarking Large Language Models for Polymer Property Predictions
Macromolecular Rapid Communications · 2026-06 · 47 (12)
DOI: 10.1002/marc.202500388 ↗Kurz gefasst
Fachartikel in der Zeitschrift Macromolecular Rapid Communications, online erschienen am 13.10.2025. Verfasst von Sonakshi Gupta und 3 weiteren Autor:innen. Beteiligte Einrichtung: School of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA. Hauptthemen laut MEDLINE: Large Language Models, Polymers. Die Arbeit wurde bisher 14-mal zitiert (Crossref) und nennt 42 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Office of Naval Research.
Abstract (Originalsprache)
Machine learning and artificial intelligence have revolutionized polymer science by enhancing the ability to rapidly predict key polymer properties and enabling generative design. The utilization of large language models (LLMs) in polymer informatics may offers additional opportunities for advancement. Unlike traditional methods that depend on large labeled datasets, hand‐crafted representations of the materials, and complex feature engineering, LLM‐based methods utilize natural language inputs via a transfer learning process and eliminate the need for complex representation and fingerprinting, thus significantly simplifying the training process. In this study, we fine‐tune general‐purpose LLMs—open‐source Llama‐3‐8B and commercial GPT‐3.5‐on a curated dataset of 11,740 entries to predict key thermal properties: glass transition (), melting (), and decomposition () temperatures. Using parameter‐efficient fine‐tuning and hyperparameter optimization, we benchmark these models against traditional fingerprinting‐based approaches including Polymer Genome, polyGNN, and polyBERT, under both single‐task (ST) and multi‐task (MT) learning frameworks. We find that while LLM informatics techniques can come close to traditional methods, they generally underperform in terms of predictive accuracy and computational efficiency. The fine‐tuned Llama‐3 model consistently outperforms GPT‐3.5, likely due to the flexibility and tunability of the open‐source architecture. Additionally, ST learning proves more effective than MT for LLMs, which struggle to exploit cross‐property correlations—a significant and known advantage of traditional methods. The analysis of molecular embeddings learned by the models provides insight into the inner workings of the LLMs, revealing fundamental limitations of general‐purpose LLMs in capturing nuanced chemo‐structural information compared to the handcrafted features and domain‐specific embeddings utilized in the traditional methods. These findings offer insights into the interplay between molecular embeddings and natural language processing, and provide guidance for LLM model selection within the context of polymer informatics.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- School of Computational Science and Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA.
- School of Materials Science and Engineering, Georgia Institute of Technology, Atlanta, GA, 30332, USA.
ORCID-Profile: Sonakshi Gupta
Förderung
- Office of Naval Research
Zitieren
APA
Gupta, S., Mahmood, A., Shukla, S., & Ramprasad, R. (2026). Benchmarking Large Language Models for Polymer Property Predictions. Macromolecular Rapid Communications, 47(12). https://doi.org/10.1002/marc.202500388
Vancouver
Gupta S, Mahmood A, Shukla S, Ramprasad R. Benchmarking Large Language Models for Polymer Property Predictions. Macromolecular Rapid Communications. 2026;47(12). doi:10.1002/marc.202500388
BibTeX
@article{Gupta2026,
author = {Gupta, Sonakshi and Mahmood, Akhlak and Shukla, Shivank and Ramprasad, Rampi},
title = {Benchmarking Large Language Models for Polymer Property Predictions},
journal = {Macromolecular Rapid Communications},
year = {2026},
volume = {47},
number = {12},
doi = {10.1002/marc.202500388}
}
EUVIMED