EUVIMEDEUVIMED entdecken
Crossref

Evaluating Large Language Models for Material Selection

Daniele Grandi, Yash Patawari Jain, Allin Groom, Brandon Cramer, Christopher McComb

Journal of Computing and Information Science in Engineering · 01.02.2025 · 25 (2)

DOI: 10.1115/1.4066730 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Computing and Information Science in Engineering, online erschienen am 14.11.2024. Verfasst von Daniele Grandi und 4 weiteren Autor:innen. Die Arbeit wurde bisher 24-mal zitiert (Crossref) und nennt 107 Literaturangaben.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Material selection is a crucial step in conceptual design due to its significant impact on the functionality, aesthetics, manufacturability, and sustainability impact of the final product. This study investigates the use of large language models (LLMs) for material selection in the product design process and compares the performance of LLMs against expert choices for various design scenarios. By collecting a dataset of expert material preferences, the study provides a basis for evaluating how well LLMs can align with expert recommendations through prompt engineering and hyperparameter tuning. The divergence between LLM and expert recommendations is measured across different model configurations, prompt strategies, and temperature settings. This approach allows for a detailed analysis of factors influencing the LLMs' effectiveness in recommending materials. The results from this study highlight two failure modes: the low variance of recommendations across different design scenarios and the tendency toward overestimating material appropriateness. Parallel prompting is identified as a useful prompt-engineering method when using LLMs for material selection. The findings further suggest that, while LLMs can provide valuable assistance, their recommendations often vary significantly from those of human experts. This discrepancy underscores the need for further research into how LLMs can be better tailored to replicate expert decision-making in material selection. This work contributes to the growing body of knowledge on how LLMs can be integrated into the design process, offering insights into their current limitations and potential for future improvements.

Zitieren

APA

Grandi, D., Jain, Y. P., Groom, A., Cramer, B., & McComb, C. (2025). Evaluating Large Language Models for Material Selection. Journal of Computing and Information Science in Engineering, 25(2). https://doi.org/10.1115/1.4066730

Vancouver

Grandi D, Jain YP, Groom A, Cramer B, McComb C. Evaluating Large Language Models for Material Selection. Journal of Computing and Information Science in Engineering. 2025;25(2). doi:10.1115/1.4066730

BibTeX
@article{Grandi2025,
  author = {Grandi, Daniele and Jain, Yash Patawari and Groom, Allin and Cramer, Brandon and McComb, Christopher},
  title = {Evaluating Large Language Models for Material Selection},
  journal = {Journal of Computing and Information Science in Engineering},
  year = {2025},
  volume = {25},
  number = {2},
  doi = {10.1115/1.4066730}
}
Kostenlos starten →