Characterizing Design Rationales Using Computational Linguistics and Human Evaluations
Journal of Mechanical Design · 01.12.2025 · 147 (12)
DOI: 10.1115/1.4069232 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Mechanical Design, online erschienen am 28.08.2025. Verfasst von Yakira Mirabito und 2 weiteren Autor:innen. Die Arbeit nennt 35 Literaturangaben. Gefördert von: National Science Foundation.
Abstract (Originalsprache)
Design rationales capture the explicit justifications behind design decisions. Often, rationales vary in the content and depth of information, making the study and comparison of rationales challenging. This project aims to characterize design rationales and develop a standardized approach to assess design rationale quality at scale. In total, 2250 rationales were machine-generated across two different representations and evaluated by two raters across five dimensions of quality. Rationales were then characterized using natural language processing techniques, resulting in 108 linguistic features for each rationale. The linguistic features were used to build predictive models for each quality dimension. The main results identify correlations between linguistic features and human evaluations, show that structured rationales were rated higher than unstructured rationales across the five dimensions, and present a model to predict rationale quality for new texts. These findings help inform strategies to improve human- and machine-generated rationales. The predictive tool offers a scalable method for evaluating different representations of rationale, thereby supporting more effective documentation practices.
Förderung
- National Science Foundation
Zitieren
APA
Mirabito, Y., Liu, X., & Goucher-Lambert, K. (2025). Characterizing Design Rationales Using Computational Linguistics and Human Evaluations. Journal of Mechanical Design, 147(12). https://doi.org/10.1115/1.4069232
Vancouver
Mirabito Y, Liu X, Goucher-Lambert K. Characterizing Design Rationales Using Computational Linguistics and Human Evaluations. Journal of Mechanical Design. 2025;147(12). doi:10.1115/1.4069232
BibTeX
@article{Mirabito2025,
author = {Mirabito, Yakira and Liu, Xiaowen and Goucher-Lambert, Kosa},
title = {Characterizing Design Rationales Using Computational Linguistics and Human Evaluations},
journal = {Journal of Mechanical Design},
year = {2025},
volume = {147},
number = {12},
doi = {10.1115/1.4069232}
}
EUVIMED