Evaluating Designer Learning and Performance in Interactive Deep Generative Design
Journal of Mechanical Design · 01.05.2023 · 145 (5)
DOI: 10.1115/1.4056374 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Mechanical Design, online erschienen am 10.01.2023. Verfasst von Ashish M. Chaudhari und 1 weiteren Autor:innen. Die Arbeit wurde bisher 11-mal zitiert (Crossref) und nennt 69 Literaturangaben. Gefördert von: Division of Civil, Mechanical and Manufacturing Innovation.
Abstract (Originalsprache)
Deep generative models have shown significant promise in improving performance in design space exploration. But there is limited understanding of their interpretability, a necessity when model explanations are desired and problems are ill-defined. Interpretability involves learning design features behind design performance, called designer learning. This study explores human–machine collaboration’s effects on designer learning and design performance. We conduct an experiment (N = 42) designing mechanical metamaterials using a conditional variational autoencoder. The independent variables are: (i) the level of automation of design synthesis, e.g., manual (where the user manually manipulates design variables), manual feature-based (where the user manipulates the weights of the features learned by the encoder), and semi-automated feature-based (where the agent generates a local design based on a start design and user-selected step size); and (ii) feature semanticity, e.g., meaningful versus abstract features. We assess feature-specific learning using item response theory and design performance using utopia distance and hypervolume improvement. The results suggest that design performance depends on the subjects’ feature-specific knowledge, emphasizing the precursory role of learning. The semi-automated synthesis locally improves the utopia distance. Still, it does not result in higher global hypervolume improvement compared to manual design synthesis and reduced designer learning compared to manual feature-based synthesis. The subjects learn semantic features better than abstract features only when design performance is sensitive to them. Potential cognitive constructs influencing learning in human–machine collaborative settings are discussed, such as cognitive load and recognition heuristics.
Förderung
- Division of Civil, Mechanical and Manufacturing Innovation
Zitieren
APA
Chaudhari, A. M., & Selva, D. (2023). Evaluating Designer Learning and Performance in Interactive Deep Generative Design. Journal of Mechanical Design, 145(5). https://doi.org/10.1115/1.4056374
Vancouver
Chaudhari AM, Selva D. Evaluating Designer Learning and Performance in Interactive Deep Generative Design. Journal of Mechanical Design. 2023;145(5). doi:10.1115/1.4056374
BibTeX
@article{Chaudhari2023,
author = {Chaudhari, Ashish M. and Selva, Daniel},
title = {Evaluating Designer Learning and Performance in Interactive Deep Generative Design},
journal = {Journal of Mechanical Design},
year = {2023},
volume = {145},
number = {5},
doi = {10.1115/1.4056374}
}
EUVIMED