Axiom-based aggregation functions for calculating variety, novelty, quality and quantity of ideation results
Design Science · 2026 · 12
DOI: 10.1017/dsj.2026.10051 ↗Kurz gefasst
Fachartikel in der Zeitschrift Design Science, online erschienen am 23.02.2026. Verfasst von Carl D. Sorensen und 4 weiteren Autor:innen. Die Arbeit wurde bisher 3-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: U.S. Air Force Academy.
Abstract (Originalsprache)
The evaluation of idea sets for design solutions using Shah et al.’s criteria of quality, quantity, novelty and variety can help design teams understand the thoroughness of their ideation work and can help design researchers compare the performance of different ideation methods. However, existing methods for aggregating these metrics to obtain total set scores for quality, quantity, novelty and variety are problematic. The present paper proposes axioms for the desired behavior of aggregation functions for quality, quantity, variety and novelty, then defines functions that meet the axioms. These axioms are intended to ensure that scoring methods reflect best practices in ideation and appropriately reward preferred ideation behavior, such as promoting the contribution of all ideas. Further, this paper provides operational definitions for quality, novelty and quantity evaluations of ideas and draws from previous methods to provide expedient scoring methods of individual ideas. Evaluation mechanics are presented that allow repeatable evaluation of idea sets containing thousands of ideas. Software tools are provided to automatically calculate the aggregation functions for ideas evaluated according to the mechanics of this paper. Finally, a method for evaluating both the variety of complete sets of ideas and the contributions of individual ideas to the overall set variety is proposed. The evaluation of variety is sufficiently defined that it can be automatically evaluated for any genealogy tree of ideas. The operational definitions for evaluating quality, novelty and quantity are suitable for adoption in artificial intelligence tools to allow automated evaluation of idea sets for these quantities.
Förderung
- U.S. Air Force Academy
Zitieren
APA
Sorensen, C. D., Ashworth, T. J., Stapleton, T., Mattson, C. A., & Anderson, M. L. (2026). Axiom-based aggregation functions for calculating variety, novelty, quality and quantity of ideation results. Design Science, 12. https://doi.org/10.1017/dsj.2026.10051
Vancouver
Sorensen CD, Ashworth TJ, Stapleton T, Mattson CA, Anderson ML. Axiom-based aggregation functions for calculating variety, novelty, quality and quantity of ideation results. Design Science. 2026;12. doi:10.1017/dsj.2026.10051
BibTeX
@article{Sorensen2026,
author = {Sorensen, Carl D. and Ashworth, Thomas J. and Stapleton, Tyler and Mattson, Christopher A. and Anderson, Michael L.},
title = {Axiom-based aggregation functions for calculating variety, novelty, quality and quantity of ideation results},
journal = {Design Science},
year = {2026},
volume = {12},
doi = {10.1017/dsj.2026.10051}
}
EUVIMED