EUVIMEDEUVIMED entdecken
Crossref

A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementarity

Charvi Rastogi, Liu Leqi, Kenneth Holstein, Hoda Heidari

Proceedings of the AAAI Conference on Human Computation and Crowdsourcing · 03.11.2023 · 11 (1) · 127-139

DOI: 10.1609/hcomp.v11i1.27554 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, online erschienen am 03.11.2023. Verfasst von Charvi Rastogi und 3 weiteren Autor:innen. Die Arbeit wurde bisher 13-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Hybrid human-ML systems increasingly make consequential decisions in a wide range of domains. These systems are often introduced with the expectation that the combined human-ML system will achieve complementary performance, that is, the combined decision-making system will be an improvement compared with either decision-making agent in isolation. However, empirical results have been mixed, and existing research rarely articulates the sources and mechanisms by which complementary performance is expected to arise. Our goal in this work is to provide conceptual tools to advance the way researchers reason and communicate about human-ML complementarity. Drawing upon prior literature in human psychology, machine learning, and human-computer interaction, we propose a taxonomy characterizing distinct ways in which human and ML-based decision-making can differ. In doing so, we conceptually map potential mechanisms by which combining human and ML decision-making may yield complementary performance, developing a language for the research community to reason about design of hybrid systems in any decision-making domain. To illustrate how our taxonomy can be used to investigate complementarity, we provide a mathematical aggregation framework to examine enabling conditions for complementarity. Through synthetic simulations, we demonstrate how this framework can be used to explore specific aspects of our taxonomy and shed light on the optimal mechanisms for combining human-ML judgments.

Zitieren

APA

Rastogi, C., Leqi, L., Holstein, K., & Heidari, H. (2023). A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementarity. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, 11(1), 127-139. https://doi.org/10.1609/hcomp.v11i1.27554

Vancouver

Rastogi C, Leqi L, Holstein K, Heidari H. A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementarity. Proceedings of the AAAI Conference on Human Computation and Crowdsourcing. 2023;11(1):127-139. doi:10.1609/hcomp.v11i1.27554

BibTeX
@article{Rastogi2023,
  author = {Rastogi, Charvi and Leqi, Liu and Holstein, Kenneth and Heidari, Hoda},
  title = {A Taxonomy of Human and ML Strengths in Decision-Making to Investigate Human-ML Complementarity},
  journal = {Proceedings of the AAAI Conference on Human Computation and Crowdsourcing},
  year = {2023},
  volume = {11},
  number = {1},
  pages = {127--139},
  doi = {10.1609/hcomp.v11i1.27554}
}
Kostenlos starten →