The Human-in-the-Loop Paradigm Orchestrating Human Intelligence and Agentic AI for Scalable Customer Experience: A Metrics-Focused Review
International Journal of Innovative Science and Research Technology · 14.03.2026 · 698
DOI: 10.38124/ijisrt/26mar527 ↗Kurz gefasst
Fachartikel in der Zeitschrift International Journal of Innovative Science and Research Technology, online erschienen am 14.03.2026. Verfasst von Aishwary Bodhale und 1 weiteren Autor:innen. Die Arbeit nennt 33 Literaturangaben.
Abstract (Originalsprache)
Human-in-the-Loop (HiL) systems integration into customer experience (CX) schemes is a disruptive strategy in terms of expanding service delivery without sacrificing quality. This is a review article that investigates the paradigm shift of orchestrated human intelligence and agentic AI in the context of CX with particular attention given to the metrics that are needed to assess, optimize, and scale such systems of hybrid forms. By conducting a topical review of literature published in 2015-2024, we realize the fact that the current CX measures do not sufficiently reflect the dynamic interaction between humans and artificial agents. According to the traditional measures of endpoint (CSAT, NPS, CES), it is not possible to measure the quality of orchestration, the effectiveness of handoff and the effectiveness of human-AI cooperation. Our framework of metrics includes five dimensions that are structured as (1) Orchestration Efficiency Metrics, (2) CX Journey Analytics, (3) Agent Performance Indicators, (4) Business Impact Measures, and (5) Learning and Adaptation Metrics. The review provides a synthesis of 87 relevant studies, which uncovered three new trends: the continuous versus discrete approach to measurement, the necessity to track the emotional trajectory, and the necessity to align multi-stakeholder metrics. This is, to the best of our knowledge, one of the first reviews to explicitly conceptualize human, AI orchestration as a quantifiable construct and to systematize measurements in specific Human-in-the-Loop customer experience system metrics. We end with research agenda that focuses on creation of real time orchestration scoring systems, considerations of ethical metrics and industry specific implementation. This publication has a contribution to the academic literature and practice as it offers a systematic method of measuring what is important in human-AI collaborative CX systems.
Zitieren
APA
Bodhale, A., & Meshram, A. (2026). The Human-in-the-Loop Paradigm Orchestrating Human Intelligence and Agentic AI for Scalable Customer Experience: A Metrics-Focused Review. International Journal of Innovative Science and Research Technology, 698. https://doi.org/10.38124/ijisrt/26mar527
Vancouver
Bodhale A, Meshram A. The Human-in-the-Loop Paradigm Orchestrating Human Intelligence and Agentic AI for Scalable Customer Experience: A Metrics-Focused Review. International Journal of Innovative Science and Research Technology. 2026:698. doi:10.38124/ijisrt/26mar527
BibTeX
@article{Bodhale2026,
author = {Bodhale, Aishwary and Meshram, Akanksha},
title = {The Human-in-the-Loop Paradigm Orchestrating Human Intelligence and Agentic AI for Scalable Customer Experience: A Metrics-Focused Review},
journal = {International Journal of Innovative Science and Research Technology},
year = {2026},
pages = {698},
doi = {10.38124/ijisrt/26mar527}
}
EUVIMED