A Modeling Strategy for the Verification of Context-Oriented Chatbot Conversational Flows via Model Checking
JUCS - Journal of Universal Computer Science · 28.07.2023 · 29 (7) · 805-835
DOI: 10.3897/jucs.91311 ↗Kurz gefasst
Fachartikel in der Zeitschrift JUCS - Journal of Universal Computer Science, online erschienen am 28.07.2023. Verfasst von Geovana Ramos Sousa Silva und 2 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref). Der Volltext ist frei zugänglich (Open Access, CC BY-ND 4.0). Gefördert von: Coordenação de Aperfeiçoamento de Pessoal de Nível Superior.
Abstract (Originalsprache)
Verification of chatbot conversational flows is paramount to capturing and understanding chatbot behavior and predicting problems that would cause the entire flow to be restructured from scratch. The literature on chatbot testing is scarce, and the few works that approach this subject do not focus on verifying the communication sequences in tandem with the functional requirements of the conversational flow itself. However, covering all possible conversational flows of context-oriented chatbots through testing is not feasible in practice given the many ramifications that should be covered by test cases. Alternatively, model checking provides a model-based verification in a mathematically precise and unambiguous manner. Moreover, it can anticipate design flaws early in the software design phase that could lead to incompleteness, ambiguities, and inconsistencies. We postulate that finding design flaws in chatbot conversational flows via model checking early in the design phase may overcome quite a few verification gaps that are not feasible via current testing techniques for context-oriented chatbot conversational flows. Therefore, in this work, we propose a modeling strategy to design and verify chatbot conversational flows via the Uppaal model checking tool. Our strategy is materialized in the form of templates and a mapping of chatbot elements into Uppaal elements. To evaluate this strategy, we invited a few chatbot developers with different levels of expertise. The feedback from the participants revealed that the strategy is a great ally in the phases of conversational prototyping and design, as well as helping to refine requirements and revealing branching logic that can be reused in the implementation phase.
Förderung
- Coordenação de Aperfeiçoamento de Pessoal de Nível Superior
Zitieren
APA
Silva, G. R. S., Rodrigues, G. N., & Canedo, E. D. (2023). A Modeling Strategy for the Verification of Context-Oriented Chatbot Conversational Flows via Model Checking. JUCS - Journal of Universal Computer Science, 29(7), 805-835. https://doi.org/10.3897/jucs.91311
Vancouver
Silva GRS, Rodrigues GN, Canedo ED. A Modeling Strategy for the Verification of Context-Oriented Chatbot Conversational Flows via Model Checking. JUCS - Journal of Universal Computer Science. 2023;29(7):805-835. doi:10.3897/jucs.91311
BibTeX
@article{Silva2023,
author = {Silva, Geovana Ramos Sousa and Rodrigues, Genaína Nunes and Canedo, Edna Dias},
title = {A Modeling Strategy for the Verification of Context-Oriented Chatbot Conversational Flows via Model Checking},
journal = {JUCS - Journal of Universal Computer Science},
year = {2023},
volume = {29},
number = {7},
pages = {805--835},
doi = {10.3897/jucs.91311}
}
EUVIMED