InSCIt : Information-Seeking Conversations with Mixed-Initiative Interactions
Transactions of the Association for Computational Linguistics · 18.05.2023 · 11 · 453-468
DOI: 10.1162/tacl_a_00559 ↗Kurz gefasst
Fachartikel in der Zeitschrift Transactions of the Association for Computational Linguistics, online erschienen am 18.05.2023. Verfasst von Zeqiu Wu und 6 weiteren Autor:innen. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).
Abstract (Originalsprache)
In an information-seeking conversation, a user may ask questions that are under-specified or unanswerable. An ideal agent would interact by initiating different response types according to the available knowledge sources. However, most current studies either fail to or artificially incorporate such agent-side initiative. This work presents InSCIt, a dataset for Information-Seeking Conversations with mixed-initiative Interactions. It contains 4.7K user-agent turns from 805 human-human conversations where the agent searches over Wikipedia and either directly answers, asks for clarification, or provides relevant information to address user queries. The data supports two subtasks, evidence passage identification and response generation, as well as a human evaluation protocol to assess model performance. We report results of two systems based on state-of-the-art models of conversational knowledge identification and open-domain question answering. Both systems significantly underperform humans, suggesting ample room for improvement in future studies.1
Zitieren
APA
Wu, Z., Parish, R., Cheng, H., Min, S., Ammanabrolu, P., Ostendorf, M., & Hajishirzi, H. (2023). InSCIt : Information-Seeking Conversations with Mixed-Initiative Interactions. Transactions of the Association for Computational Linguistics, 11, 453-468. https://doi.org/10.1162/tacl_a_00559
Vancouver
Wu Z, Parish R, Cheng H, Min S, Ammanabrolu P, Ostendorf M, et al. InSCIt : Information-Seeking Conversations with Mixed-Initiative Interactions. Transactions of the Association for Computational Linguistics. 2023;11:453-468. doi:10.1162/tacl_a_00559
BibTeX
@article{Wu2023,
author = {Wu, Zeqiu and Parish, Ryu and Cheng, Hao and Min, Sewon and Ammanabrolu, Prithviraj and Ostendorf, Mari and Hajishirzi, Hannaneh},
title = {InSCIt : Information-Seeking Conversations with Mixed-Initiative Interactions},
journal = {Transactions of the Association for Computational Linguistics},
year = {2023},
volume = {11},
pages = {453--468},
doi = {10.1162/tacl_a_00559}
}
EUVIMED