LLM-Powered Automatic Translation and Urgency in Crisis Scenarios
Proceedings of the International ISCRAM Conference · 25.05.2026 · 23
DOI: 10.59297/vtqcsb52 ↗Kurz gefasst
Fachartikel in der Zeitschrift Proceedings of the International ISCRAM Conference, online erschienen am 25.05.2026. Verfasst von Belu Ticona und 1 weiteren Autor:innen.
Abstract (Originalsprache)
Large language models (LLMs) are increasingly proposed for crisis preparedness and response, particularly for multilingual communication. However, their suitability for high-stakes crisis contexts remains insufficiently evaluated. This work examines the performance of state-of-the-art LLMs and machine translation systems in crisis-domain translation, with a focus on preserving urgency, a critical property for effective crisis communication and triage. Using multilingual crisis data (TICO-19, 30 languages) and a newly introduced urgency-annotated dataset of 100 scenarios translated into 29 languages, we show that dedicated translation models and LLMs exhibit substantial quality degradation, particularly for low-resource languages. Beyond translation quality, we conduct a human annotation study revealing a striking asymmetry: human assessors maintain consistent urgency judgments regardless of prompt language, while LLM-based urgency classifications vary widely across languages for identical scenarios, at times spanning the full range from Not Urgent to Critical. These findings highlight significant risks in deploying general-purpose language technologies for crisis triage and underscore the need for multilingual, human-centered evaluation frameworks.
Zitieren
APA
Ticona, B., & Anastasopoulos, A. (2026). LLM-Powered Automatic Translation and Urgency in Crisis Scenarios. Proceedings of the International ISCRAM Conference, 23. https://doi.org/10.59297/vtqcsb52
Vancouver
Ticona B, Anastasopoulos A. LLM-Powered Automatic Translation and Urgency in Crisis Scenarios. Proceedings of the International ISCRAM Conference. 2026;23. doi:10.59297/vtqcsb52
BibTeX
@article{Ticona2026,
author = {Ticona, Belu and Anastasopoulos, Antonios},
title = {LLM-Powered Automatic Translation and Urgency in Crisis Scenarios},
journal = {Proceedings of the International ISCRAM Conference},
year = {2026},
volume = {23},
doi = {10.59297/vtqcsb52}
}
EUVIMED