EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Multitask Learning for Crash Analysis: A Fine-Tuned LLM Framework Using Twitter Data

Shadi Jaradat, Richi Nayak, Alexander Paz, Huthaifa I. Ashqar, Mohammad Elhenawy

Smart Cities · 01.09.2024 · 7 (5) · 2422-2465

DOI: 10.3390/smartcities7050095 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Smart Cities, online erschienen am 01.09.2024. Verfasst von Shadi Jaradat und 4 weiteren Autor:innen. Die Arbeit wurde bisher 48-mal zitiert (Crossref) und nennt 63 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Queensland University of Technology (QUT), Centre of Data Science at QUT.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Road traffic crashes (RTCs) are a global public health issue, with traditional analysis methods often hindered by delays and incomplete data. Leveraging social media for real-time traffic safety analysis offers a promising alternative, yet effective frameworks for this integration are scarce. This study introduces a novel multitask learning (MTL) framework utilizing large language models (LLMs) to analyze RTC-related tweets from Australia. We collected 26,226 traffic-related tweets from May 2022 to May 2023. Using GPT-3.5, we extracted fifteen distinct features categorized into six classification tasks and nine information retrieval tasks. These features were then used to fine-tune GPT-2 for language modeling, which outperformed baseline models, including GPT-4o mini in zero-shot mode and XGBoost, across most tasks. Unlike traditional single-task classifiers that may miss critical details, our MTL approach simultaneously classifies RTC-related tweets and extracts detailed information in natural language. Our fine-tunedGPT-2 model achieved an average accuracy of 85% across the six classification tasks, surpassing the baseline GPT-4o mini model’s 64% and XGBoost’s 83.5%. In information retrieval tasks, our fine-tuned GPT-2 model achieved a BLEU-4 score of 0.22, a ROUGE-I score of 0.78, and a WER of 0.30, significantly outperforming the baseline GPT-4 mini model’s BLEU-4 score of 0.0674, ROUGE-I score of 0.2992, and WER of 2.0715. These results demonstrate the efficacy of our fine-tuned GPT-2 model in enhancing both classification and information retrieval, offering valuable insights for data-driven decision-making to improve road safety. This study is the first to explicitly apply social media data and LLMs within an MTL framework to enhance traffic safety.

Förderung

  • Queensland University of Technology (QUT)
  • Centre of Data Science at QUT

Zitieren

APA

Jaradat, S., Nayak, R., Paz, A., Ashqar, H. I., & Elhenawy, M. (2024). Multitask Learning for Crash Analysis: A Fine-Tuned LLM Framework Using Twitter Data. Smart Cities, 7(5), 2422-2465. https://doi.org/10.3390/smartcities7050095

Vancouver

Jaradat S, Nayak R, Paz A, Ashqar HI, Elhenawy M. Multitask Learning for Crash Analysis: A Fine-Tuned LLM Framework Using Twitter Data. Smart Cities. 2024;7(5):2422-2465. doi:10.3390/smartcities7050095

BibTeX
@article{Jaradat2024,
  author = {Jaradat, Shadi and Nayak, Richi and Paz, Alexander and Ashqar, Huthaifa I. and Elhenawy, Mohammad},
  title = {Multitask Learning for Crash Analysis: A Fine-Tuned LLM Framework Using Twitter Data},
  journal = {Smart Cities},
  year = {2024},
  volume = {7},
  number = {5},
  pages = {2422--2465},
  doi = {10.3390/smartcities7050095}
}
Kostenlos starten →