Semantic Scene Understanding with Large Language Models on Unmanned Aerial Vehicles
Drones · 08.02.2023 · 7 (2) · 114
DOI: 10.3390/drones7020114 ↗Kurz gefasst
Fachartikel in der Zeitschrift Drones, online erschienen am 08.02.2023. Verfasst von J. de Curtò und 2 weiteren Autor:innen. Die Arbeit wurde bisher 70-mal zitiert (Crossref) und nennt 36 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: HK Innovation and Technology Commission (InnoHK Project CIMDA), Universitat Politècnica de València, MCIN/AEI/10.13039/501100011033 and ERDF.
Abstract (Originalsprache)
Unmanned Aerial Vehicles (UAVs) are able to provide instantaneous visual cues and a high-level data throughput that could be further leveraged to address complex tasks, such as semantically rich scene understanding. In this work, we built on the use of Large Language Models (LLMs) and Visual Language Models (VLMs), together with a state-of-the-art detection pipeline, to provide thorough zero-shot UAV scene literary text descriptions. The generated texts achieve a GUNNING Fog median grade level in the range of 7–12. Applications of this framework could be found in the filming industry and could enhance user experience in theme parks or in the advertisement sector. We demonstrate a low-cost highly efficient state-of-the-art practical implementation of microdrones in a well-controlled and challenging setting, in addition to proposing the use of standardized readability metrics to assess LLM-enhanced descriptions.
Förderung
- HK Innovation and Technology Commission (InnoHK Project CIMDA)
- Universitat Politècnica de València
- MCIN/AEI/10.13039/501100011033 and ERDF
Zitieren
APA
Curtò, J. D., Zarzà, I. D., & Calafate, C. T. (2023). Semantic Scene Understanding with Large Language Models on Unmanned Aerial Vehicles. Drones, 7(2), 114. https://doi.org/10.3390/drones7020114
Vancouver
Curtò JD, Zarzà ID, Calafate CT. Semantic Scene Understanding with Large Language Models on Unmanned Aerial Vehicles. Drones. 2023;7(2):114. doi:10.3390/drones7020114
BibTeX
@article{Curt2023,
author = {Curtò, J. de and Zarzà, I. de and Calafate, Carlos T.},
title = {Semantic Scene Understanding with Large Language Models on Unmanned Aerial Vehicles},
journal = {Drones},
year = {2023},
volume = {7},
number = {2},
pages = {114},
doi = {10.3390/drones7020114}
}
EUVIMED