Deep Learning-Based Object Detection with Mobile Application and Expression Generation Using a Large Language Model
Journal of Naval Sciences and Engineering · 26.06.2026 · 22 (1) · 69-93
DOI: 10.56850/jnse.1828189 ↗Kurz gefasst
Fachartikel in der Zeitschrift Journal of Naval Sciences and Engineering, online erschienen am 26.06.2026. Verfasst von Nurcihan Dere und 2 weiteren Autor:innen. Die Arbeit nennt 24 Literaturangaben.
Abstract (Originalsprache)
This work presents an integrated mobile solution that allows users to detect objects in their environment, measure their distances, and understand the spatial relationships between them. The system combines YOLOv11-based real-time object detection, LiDAR-assisted distance measurement, and GPT-4o expression generation, allowing users to locate desired objects and learn about nearby objects. This allows the user to understand not only the presence of objects but also their locations and their spatial relationships. In this study, images are captured with a mobile application during object detection, ensuring that the object is always within the frame. This prevents problems such as blurring and incorrect framing, which are frequently encountered in photos created by visually impaired users. Experimental results show that the YOLOv11 model demonstrates effective performance with an F1 score of 0.77 and a mAP value of 0.806. Furthermore, the fine-tuned GPT-4o model identifies object locations in images and generates expressions that include other surrounding objects. The present work proposes a system that integrates object detection, LiDAR-based distance measurement, and expression generation from a large language model. It provides a reference for the implementation of more advanced solutions in the future.
Zitieren
APA
Dere, N., Yıldız, K., & Demir, Ö. (2026). Deep Learning-Based Object Detection with Mobile Application and Expression Generation Using a Large Language Model. Journal of Naval Sciences and Engineering, 22(1), 69-93. https://doi.org/10.56850/jnse.1828189
Vancouver
Dere N, Yıldız K, Demir Ö. Deep Learning-Based Object Detection with Mobile Application and Expression Generation Using a Large Language Model. Journal of Naval Sciences and Engineering. 2026;22(1):69-93. doi:10.56850/jnse.1828189
BibTeX
@article{Dere2026,
author = {Dere, Nurcihan and Yıldız, Kazım and Demir, Önder},
title = {Deep Learning-Based Object Detection with Mobile Application and Expression Generation Using a Large Language Model},
journal = {Journal of Naval Sciences and Engineering},
year = {2026},
volume = {22},
number = {1},
pages = {69--93},
doi = {10.56850/jnse.1828189}
}
EUVIMED