Fisheye Object Detection with Visual Prompting-Aided Fine-Tuning
Remote Sensing · 07.06.2024 · 16 (12) · 2054
DOI: 10.3390/rs16122054 ↗Kurz gefasst
Fachartikel in der Zeitschrift Remote Sensing, online erschienen am 07.06.2024. Verfasst von Minwoo Jeon und 2 weiteren Autor:innen. Die Arbeit wurde bisher 5-mal zitiert (Crossref) und nennt 45 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Institute of Information & communications Technology Planning & Evaluation (IITP), Convergence security core talent training business support program.
Abstract (Originalsprache)
Fisheye cameras play a crucial role in various fields by offering a wide field of view, enabling the capture of expansive areas within a single frame. Nonetheless, the radial distortion characteristics of fisheye lenses lead to notable shape deformation, particularly at the edges of the image, posing a significant challenge for accurate object detection. In this paper, we introduce a novel method, ‘VP-aided fine-tuning’, which harnesses the strengths of the pretraining–fine-tuning paradigm augmented by visual prompting (VP) to bridge the domain gap between undistorted standard datasets and distorted fisheye image datasets. Our approach involves two key elements: the use of VPs to effectively adapt a pretrained model to the fisheye domain, and a detailed 24-point regression of objects to fit the unique distortions of fisheye images. This 24-point regression accurately defines the object boundaries and substantially reduces the impact of environmental noise. The proposed method was evaluated against existing object detection frameworks on fisheye images, demonstrating superior performance and robustness. Experimental results also showed performance improvements with the application of VP, regardless of the variety of fine-tuning method applied.
Förderung
- Institute of Information & communications Technology Planning & Evaluation (IITP)
- Convergence security core talent training business support program
Zitieren
APA
Jeon, M., Park, G., & Hwang, H. (2024). Fisheye Object Detection with Visual Prompting-Aided Fine-Tuning. Remote Sensing, 16(12), 2054. https://doi.org/10.3390/rs16122054
Vancouver
Jeon M, Park G, Hwang H. Fisheye Object Detection with Visual Prompting-Aided Fine-Tuning. Remote Sensing. 2024;16(12):2054. doi:10.3390/rs16122054
BibTeX
@article{Jeon2024,
author = {Jeon, Minwoo and Park, Gyeong-Moon and Hwang, Hyoseok},
title = {Fisheye Object Detection with Visual Prompting-Aided Fine-Tuning},
journal = {Remote Sensing},
year = {2024},
volume = {16},
number = {12},
pages = {2054},
doi = {10.3390/rs16122054}
}
EUVIMED