EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Hybrid Vision System for Enhanced Situational Awareness in Unmanned Surface Vehicles: Decision-Level Camera-LiDAR Fusion With Supervised and Unsupervised Approaches

Yousef Abd Alhattab, Hasan F. M. Zaki, Abd Halim Bin Embong, Zulkifli Bin Zainal Abidin, Ahmed Rimaz Faizabadi, Ahmad Imran Ibrahim

IEEE Access · 2025 · 13 · 75618-75634

DOI: 10.1109/access.2025.3562299 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Access, 2025. Verfasst von Yousef Abd Alhattab und 5 weiteren Autor:innen. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 33 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Ministry of Higher Education Malaysia through the Fundamental Research Grant Scheme, Ministry of Science, Technology and Innovation (MOSTI) through a Collaborative Effort Between Pesaka Mawar Sdn. Bhd., and International Islamic University Mala….

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The integration of LiDAR and cameras with an efficient data fusion approach significantly improves Enhanced Situational Awareness (ESA) for small-sized Unmanned Surface Vehicles (USVs). This is critical for early obstacle detection, particularly when maritime obstacles are only 5 to 10 seconds away. This is important to ensure effective collision avoidance in regions without reliable Global Positioning System (GPS) and Automatic Identification System (AIS), while maintaining low computational requirements and real-time performance. This paper presents a system aimed at ESA using an unsupervised approach and a trained deep learning model to detect multiple maritime obstacles in denied GPS zones. The proposed system incorporates a technical mechanism that uses a compact hardware system with an integrated advanced computing module and sensors for small-sized USVs. It addresses the challenges of achieving peak performance on an edge machine learning computer integration to reduce computational overhead. Further, it minimizes temporal detection variations using sophisticated filters and clustering in dynamic maritime environments with synchronized LiDAR and camera data fusion. The detection model, trained using Maritime Federated Large Dataset (MFLD2), achieved over 99% operational accuracy with the proposed data fusion approach. The system’s capacity to precisely identify obstacle location and distance is validated by experimental findings, enabling real-time situational awareness.

Förderung

  • Ministry of Higher Education Malaysia through the Fundamental Research Grant Scheme
  • Ministry of Science, Technology and Innovation (MOSTI) through a Collaborative Effort Between Pesaka Mawar Sdn. Bhd., and International Islamic University Mala…

Zitieren

APA

Alhattab, Y. A., Zaki, H. F. M., Embong, A. H. B., Abidin, Z. B. Z., Faizabadi, A. R., & Ibrahim, A. I. (2025). Hybrid Vision System for Enhanced Situational Awareness in Unmanned Surface Vehicles: Decision-Level Camera-LiDAR Fusion With Supervised and Unsupervised Approaches. IEEE Access, 13, 75618-75634. https://doi.org/10.1109/access.2025.3562299

Vancouver

Alhattab YA, Zaki HFM, Embong AHB, Abidin ZBZ, Faizabadi AR, Ibrahim AI. Hybrid Vision System for Enhanced Situational Awareness in Unmanned Surface Vehicles: Decision-Level Camera-LiDAR Fusion With Supervised and Unsupervised Approaches. IEEE Access. 2025;13:75618-75634. doi:10.1109/access.2025.3562299

BibTeX
@article{Alhattab2025,
  author = {Alhattab, Yousef Abd and Zaki, Hasan F. M. and Embong, Abd Halim Bin and Abidin, Zulkifli Bin Zainal and Faizabadi, Ahmed Rimaz and Ibrahim, Ahmad Imran},
  title = {Hybrid Vision System for Enhanced Situational Awareness in Unmanned Surface Vehicles: Decision-Level Camera-LiDAR Fusion With Supervised and Unsupervised Approaches},
  journal = {IEEE Access},
  year = {2025},
  volume = {13},
  pages = {75618--75634},
  doi = {10.1109/access.2025.3562299}
}
Kostenlos starten →