EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

A Novel Framework for Image Matching and Stitching for Moving Car Inspection under Illumination Challenges

Andreas El Saer, Lazaros Grammatikopoulos iD, Giorgos Sfikas iD, George Karras, Elli Petsa

Sensors · 07.02.2024 · 24 (4) · 1083

DOI: 10.3390/s24041083 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Sensors, online erschienen am 07.02.2024. Verfasst von Andreas El Saer und 4 weiteren Autor:innen. Beteiligte Einrichtung: Department of Surveying and Geoinformatics Engineering, University of West Attica, 12243 Athens, Greece. Die Arbeit wurde bisher 6-mal zitiert (Crossref) und nennt 77 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: European Union's Horizon h2020, European Union’s Horizon h2020.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Vehicle exterior inspection is a critical operation for identifying defects and ensuring the overall safety and integrity of vehicles. Visual-based inspection of moving objects, such as vehicles within dynamic environments abounding with reflections, presents significant challenges, especially when time and accuracy are of paramount importance. Conventional exterior inspections of vehicles require substantial labor, which is both costly and prone to errors. Recent advancements in deep learning have reduced labor work by enabling the use of segmentation algorithms for defect detection and description based on simple RGB camera acquisitions. Nonetheless, these processes struggle with issues of image orientation leading to difficulties in accurately differentiating between detected defects. This results in numerous false positives and additional labor effort. Estimating image poses enables precise localization of vehicle damages within a unified 3D reference system, following initial detections in the 2D imagery. A primary challenge in this field is the extraction of distinctive features and the establishment of accurate correspondences between them, a task that typical image matching techniques struggle to address for highly reflective moving objects. In this study, we introduce an innovative end-to-end pipeline tailored for efficient image matching and stitching, specifically addressing the challenges posed by moving objects in static uncalibrated camera setups. Extracting features from moving objects with strong reflections presents significant difficulties, beyond the capabilities of current image matching algorithms. To tackle this, we introduce a novel filtering scheme that can be applied to every image matching process, provided that the input features are sufficient. A critical aspect of this module involves the exclusion of points located in the background, effectively distinguishing them from points that pertain to the vehicle itself. This is essential for accurate feature extraction and subsequent analysis. Finally, we generate a high-quality image mosaic by employing a series of sequential stereo-rectified pairs.

Schlagwörter

Stichwörter der Autor:innen

car inspectiondeep learningfeature extractionglossy surfacesimage matchingimage pose estimationmoving objectsoutlier removalstructure from motion

Autor:innen und Institutionen

  • Department of Surveying and Geoinformatics Engineering, University of West Attica, 12243 Athens, Greece.
  • School of Rural, Surveying and Geoinformatics Engineering, National Technical University of Athens, 15780 Athens, Greece.

ORCID-Profile: Lazaros Grammatikopoulos, Giorgos Sfikas

Förderung

  • European Union's Horizon h2020
  • European Union’s Horizon h2020

Zitieren

APA

El Saer, A., Grammatikopoulos, L., Sfikas, G., Karras, G., & Petsa, E. (2024). A Novel Framework for Image Matching and Stitching for Moving Car Inspection under Illumination Challenges. Sensors, 24(4), 1083. https://doi.org/10.3390/s24041083

Vancouver

El Saer A, Grammatikopoulos L, Sfikas G, Karras G, Petsa E. A Novel Framework for Image Matching and Stitching for Moving Car Inspection under Illumination Challenges. Sensors. 2024;24(4):1083. doi:10.3390/s24041083

BibTeX
@article{ElSaer2024,
  author = {El Saer, Andreas and Grammatikopoulos, Lazaros and Sfikas, Giorgos and Karras, George and Petsa, Elli},
  title = {A Novel Framework for Image Matching and Stitching for Moving Car Inspection under Illumination Challenges},
  journal = {Sensors},
  year = {2024},
  volume = {24},
  number = {4},
  pages = {1083},
  doi = {10.3390/s24041083}
}
Kostenlos starten →