EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Interpretable Vision Transformers in Monocular Depth Estimation via SVDA

Vasileios Arampatzakis, George Pavlidis, Nikolaos Mitianoudis, Nikos Papamarkos

Mathematics · 11.04.2026 · 14 (8) · 1272

DOI: 10.3390/math14081272 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Mathematics, online erschienen am 11.04.2026. Verfasst von Vasileios Arampatzakis und 3 weiteren Autor:innen. Die Arbeit nennt 26 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Horizon Europe.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Monocular depth estimation is a central problem in computer vision with applications in robotics, augmented reality, and autonomous driving, yet the self-attention mechanisms used by modern Transformer architectures remain opaque. In this work, we integrate SVD-Inspired Attention (SVDA) into the Dense Prediction Transformer (DPT), introducing a spectrally structured attention formulation for dense prediction that decouples directional alignment from spectral modulation through a learnable diagonal matrix embedded in normalized query–key interactions. Experiments on KITTI and NYU-v2 show that SVDA preserves competitive predictive performance while enabling intrinsic interpretability: on KITTI, AbsRel improves from 0.058 to 0.056 and δ1 from 0.976 to 0.979, while on NYU-v2, AbsRel improves from 0.133 to 0.124 and δ1 from 0.865 to 0.872. This is achieved with only 0.01% additional parameters, at the cost of a measurable runtime overhead associated with the added normalization and spectral modulation. More importantly, SVDA enables six spectral indicators that quantify entropy, rank, sparsity, alignment, selectivity, and robustness, revealing consistent cross-dataset and depth-wise patterns in how attention organizes during training. These properties make the model easier to inspect and better suited to applications where transparency and reliability are important, such as robotics and autonomous navigation.

Förderung

  • Horizon Europe

Zitieren

APA

Arampatzakis, V., Pavlidis, G., Mitianoudis, N., & Papamarkos, N. (2026). Interpretable Vision Transformers in Monocular Depth Estimation via SVDA. Mathematics, 14(8), 1272. https://doi.org/10.3390/math14081272

Vancouver

Arampatzakis V, Pavlidis G, Mitianoudis N, Papamarkos N. Interpretable Vision Transformers in Monocular Depth Estimation via SVDA. Mathematics. 2026;14(8):1272. doi:10.3390/math14081272

BibTeX
@article{Arampatzakis2026,
  author = {Arampatzakis, Vasileios and Pavlidis, George and Mitianoudis, Nikolaos and Papamarkos, Nikos},
  title = {Interpretable Vision Transformers in Monocular Depth Estimation via SVDA},
  journal = {Mathematics},
  year = {2026},
  volume = {14},
  number = {8},
  pages = {1272},
  doi = {10.3390/math14081272}
}
Kostenlos starten →