EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Latent Graph Attention for Spatial Context in Light-Weight Networks: Multi-Domain Applications in Visual Perception Tasks

Ayush Singh, Yash Bhambhu, Himanshu Buckchash, Deepak K. Gupta, Dilip K. Prasad

Applied Sciences · 19.11.2024 · 14 (22) · 10677

DOI: 10.3390/app142210677 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Applied Sciences, online erschienen am 19.11.2024. Verfasst von Ayush Singh und 4 weiteren Autor:innen. Die Arbeit wurde bisher 4-mal zitiert (Crossref) und nennt 43 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Research Council of Norway Project, H2020 Project, HORIZON-ERC-POC Project.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Global contexts in images are quite valuable in image-to-image translation problems. Conventional attention-based and graph-based models capture the global context to a large extent; however, these are computationally expensive. Moreover, existing approaches are limited to only learning the pairwise semantic relation between any two points in the image. In this paper, we present Latent Graph Attention (LGA), a computationally inexpensive (linear to the number of nodes) and stable modular framework for incorporating the global context in existing architectures. This framework particularly empowers small-scale architectures to achieve performance closer to that of large architectures, making the light-weight architectures more useful for edge devices with lower compute power and lower energy needs. LGA propagates information spatially using a network of locally connected graphs, thereby facilitating the construction of a semantically coherent relation between any two spatially distant points that also takes into account the influence of the intermediate pixels. Moreover, the depth of the graph network can be used to adapt the extent of contextual spread to the target dataset, thereby able to explicitly control the added computational cost. To enhance the learning mechanism of LGA, we also introduce a novel contrastive loss term that helps our LGA module to couple well with the original architecture at the expense of minimal additional computational load. We show that incorporating LGA improves performance in three challenging applications, namely transparent object segmentation, image restoration for dehazing and optical flow estimation.

Förderung

  • Research Council of Norway Project
  • H2020 Project
  • HORIZON-ERC-POC Project
  • VirtualStain

Zitieren

APA

Singh, A., Bhambhu, Y., Buckchash, H., Gupta, D. K., & Prasad, D. K. (2024). Latent Graph Attention for Spatial Context in Light-Weight Networks: Multi-Domain Applications in Visual Perception Tasks. Applied Sciences, 14(22), 10677. https://doi.org/10.3390/app142210677

Vancouver

Singh A, Bhambhu Y, Buckchash H, Gupta DK, Prasad DK. Latent Graph Attention for Spatial Context in Light-Weight Networks: Multi-Domain Applications in Visual Perception Tasks. Applied Sciences. 2024;14(22):10677. doi:10.3390/app142210677

BibTeX
@article{Singh2024,
  author = {Singh, Ayush and Bhambhu, Yash and Buckchash, Himanshu and Gupta, Deepak K. and Prasad, Dilip K.},
  title = {Latent Graph Attention for Spatial Context in Light-Weight Networks: Multi-Domain Applications in Visual Perception Tasks},
  journal = {Applied Sciences},
  year = {2024},
  volume = {14},
  number = {22},
  pages = {10677},
  doi = {10.3390/app142210677}
}
Kostenlos starten →