EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Gauge-Equivariant Attention for Rotation-Stable 360° Scene Understanding

Tianjian Zhou, Yishan Li, Jie Jiang, Yifei Zhang

ACM Transactions on Graphics · 09.11.2026 · 45 (6) · 1-24

DOI: 10.1145/3842525 ↗

Kurz gefasst

Fachartikel in der Zeitschrift ACM Transactions on Graphics, online erschienen am 09.11.2026. Verfasst von Tianjian Zhou und 3 weiteren Autor:innen. Die Arbeit nennt 52 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

Panoramic 360° scene understanding increasingly relies on icosphere transformers, but a state-of-the-art spherical model loses more than half of its segmentation accuracy when the camera rotates by 90°, and controlled ablations identify gauge dependence in its relative-position bias as a major contributor. We propose gauge-equivariant relative position encoding (GE-RPE) : a parameter-free Reynolds average of the bias over a finite cyclic subgroup C n ⊂ SO(2) of gauge rotations. Plugged into a SphereUFormer backbone the change is invisible at deployment—zero added parameters and 1.5–4.4% forward latency—and the matched three-seed GE-RPE model records a 1.3% drop; the published SphereUFormer checkpoint records 53% under the same stress protocol but a different training recipe. Once the gauge defect is removed and a teacher-token permutation π R aligns the SSL views to the rotated student frame, iBOT+MAE pretraining stops being a liability and becomes a clean low-label lever: the full framework EquiSSL (GE-RPE + π R + iBOT+MAE) tightens the drop to 0.8% at 68.30% val mIoU and lifts 1%-label fine-tuning by +2.39 mIoU on the N =373 test split (and by +4.10 on the smaller N =40 val split); the same fix carries over to monocular depth and to zero-shot Structured3D segmentation. The construction is provably C n - invariant and O( n -2 )-close to the continuous SO(2) average, making the resulting model a usable 360° visual-computing primitive across panoramic relighting, immersive video, and cross-dataset transfer. Code is available at https://github.com/Jaywalk18/equissl-release.

Zitieren

APA

Zhou, T., Li, Y., Jiang, J., & Zhang, Y. (2026). Gauge-Equivariant Attention for Rotation-Stable 360° Scene Understanding. ACM Transactions on Graphics, 45(6), 1-24. https://doi.org/10.1145/3842525

Vancouver

Zhou T, Li Y, Jiang J, Zhang Y. Gauge-Equivariant Attention for Rotation-Stable 360° Scene Understanding. ACM Transactions on Graphics. 2026;45(6):1-24. doi:10.1145/3842525

BibTeX
@article{Zhou2026,
  author = {Zhou, Tianjian and Li, Yishan and Jiang, Jie and Zhang, Yifei},
  title = {Gauge-Equivariant Attention for Rotation-Stable 360° Scene Understanding},
  journal = {ACM Transactions on Graphics},
  year = {2026},
  volume = {45},
  number = {6},
  pages = {1--24},
  doi = {10.1145/3842525}
}
Kostenlos starten →