EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

MoiréMop: Lightweight and Pervasive Moiré Removal for Mobile Camera-to-Screen Interaction

Zhaowei Wu, Jingyi Ning, Yanling Bu, Lei Xie

Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · 15.06.2026 · 10 (2) · 1-28

DOI: 10.1145/3810197 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, online erschienen am 15.06.2026. Verfasst von Zhaowei Wu und 3 weiteren Autor:innen. Die Arbeit wurde bisher 1-mal zitiert (Crossref) und nennt 65 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: National Natural Science Foundation of China, Key Projects of Jiangsu Provincial Basic Research Program, Basic Research Program of Jiangsu.

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The widespread use of mobile devices and electronic displays has made camera-to-screen interaction, where users capture display screens with smartphones or smart glasses, a common way of recording and sharing information across applications such as real-time document analysis and AR/VR. However, such interaction often introduces unwanted colored stripe distortions known as moiré patterns. These patterns severely degrade image quality and hinder user experience in downstream tasks. Existing moiré removal methods process entire images uniformly, leading to high computational costs and detail degradation in moiré-free regions, while lacking generalizability across diverse real-world scenarios. In this paper, we propose MoiréMop, a lightweight, high-fidelity, and pervasive moiré removal method for mobile devices. MoiréMop localizes moiré-affected regions robustly and performs selective removal for efficiency and fidelity. To achieve robust and fine-grained moiré region extraction, we analyze the spectral aliasing mechanism of moiré pattern and reveal a unique symmetry between high- and low-frequency components. Leveraging this, we propose a Reversed Spectrum Consistency Map (RSCM) to estimate moiré presence and a Temporal Consistency Mask Propagation (TCMP) for real-time moiré region propagation across frames. For high-fidelity moiré removal, a Cross Spectral Adaptive Demoiré Network (CSADN) is designed to suppress moiré adaptively by modeling frequency symmetry. Extensive experiments demonstrate that MoiréMop achieves high-fidelity moiré removal and enhances segmentation accuracy by 18% while maintaining real-time efficiency on pervasive mobile devices, significantly improving user experience.

Förderung

  • National Natural Science Foundation of China
  • Key Projects of Jiangsu Provincial Basic Research Program
  • Basic Research Program of Jiangsu
  • Natural Science Foundation of Jiangsu Province
  • Postdoctoral Fellowship Program of CPSF
  • China Postdoctoral Science Foundation
  • Fundamental and Interdisciplinary Disciplines Breakthrough Plan of the Ministry of Education of China
  • 111 Center

Zitieren

APA

Wu, Z., Ning, J., Bu, Y., & Xie, L. (2026). MoiréMop: Lightweight and Pervasive Moiré Removal for Mobile Camera-to-Screen Interaction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies, 10(2), 1-28. https://doi.org/10.1145/3810197

Vancouver

Wu Z, Ning J, Bu Y, Xie L. MoiréMop: Lightweight and Pervasive Moiré Removal for Mobile Camera-to-Screen Interaction. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies. 2026;10(2):1-28. doi:10.1145/3810197

BibTeX
@article{Wu2026,
  author = {Wu, Zhaowei and Ning, Jingyi and Bu, Yanling and Xie, Lei},
  title = {MoiréMop: Lightweight and Pervasive Moiré Removal for Mobile Camera-to-Screen Interaction},
  journal = {Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies},
  year = {2026},
  volume = {10},
  number = {2},
  pages = {1--28},
  doi = {10.1145/3810197}
}
Kostenlos starten →