EUVIMEDEUVIMED entdecken
Crossref

Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised Learning

Xiaoxiao Sheng, Zhiqiang Shen, Gang Xiao

Proceedings of the AAAI Conference on Artificial Intelligence · 26.06.2023 · 37 (8) · 9802-9810

DOI: 10.1609/aaai.v37i8.26170 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Proceedings of the AAAI Conference on Artificial Intelligence, online erschienen am 26.06.2023. Verfasst von Xiaoxiao Sheng und 2 weiteren Autor:innen. Die Arbeit wurde bisher 20-mal zitiert (Crossref).

AbstractBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

We present a new self-supervised paradigm on point cloud sequence understanding. Inspired by the discriminative and generative self-supervised methods, we design two tasks, namely point cloud sequence based Contrastive Prediction and Reconstruction (CPR), to collaboratively learn more comprehensive spatiotemporal representations. Specifically, dense point cloud segments are first input into an encoder to extract embeddings. All but the last ones are then aggregated by a context-aware autoregressor to make predictions for the last target segment. Towards the goal of modeling multi-granularity structures, local and global contrastive learning are performed between predictions and targets. To further improve the generalization of representations, the predictions are also utilized to reconstruct raw point cloud sequences by a decoder, where point cloud colorization is employed to discriminate against different frames. By combining classic contrast and reconstruction paradigms, it makes the learned representations with both global discrimination and local perception. We conduct experiments on four point cloud sequence benchmarks, and report the results on action recognition and gesture recognition under multiple experimental settings. The performances are comparable with supervised methods and show powerful transferability.

Zitieren

APA

Sheng, X., Shen, Z., & Xiao, G. (2023). Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised Learning. Proceedings of the AAAI Conference on Artificial Intelligence, 37(8), 9802-9810. https://doi.org/10.1609/aaai.v37i8.26170

Vancouver

Sheng X, Shen Z, Xiao G. Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised Learning. Proceedings of the AAAI Conference on Artificial Intelligence. 2023;37(8):9802-9810. doi:10.1609/aaai.v37i8.26170

BibTeX
@article{Sheng2023,
  author = {Sheng, Xiaoxiao and Shen, Zhiqiang and Xiao, Gang},
  title = {Contrastive Predictive Autoencoders for Dynamic Point Cloud Self-Supervised Learning},
  journal = {Proceedings of the AAAI Conference on Artificial Intelligence},
  year = {2023},
  volume = {37},
  number = {8},
  pages = {9802--9810},
  doi = {10.1609/aaai.v37i8.26170}
}
Kostenlos starten →