A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends
IEEE Transactions on Pattern Analysis and Machine Intelligence · 2024-12 · 46 (12) · 9052-9071
DOI: 10.1109/tpami.2024.3415112 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Pattern Analysis and Machine Intelligence, 2024-12. Verfasst von Jie Gui und 6 weiteren Autor:innen. Die Arbeit wurde bisher 599-mal zitiert (Crossref) und nennt 270 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Start-up Research Fund of Southeast University, NTU RSR.
Abstract (Originalsprache)
Deep supervised learning algorithms typically require a large volume of labeled data to achieve satisfactory performance. However, the process of collecting and labeling such data can be expensive and time-consuming. Self-supervised learning (SSL), a subset of unsupervised learning, aims to learn discriminative features from unlabeled data without relying on human-annotated labels. SSL has garnered significant attention recently, leading to the development of numerous related algorithms. However, there is a dearth of comprehensive studies that elucidate the connections and evolution of different SSL variants. This paper presents a review of diverse SSL methods, encompassing algorithmic aspects, application domains, three key trends, and open research questions. First, we provide a detailed introduction to the motivations behind most SSL algorithms and compare their commonalities and differences. Second, we explore representative applications of SSL in domains such as image processing, computer vision, and natural language processing. Lastly, we discuss the three primary trends observed in SSL research and highlight the open questions that remain.
Förderung
- National Natural Science Foundation of China
- Start-up Research Fund of Southeast University
- NTU RSR
Zitieren
APA
Gui, J., Chen, T., Zhang, J., Cao, Q., Sun, Z., Luo, H., & Tao, D. (2024). A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends. IEEE Transactions on Pattern Analysis and Machine Intelligence, 46(12), 9052-9071. https://doi.org/10.1109/tpami.2024.3415112
Vancouver
Gui J, Chen T, Zhang J, Cao Q, Sun Z, Luo H, et al. A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends. IEEE Transactions on Pattern Analysis and Machine Intelligence. 2024;46(12):9052-9071. doi:10.1109/tpami.2024.3415112
BibTeX
@article{Gui2024,
author = {Gui, Jie and Chen, Tuo and Zhang, Jing and Cao, Qiong and Sun, Zhenan and Luo, Hao and Tao, Dacheng},
title = {A Survey on Self-Supervised Learning: Algorithms, Applications, and Future Trends},
journal = {IEEE Transactions on Pattern Analysis and Machine Intelligence},
year = {2024},
volume = {46},
number = {12},
pages = {9052--9071},
doi = {10.1109/tpami.2024.3415112}
}
EUVIMED