Silhouette-Based Evaluation of PCA, Isomap, and t-SNE on Linear and Nonlinear Data Structures
Stats · 03.11.2025 · 8 (4) · 105
DOI: 10.3390/stats8040105 ↗Kurz gefasst
Fachartikel in der Zeitschrift Stats, online erschienen am 03.11.2025. Verfasst von Mostafa Zahed und 1 weiteren Autor:innen. Die Arbeit wurde bisher 8-mal zitiert (Crossref) und nennt 38 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: College of Arts and Sciences, East Tennessee State University.
Abstract (Originalsprache)
Dimensionality reduction is fundamental for analyzing high-dimensional data, supporting visualization, denoising, and structure discovery. We present a systematic, large-scale benchmark of three widely used methods—Principal Component Analysis (PCA), Isometric Mapping (Isomap), and t-Distributed Stochastic Neighbor Embedding (t-SNE)—evaluated by average silhouette scores to quantify cluster preservation after embedding. Our full factorial simulation varies sample size n∈{100,200,300,400,500}, noise variance σ2∈{0.25,0.5,0.75,1,1.5,2}, and feature count p∈{20,50,100,200,300,400} under four generative regimes: (1) a linear Gaussian mixture, (2) a linear Student-t mixture with heavy tails, (3) a nonlinear Swiss-roll manifold, and (4) a nonlinear concentric-spheres manifold, each replicated 1000 times per condition. Beyond empirical comparisons, we provide mathematical results that explain the observed rankings: under standard separation and sampling assumptions, PCA maximizes silhouettes for linear, low-rank structure, whereas Isomap dominates on smooth curved manifolds; t-SNE prioritizes local neighborhoods, yielding strong local separation but less reliable global geometry. Empirically, PCA consistently achieves the highest silhouettes for linear structure (Isomap second, t-SNE third); on manifolds the ordering reverses (Isomap > t-SNE > PCA). Increasing σ2 and adding uninformative dimensions (larger p) degrade all methods, while larger n improves levels and stability. To our knowledge, this is the first integrated study combining a comprehensive factorial simulation across linear and nonlinear regimes with distribution-based summaries (density and violin plots) and supporting theory that predicts method orderings. The results offer clear, practice-oriented guidance: prefer PCA when structure is approximately linear; favor manifold learning—especially Isomap—when curvature is present; and use t-SNE for the exploratory visualization of local neighborhoods. Complete tables and replication materials are provided to facilitate method selection and reproducibility.
Förderung
- College of Arts and Sciences
- East Tennessee State University
Zitieren
APA
Zahed, M., & Skafyan, M. (2025). Silhouette-Based Evaluation of PCA, Isomap, and t-SNE on Linear and Nonlinear Data Structures. Stats, 8(4), 105. https://doi.org/10.3390/stats8040105
Vancouver
Zahed M, Skafyan M. Silhouette-Based Evaluation of PCA, Isomap, and t-SNE on Linear and Nonlinear Data Structures. Stats. 2025;8(4):105. doi:10.3390/stats8040105
BibTeX
@article{Zahed2025,
author = {Zahed, Mostafa and Skafyan, Maryam},
title = {Silhouette-Based Evaluation of PCA, Isomap, and t-SNE on Linear and Nonlinear Data Structures},
journal = {Stats},
year = {2025},
volume = {8},
number = {4},
pages = {105},
doi = {10.3390/stats8040105}
}
EUVIMED