Semi-supervised spatiotemporal segmentation of in situ transmission electron microscopy for nanoparticle dynamics
Materials Today Physics · 2026-02 · 61 · 102033
DOI: 10.1016/j.mtphys.2026.102033 ↗Kurz gefasst
Fachartikel in der Zeitschrift Materials Today Physics, 2026-02. Verfasst von Manpreet Kaur und 6 weiteren Autor:innen. Die Arbeit wurde bisher 2-mal zitiert (Crossref) und nennt 71 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY-NC 4.0). Gefördert von: Materials Research Science and Engineering Center, Harvard University, National Science Foundation, Division of Materials Research.
Abstract (Originalsprache)
Understanding the real-time morphological evolution of nanoparticles under varying thermal and environmental conditions is crucial for revealing the mechanisms that govern their stability, growth, and functional performance in applications such as catalysis and nanomanufacturing. In-situ transmission electron microscopy provides direct, atomic-scale visualization of these dynamic processes through sequential imaging, capturing subtle transformations on a frame-by-frame basis. However, extracting reliable shape descriptors from such sequential image data remains challenging due to high noise, low contrast, inter-particle overlap, and the manual effort required for annotation. Existing segmentation methods often treat each frame independently, overlooking the temporal continuity inherent in in-situ imaging and failing to capture subtle but critical morphological transitions that underpin particle reshaping, coalescence, and structural evolution. To address these limitations, we present Swin U-Net Transformer with Temporal Convolutional Network for Segmentation (SwinTCN-Seg), a semi-supervised, spatiotemporally-aware framework that fuses transformer-based spatial encoding with temporal modeling to enable reliable analysis of morphological evolution in dynamic nanoparticle systems. Moreover, to reduce the need for dense manual labels, SwinTCN-Seg employs a pseudo-label propagation scheme that utilizes high-confidence predictions from labeled frames to guide learning on unlabeled ones, thereby uncovering transitional configurations. We validate SwinTCN-Seg on a large corpus of in-situ sequences of gold (Au) and platinum (Pt) nanoparticles imaged from 650 °C to 900 °C under vacuum and air environments. Despite being trained on only 5% of the labeled frames, the model achieves high segmentation accuracy, particularly in high-temperature regimes ( ≥ 800 °C) where conventional methods struggle to detect complex phenomena such as faceting, sintering, and fragmentation. Code and models are available at https://github.com/kaur-manpreet325/TEM-Seg .
Förderung
- Materials Research Science and Engineering Center, Harvard University
- National Science Foundation
- Division of Materials Research
- Natural Sciences and Engineering Research Council of Canada
Zitieren
APA
Kaur, M., Ebadi, A., Zhang, X., Liu, H., Chen, C., Stach, E. A., & Liu, Q. (2026). Semi-supervised spatiotemporal segmentation of in situ transmission electron microscopy for nanoparticle dynamics. Materials Today Physics, 61, 102033. https://doi.org/10.1016/j.mtphys.2026.102033
Vancouver
Kaur M, Ebadi A, Zhang X, Liu H, Chen C, Stach EA, et al. Semi-supervised spatiotemporal segmentation of in situ transmission electron microscopy for nanoparticle dynamics. Materials Today Physics. 2026;61:102033. doi:10.1016/j.mtphys.2026.102033
BibTeX
@article{Kaur2026,
author = {Kaur, Manpreet and Ebadi, Ali and Zhang, Xingying and Liu, Huanjing and Chen, Cheng-Yu and Stach, Eric A. and Liu, Qian},
title = {Semi-supervised spatiotemporal segmentation of in situ transmission electron microscopy for nanoparticle dynamics},
journal = {Materials Today Physics},
year = {2026},
volume = {61},
pages = {102033},
doi = {10.1016/j.mtphys.2026.102033}
}
EUVIMED