S2P-Matching: Self-Supervised Patch-Based Matching Using Transformer for Capsule Endoscopic Images Stitching
IEEE Transactions on Biomedical Engineering · 2025-02 · 72 (2) · 540-551
DOI: 10.1109/tbme.2024.3462502 ↗Kurz gefasst
Fachartikel in der Zeitschrift IEEE Transactions on Biomedical Engineering, 2025-02. Verfasst von Feng Lu und 11 weiteren Autor:innen. Hauptthemen laut MEDLINE: Capsule Endoscopy, Image Interpretation, Computer-Assisted, Supervised Machine Learning. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Hubei Big Data Analysis Platform and Intelligent Service Project for Medical and Health, Shanghai Municipal Science and Technology.
Abstract (Originalsprache)
The Magnetically Controlled Capsule Endoscopy (MCCE) has a limited shooting range, resulting in capturing numerous fragmented images and an inability to precisely locate and examine the region of interest (ROI) as traditional endoscopy can. Addressing this issue, image stitching around the ROI can be employed to aid in the diagnosis of gastrointestinal (GI) tract conditions. However, MCCE images possess unique characteristics, such as weak texture, close-up shooting, and large angle rotation, presenting challenges to current image-matching methods. In this context, a method named S2P-Matching is proposed for self-supervised patch-based matching in MCCE image stitching. The method involves augmenting the raw data by simulating the capsule endoscopic camera's behavior around the GI tract's ROI. Subsequently, an improved contrast learning encoder is utilized to extract local features, represented as deep feature descriptors. This encoder comprises two branches that extract distinct scale features, which are combined over the channel without manual labeling. The data-driven descriptors are then input into a Transformer model to obtain patch-level matches by learning the globally consented matching priors in the pseudo-ground-truth match pairs. Finally, the patch-level matching is refined and filtered to the pixel-level. The experimental results on real-world MCCE images demonstrate that S2P-Matching provides enhanced accuracy in addressing challenging issues in the GI tract environment with image parallax. The performance improvement can reach up to 203 and 55.8% in terms of NCM (Number of Correct Matches) and SR (Success Rate), respectively. This approach is expected to facilitate the wide adoption of MCCE-based gastrointestinal screening.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Förderung
- National Natural Science Foundation of China
- Hubei Big Data Analysis Platform and Intelligent Service Project for Medical and Health
- Shanghai Municipal Science and Technology
- Hong Kong Polytechnic University
Zitieren
APA
Lu, F., Zhou, D., Chen, H., Liu, S., Ling, X., Zhu, L., Gong, T., Sheng, B., Liao, X., Jin, H., Li, P., & Feng, D. D. (2025). S2P-Matching: Self-Supervised Patch-Based Matching Using Transformer for Capsule Endoscopic Images Stitching. IEEE Transactions on Biomedical Engineering, 72(2), 540-551. https://doi.org/10.1109/tbme.2024.3462502
Vancouver
Lu F, Zhou D, Chen H, Liu S, Ling X, Zhu L, et al. S2P-Matching: Self-Supervised Patch-Based Matching Using Transformer for Capsule Endoscopic Images Stitching. IEEE Transactions on Biomedical Engineering. 2025;72(2):540-551. doi:10.1109/tbme.2024.3462502
BibTeX
@article{Lu2025,
author = {Lu, Feng and Zhou, Dao and Chen, Haoyang and Liu, Shuai and Ling, Xianliang and Zhu, Lei and Gong, Tingting and Sheng, Bin and Liao, Xiaofei and Jin, Hai and Li, Ping and Feng, David Dagan},
title = {S2P-Matching: Self-Supervised Patch-Based Matching Using Transformer for Capsule Endoscopic Images Stitching},
journal = {IEEE Transactions on Biomedical Engineering},
year = {2025},
volume = {72},
number = {2},
pages = {540--551},
doi = {10.1109/tbme.2024.3462502}
}
EUVIMED