EUVIMEDEUVIMED entdecken
Crossref

S2P-Matching: Self-Supervised Patch-Based Matching Using Transformer for Capsule Endoscopic Images Stitching

Feng Lu, Dao Zhou, Haoyang Chen, Shuai Liu, Xianliang Ling, Lei Zhu, Tingting Gong, Bin Sheng, Xiaofei Liao, Hai Jin, Ping Li, David Dagan Feng

IEEE Transactions on Biomedical Engineering · 2025-02 · 72 (2) · 540-551

DOI: 10.1109/tbme.2024.3462502 ↗

Kurz gefasst

Fachartikel in der Zeitschrift IEEE Transactions on Biomedical Engineering, 2025-02. Verfasst von Feng Lu und 11 weiteren Autor:innen. Hauptthemen laut MEDLINE: Capsule Endoscopy, Image Interpretation, Computer-Assisted, Supervised Machine Learning. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 47 Literaturangaben. Gefördert von: National Natural Science Foundation of China, Hubei Big Data Analysis Platform and Intelligent Service Project for Medical and Health, Shanghai Municipal Science and Technology.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

The Magnetically Controlled Capsule Endoscopy (MCCE) has a limited shooting range, resulting in capturing numerous fragmented images and an inability to precisely locate and examine the region of interest (ROI) as traditional endoscopy can. Addressing this issue, image stitching around the ROI can be employed to aid in the diagnosis of gastrointestinal (GI) tract conditions. However, MCCE images possess unique characteristics, such as weak texture, close-up shooting, and large angle rotation, presenting challenges to current image-matching methods. In this context, a method named S2P-Matching is proposed for self-supervised patch-based matching in MCCE image stitching. The method involves augmenting the raw data by simulating the capsule endoscopic camera's behavior around the GI tract's ROI. Subsequently, an improved contrast learning encoder is utilized to extract local features, represented as deep feature descriptors. This encoder comprises two branches that extract distinct scale features, which are combined over the channel without manual labeling. The data-driven descriptors are then input into a Transformer model to obtain patch-level matches by learning the globally consented matching priors in the pseudo-ground-truth match pairs. Finally, the patch-level matching is refined and filtered to the pixel-level. The experimental results on real-world MCCE images demonstrate that S2P-Matching provides enhanced accuracy in addressing challenging issues in the GI tract environment with image parallax. The performance improvement can reach up to 203 and 55.8% in terms of NCM (Number of Correct Matches) and SR (Success Rate), respectively. This approach is expected to facilitate the wide adoption of MCCE-based gastrointestinal screening.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Capsule EndoscopyImage Interpretation, Computer-AssistedSupervised Machine LearningHumansAlgorithmsGastrointestinal Tract

Förderung

  • National Natural Science Foundation of China
  • Hubei Big Data Analysis Platform and Intelligent Service Project for Medical and Health
  • Shanghai Municipal Science and Technology
  • Hong Kong Polytechnic University

Zitieren

APA

Lu, F., Zhou, D., Chen, H., Liu, S., Ling, X., Zhu, L., Gong, T., Sheng, B., Liao, X., Jin, H., Li, P., & Feng, D. D. (2025). S2P-Matching: Self-Supervised Patch-Based Matching Using Transformer for Capsule Endoscopic Images Stitching. IEEE Transactions on Biomedical Engineering, 72(2), 540-551. https://doi.org/10.1109/tbme.2024.3462502

Vancouver

Lu F, Zhou D, Chen H, Liu S, Ling X, Zhu L, et al. S2P-Matching: Self-Supervised Patch-Based Matching Using Transformer for Capsule Endoscopic Images Stitching. IEEE Transactions on Biomedical Engineering. 2025;72(2):540-551. doi:10.1109/tbme.2024.3462502

BibTeX
@article{Lu2025,
  author = {Lu, Feng and Zhou, Dao and Chen, Haoyang and Liu, Shuai and Ling, Xianliang and Zhu, Lei and Gong, Tingting and Sheng, Bin and Liao, Xiaofei and Jin, Hai and Li, Ping and Feng, David Dagan},
  title = {S2P-Matching: Self-Supervised Patch-Based Matching Using Transformer for Capsule Endoscopic Images Stitching},
  journal = {IEEE Transactions on Biomedical Engineering},
  year = {2025},
  volume = {72},
  number = {2},
  pages = {540--551},
  doi = {10.1109/tbme.2024.3462502}
}
Kostenlos starten →