EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

RGB to hyperspectral: Spectral reconstruction for enhanced surgical imaging

Tobias Czempiel iD, Alfie Roddan, Maria Leiloglou, Zepeng Hu, Kevin O'Neill, Giulio Anichini, Danail Stoyanov, Daniel Elson

Healthcare Technology Letters · 2024-12 · 11 (6) · 307-317

DOI: 10.1049/htl2.12098 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Healthcare Technology Letters, online erschienen am 25.11.2024. Verfasst von Tobias Czempiel und 7 weiteren Autor:innen. Beteiligte Einrichtung: EnAcuity Limited London UK. Die Arbeit wurde bisher 10-mal zitiert (Crossref) und nennt 31 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: Royal Academy of Engineering, Brain Tumour Research.

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study investigates the reconstruction of hyperspectral signatures from RGB data to enhance surgical imaging, utilizing the publicly available HeiPorSPECTRAL dataset from porcine surgery and an in‐house neurosurgery dataset. Various architectures based on convolutional neural networks (CNNs) and transformer models are evaluated using comprehensive metrics. Transformer models exhibit superior performance in terms of RMSE, SAM, PSNR and SSIM by effectively integrating spatial information to predict accurate spectral profiles, encompassing both visible and extended spectral ranges. Qualitative assessments demonstrate the capability to predict spectral profiles critical for informed surgical decision‐making during procedures. Challenges associated with capturing both the visible and extended hyperspectral ranges are highlighted using the MAE, emphasizing the complexities involved. The findings open up the new research direction of hyperspectral reconstruction for surgical applications and clinical use cases in real‐time surgical environments.

Schlagwörter

Stichwörter der Autor:innen

computer visionmedical image processingsignal reconstruction

Autor:innen und Institutionen

  • EnAcuity Limited London UK.
  • Hamlyn Centre for Robotic Surgery Department of Surgery and Cancer Imperial College London London UK.
  • Wellcome/EPSRC Centre for Interventional and Surgical Sciences (WEISS) and Department of Computer Science University College London London UK.
  • Department of Surgery and Cancer Healthcare NHS Trust Imperial College London London UK.

ORCID-Profile: Tobias Czempiel

Förderung

  • Royal Academy of Engineering
  • Brain Tumour Research

Zitieren

APA

Czempiel, T., Roddan, A., Leiloglou, M., Hu, Z., O'Neill, K., Anichini, G., Stoyanov, D., & Elson, D. (2024). RGB to hyperspectral: Spectral reconstruction for enhanced surgical imaging. Healthcare Technology Letters, 11(6), 307-317. https://doi.org/10.1049/htl2.12098

Vancouver

Czempiel T, Roddan A, Leiloglou M, Hu Z, O'Neill K, Anichini G, et al. RGB to hyperspectral: Spectral reconstruction for enhanced surgical imaging. Healthcare Technology Letters. 2024;11(6):307-317. doi:10.1049/htl2.12098

BibTeX
@article{Czempiel2024,
  author = {Czempiel, Tobias and Roddan, Alfie and Leiloglou, Maria and Hu, Zepeng and O'Neill, Kevin and Anichini, Giulio and Stoyanov, Danail and Elson, Daniel},
  title = {RGB to hyperspectral: Spectral reconstruction for enhanced surgical imaging},
  journal = {Healthcare Technology Letters},
  year = {2024},
  volume = {11},
  number = {6},
  pages = {307--317},
  doi = {10.1049/htl2.12098}
}
Kostenlos starten →