EUVIMEDEUVIMED entdecken
Open Access · CC BY 4.0

Retrospective validation of MetaSystems’ deep-learning-based digital microscopy platform with assistance compared to manual fluorescence microscopy for detection of mycobacteria

Claudine Desruisseaux, Conor Broderick, Valéry Lavergne, Kim Sy, Duang-Jai Garcia, Gaurav Barot, Kerstin Locher iD, Charlene Porter, Mélissa Caza, Marthe K Charles iD

Journal of Clinical Microbiology · 2024

DOI: 10.1128/jcm.01069-23 ↗

Kurz gefasst

Fachartikel in der Zeitschrift Journal of Clinical Microbiology, 2024. Verfasst von Claudine Desruisseaux und 9 weiteren Autor:innen. Beteiligte Einrichtung: Division of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coasta…. Hauptthemen laut MEDLINE: Deep Learning, Mycobacterium, Tuberculosis, Mycobacterium tuberculosis. Die Arbeit wurde bisher 17-mal zitiert (Crossref) und nennt 35 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0).

AbstractSchlagwörterBibliografische AngabenZitierenVerwandte Studien

Abstract (Originalsprache)

This study aimed to validate Metasystems’ automated acid-fast bacilli (AFB) smear microscopy scanning and deep-learning-based image analysis module (Neon Metafer) with assistance on respiratory and pleural samples, compared to conventional manual fluorescence microscopy (MM). Analytical parameters were assessed first, followed by a retrospective validation study. In all, 320 archived auramine-O-stained slides selected non-consecutively [85 originally reported as AFB-smear-positive, 235 AFB-smear-negative slides; with an overall mycobacterial culture positivity rate of 24.1% (77/320)] underwent whole-slide imaging and were analyzed by the Metafer Neon AFB Module (version 4.3.130) using a predetermined probability threshold (PT) for AFB detection of 96%. Digital slides were then examined by a trained reviewer blinded to previous AFB smear and culture results, for the final interpretation of assisted digital microscopy (a-DM). Paired results from both microscopic methods were compared to mycobacterial culture. A scanning failure rate of 10.6% (34/320) was observed, leaving 286 slides for analysis. After discrepant analysis, concordance, positive and negative agreements were 95.5% (95%CI, 92.4%–97.6%), 96.2% (95%CI, 89.2%–99.2%), and 95.2% (95%CI, 91.3%–97.7%), respectively. Using mycobacterial culture as reference standard, a-DM and MM had comparable sensitivities: 90.7% (95%CI, 81.7%–96.2%) versus 92.0% (95%CI, 83.4%–97.0%) ( P -value = 1.00); while their specificities differed 91.9% (95%CI, 87.4%–95.2%) versus 95.7% (95%CI, 92.1%–98.0%), respectively ( P -value = 0.03). Using a PT of 96%, MetaSystems’ platform shows acceptable performance. With a national laboratory staff shortage and a local low mycobacterial infection rate, this instrument when combined with culture, can reliably triage-negative AFB-smear respiratory slides and identify positive slides requiring manual confirmation and semi-quantification. IMPORTANCE This manuscript presents a full validation of MetaSystems’ automated acid-fast bacilli (AFB) smear microscopy scanning and deep-learning-based image analysis module using a probability threshold of 96% including accuracy, precision studies, and evaluation of limit of AFB detection on respiratory samples when the technology is used with assistance. This study is complementary to the conversation started by Tomasello et al. on the use of image analysis artificial intelligence software in routine mycobacterial diagnostic activities within the context of high-throughput laboratories with low incidence of tuberculosis.

Schlagwörter

MeSH-Schlagwörter (MEDLINE)

Deep LearningMycobacteriumTuberculosisMycobacterium tuberculosisHumansRetrospective StudiesArtificial IntelligenceNeonMicroscopy, FluorescenceSputum

Stichwörter der Autor:innen

AFB fluorescence microscopyacid-fast bacilliartificial intelligenceautomated digital microscopyclinical validationdeep learningdeep neural networkmycobacteria

Substanzen

Neon

Autor:innen und Institutionen

  • Division of Medical Microbiology and Infection Control, Department of Pathology and Laboratory Medicine, Vancouver General Hospital, Vancouver Coastal Health, Vancouver, British Columbia, Canada.
  • Faculty of Medicine, Department of Pathology and Laboratory Medicine, The University of British Columbia, Vancouver, British Columbia, Canada.

ORCID-Profile: Kerstin Locher, Marthe K Charles

Zitieren

APA

Desruisseaux, C., Broderick, C., Lavergne, V., Sy, K., Garcia, D. J., Barot, G., Locher, K., Porter, C., Caza, M., & Charles, M. K. (2024). Retrospective validation of MetaSystems’ deep-learning-based digital microscopy platform with assistance compared to manual fluorescence microscopy for detection of mycobacteria. Journal of Clinical Microbiology. https://doi.org/10.1128/jcm.01069-23

Vancouver

Desruisseaux C, Broderick C, Lavergne V, Sy K, Garcia DJ, Barot G, et al. Retrospective validation of MetaSystems’ deep-learning-based digital microscopy platform with assistance compared to manual fluorescence microscopy for detection of mycobacteria. Journal of Clinical Microbiology. 2024. doi:10.1128/jcm.01069-23

BibTeX
@article{Desruisseaux2024,
  author = {Desruisseaux, Claudine and Broderick, Conor and Lavergne, Valéry and Sy, Kim and Garcia, Duang-Jai and Barot, Gaurav and Locher, Kerstin and Porter, Charlene and Caza, Mélissa and Charles, Marthe K},
  title = {Retrospective validation of MetaSystems’ deep-learning-based digital microscopy platform with assistance compared to manual fluorescence microscopy for detection of mycobacteria},
  journal = {Journal of Clinical Microbiology},
  year = {2024},
  doi = {10.1128/jcm.01069-23}
}
Kostenlos starten →