Interrater agreement and variability in visual reading of [18F] flutemetamol PET images
Annals of Nuclear Medicine · 2025
DOI: 10.1007/s12149-024-01977-7 ↗Kurz gefasst
Fachartikel in der Zeitschrift Annals of Nuclear Medicine, 2025. Verfasst von Akinori Takenaka und 15 weiteren Autor:innen. Beteiligte Einrichtung: Department of Radiology, Fujita Health University School of Medicine, Toyoake, Japan. Hauptthemen laut MEDLINE: Positron-Emission Tomography, Observer Variation, Aniline Compounds, Benzothiazoles. Die Arbeit wurde bisher 12-mal zitiert (Crossref) und nennt 32 Literaturangaben. Der Volltext ist frei zugänglich (Open Access, CC BY 4.0). Gefördert von: AMED, National Center for Geriatrics and Gerontology.
Abstract (Originalsprache)
Objective
The purpose of this study was to validate the concordance of visual ratings of [18F] flutemetamol amyloid positron emission tomography (PET) images and to investigate the correlation between the agreement of each rater and the Centiloid (CL) scale.
Methods
A total of 192 participants, clinically classified as cognitively normal (CN) ( n = 59), mild cognitive impairment (MCI) ( n = 65), Alzheimer’s disease (AD) ( n = 55), or non-AD dementia ( n = 13), participated in this study. Three experts conducted visual ratings of the amyloid PET images for all 192 patients, assigning a confidence level to each rating on a three-point scale (certain, probable, or neither). The positive or negative determination of amyloid PET results was made by majority vote. The CL value was calculated using the CapAIBL pipeline.
Results
Overall, 101 images were determined to be positive, and 91 images were negative. Of the 101 positive images, the three raters were in complete agreement for 92 images and in disagreement for 9 images. Of the 91 negative images, the three raters were in complete agreement for 75 images and in disagreement for 16 images. Interrater reliability among the three experts was particularly high, with both Fleiss’ kappa and Conger’s kappa measuring 0.83 (0.76–0.89). The CL values of the unanimous positive group were significantly greater than those of the other groups, whereas the CL values of the unanimous negative group were significantly lower than those of the other groups. Images with rater disagreement had intermediate CLs. In cases with a high confidence level, the positive or negative visual ratings were in almost complete agreement. However, as confidence levels decreased, experts’ visual ratings became more variable. The lower the confidence level was, the greater the number of cases with disagreement in the visual ratings.
Conclusion
Three experts independently rated 192 amyloid PET images, achieving a high level of interrater agreement. However, in patients with intermediate amyloid accumulation, visual ratings varied. Therefore, determining positive and negative decisions in these patients should be performed with caution.
Schlagwörter
MeSH-Schlagwörter (MEDLINE)
Stichwörter der Autor:innen
Substanzen
Autor:innen und Institutionen
- Department of Radiology, Fujita Health University School of Medicine, Toyoake, Japan.
- Department of Radiology, National Center for Geriatrics and Gerontology, Obu, Japan.
- Micron Inc. Imaging Service Dept., Tokyo, Japan.
- Department of Radiology, Anjo Kosei Hospital, Anjo, Japan.
- Department of Neurology, National Center for Geriatrics and Gerontology, Obu, Japan.
- Department of Radiology, Faculty of Medicine, Kindai University, Osakasayama, Japan.
Förderung
- AMED
- National Center for Geriatrics and Gerontology
Zitieren
APA
Takenaka, A., Nihashi, T., Sakurai, K., Notomi, K., Ono, H., Inui, Y., Ito, S., Arahata, Y., Takeda, A., Ishii, K., Ishii, K., Ito, K., Toyama, H., Nakamura, A., Kato, T., & BATON Study Group (2025). Interrater agreement and variability in visual reading of [18F] flutemetamol PET images. Annals of Nuclear Medicine. https://doi.org/10.1007/s12149-024-01977-7
Vancouver
Takenaka A, Nihashi T, Sakurai K, Notomi K, Ono H, Inui Y, et al. Interrater agreement and variability in visual reading of [18F] flutemetamol PET images. Annals of Nuclear Medicine. 2025. doi:10.1007/s12149-024-01977-7
BibTeX
@article{Takenaka2025,
author = {Takenaka, Akinori and Nihashi, Takashi and Sakurai, Keita and Notomi, Keiji and Ono, Hokuto and Inui, Yoshitaka and Ito, Shinji and Arahata, Yutaka and Takeda, Akinori and Ishii, Kazunari and Ishii, Kenji and Ito, Kengo and Toyama, Hiroshi and Nakamura, Akinori and Kato, Takashi and BATON Study Group, BATON Study Group},
title = {Interrater agreement and variability in visual reading of [18F] flutemetamol PET images},
journal = {Annals of Nuclear Medicine},
year = {2025},
doi = {10.1007/s12149-024-01977-7}
}
EUVIMED