Interobserver agreement for the standardized reporting system PSMA-RADS 1.0 on18F-DCFPYL PET/CT imaging

Rudolf A. Werner, Ralph A. Bundschuh, Lena Bundschuh, Mehrbod S. Javadi, Jeffrey P. Leal, Takahiro Higuchi, Kenneth J. Pienta, Andreas K. Buck, Martin G. Pomper, Michael A. Gorin, Constantin Lapa, Steven P. Rowe

Research output: Contribution to journalArticle

8 Citations (Scopus)

Abstract

Recently, the standardized reporting and data system for prostate-specific membrane antigen (PSMA)–targeted PET imaging studies, termed PSMA-RADS version 1.0, was introduced. We aimed to determine the interobserver agreement for applying PSMA-RADS to imaging interpretation of18F-DCFPyL (2-(3-{1-carboxy-5-[(6-18F-flu-oro-pyridine-3-carbonyl)-amino]-pentyl}-ureido)-pentanedioic acid) PET examinations in a prospective setting mimicking the typical clinical workflow at a prostate cancer referral center. Methods: Four readers (2 experienced readers (ERs, .3 y of PSMA-targeted PET interpretation experience) and 2 inexperienced readers (IRs,,1 y of experience)), who had all read the initial publication on PSMA-RADS 1.0, assessed 5018F-DCFPyL PET/CT studies independently. Per scan, a maximum of 5 target lesions was selected by the observers, and a PSMA-RADS score for every target lesion was recorded. No specific preexisting conditions were placed on the selection of the target lesions, although PSMA-RADS 1.0 suggests that readers focus on the most avid or largest lesions. An overall scan impression based on PSMA-RADS was indicated, and interobserver agreement rates on a target lesion–based, on an organ-based, and on an overall PSMA-RADS score–based level were computed. Results: The number of target lesions identified by each observer was as follows: ER 1, 123; ER 2, 134; IR 1, 123; and IR 2, 120. Among those selected target lesions, 125 were chosen by at least 2 individual observers (all 4 readers selected the same target lesion in 58 of 125 [46.4%] instances, 3 readers in 40 of 125 [32%], and 2 observers in 27 of 125 [21.6%]). The interobserver agreement for PSMA-RADS scoring among identical target lesions was good (intraclass correlation coefficient [ICC] for 4, 3, and 2 identical target lesions, $0.60, respectively). For lymph nodes, an excellent interobserver agreement was derived (ICC, 0.79). The interobserver agreement for an overall scan impression based on PSMA-RADS was also excellent (ICC, 0.84), with a significant difference for ER (ICC, 0.97) vs. IR (ICC, 0.74) (P 5 0.005). Conclusion: PSMA-RADS demonstrated a high concordance rate in this study, even among readers with different levels of experience. This finding suggests that PSMA-RADS can be effectively used for communication with clinicians and can be implemented in the collection of data for large prospective trials.

Original languageEnglish
Pages (from-to)1857-1864
Number of pages8
JournalJournal of Nuclear Medicine
Volume59
Issue number12
DOIs
Publication statusPublished - Dec 1 2018
Externally publishedYes

Fingerprint

human glutamate carboxypeptidase II
Preexisting Condition Coverage
Workflow
Information Systems
Publications
Prostatic Neoplasms
Referral and Consultation
Lymph Nodes
Acids
pyridine

Keywords

  • F-DCFPyL
  • Interobserver
  • Interreader
  • Prostate cancer
  • PSMA
  • PSMA-RADS

ASJC Scopus subject areas

  • Radiology Nuclear Medicine and imaging

Cite this

Werner, R. A., Bundschuh, R. A., Bundschuh, L., Javadi, M. S., Leal, J. P., Higuchi, T., ... Rowe, S. P. (2018). Interobserver agreement for the standardized reporting system PSMA-RADS 1.0 on18F-DCFPYL PET/CT imaging. Journal of Nuclear Medicine, 59(12), 1857-1864. https://doi.org/10.2967/jnumed.118.217588

Interobserver agreement for the standardized reporting system PSMA-RADS 1.0 on18F-DCFPYL PET/CT imaging. / Werner, Rudolf A.; Bundschuh, Ralph A.; Bundschuh, Lena; Javadi, Mehrbod S.; Leal, Jeffrey P.; Higuchi, Takahiro; Pienta, Kenneth J.; Buck, Andreas K.; Pomper, Martin G.; Gorin, Michael A.; Lapa, Constantin; Rowe, Steven P.

In: Journal of Nuclear Medicine, Vol. 59, No. 12, 01.12.2018, p. 1857-1864.

Research output: Contribution to journalArticle

Werner, RA, Bundschuh, RA, Bundschuh, L, Javadi, MS, Leal, JP, Higuchi, T, Pienta, KJ, Buck, AK, Pomper, MG, Gorin, MA, Lapa, C & Rowe, SP 2018, 'Interobserver agreement for the standardized reporting system PSMA-RADS 1.0 on18F-DCFPYL PET/CT imaging', Journal of Nuclear Medicine, vol. 59, no. 12, pp. 1857-1864. https://doi.org/10.2967/jnumed.118.217588
Werner, Rudolf A. ; Bundschuh, Ralph A. ; Bundschuh, Lena ; Javadi, Mehrbod S. ; Leal, Jeffrey P. ; Higuchi, Takahiro ; Pienta, Kenneth J. ; Buck, Andreas K. ; Pomper, Martin G. ; Gorin, Michael A. ; Lapa, Constantin ; Rowe, Steven P. / Interobserver agreement for the standardized reporting system PSMA-RADS 1.0 on18F-DCFPYL PET/CT imaging. In: Journal of Nuclear Medicine. 2018 ; Vol. 59, No. 12. pp. 1857-1864.
@article{ff55467198614f4db61c3756b8ca77e2,
title = "Interobserver agreement for the standardized reporting system PSMA-RADS 1.0 on18F-DCFPYL PET/CT imaging",
abstract = "Recently, the standardized reporting and data system for prostate-specific membrane antigen (PSMA)–targeted PET imaging studies, termed PSMA-RADS version 1.0, was introduced. We aimed to determine the interobserver agreement for applying PSMA-RADS to imaging interpretation of18F-DCFPyL (2-(3-{1-carboxy-5-[(6-18F-flu-oro-pyridine-3-carbonyl)-amino]-pentyl}-ureido)-pentanedioic acid) PET examinations in a prospective setting mimicking the typical clinical workflow at a prostate cancer referral center. Methods: Four readers (2 experienced readers (ERs, .3 y of PSMA-targeted PET interpretation experience) and 2 inexperienced readers (IRs,,1 y of experience)), who had all read the initial publication on PSMA-RADS 1.0, assessed 5018F-DCFPyL PET/CT studies independently. Per scan, a maximum of 5 target lesions was selected by the observers, and a PSMA-RADS score for every target lesion was recorded. No specific preexisting conditions were placed on the selection of the target lesions, although PSMA-RADS 1.0 suggests that readers focus on the most avid or largest lesions. An overall scan impression based on PSMA-RADS was indicated, and interobserver agreement rates on a target lesion–based, on an organ-based, and on an overall PSMA-RADS score–based level were computed. Results: The number of target lesions identified by each observer was as follows: ER 1, 123; ER 2, 134; IR 1, 123; and IR 2, 120. Among those selected target lesions, 125 were chosen by at least 2 individual observers (all 4 readers selected the same target lesion in 58 of 125 [46.4{\%}] instances, 3 readers in 40 of 125 [32{\%}], and 2 observers in 27 of 125 [21.6{\%}]). The interobserver agreement for PSMA-RADS scoring among identical target lesions was good (intraclass correlation coefficient [ICC] for 4, 3, and 2 identical target lesions, $0.60, respectively). For lymph nodes, an excellent interobserver agreement was derived (ICC, 0.79). The interobserver agreement for an overall scan impression based on PSMA-RADS was also excellent (ICC, 0.84), with a significant difference for ER (ICC, 0.97) vs. IR (ICC, 0.74) (P 5 0.005). Conclusion: PSMA-RADS demonstrated a high concordance rate in this study, even among readers with different levels of experience. This finding suggests that PSMA-RADS can be effectively used for communication with clinicians and can be implemented in the collection of data for large prospective trials.",
keywords = "F-DCFPyL, Interobserver, Interreader, Prostate cancer, PSMA, PSMA-RADS",
author = "Werner, {Rudolf A.} and Bundschuh, {Ralph A.} and Lena Bundschuh and Javadi, {Mehrbod S.} and Leal, {Jeffrey P.} and Takahiro Higuchi and Pienta, {Kenneth J.} and Buck, {Andreas K.} and Pomper, {Martin G.} and Gorin, {Michael A.} and Constantin Lapa and Rowe, {Steven P.}",
year = "2018",
month = "12",
day = "1",
doi = "10.2967/jnumed.118.217588",
language = "English",
volume = "59",
pages = "1857--1864",
journal = "Journal of Nuclear Medicine",
issn = "0161-5505",
publisher = "Society of Nuclear Medicine Inc.",
number = "12",

}

TY - JOUR

T1 - Interobserver agreement for the standardized reporting system PSMA-RADS 1.0 on18F-DCFPYL PET/CT imaging

AU - Werner, Rudolf A.

AU - Bundschuh, Ralph A.

AU - Bundschuh, Lena

AU - Javadi, Mehrbod S.

AU - Leal, Jeffrey P.

AU - Higuchi, Takahiro

AU - Pienta, Kenneth J.

AU - Buck, Andreas K.

AU - Pomper, Martin G.

AU - Gorin, Michael A.

AU - Lapa, Constantin

AU - Rowe, Steven P.

PY - 2018/12/1

Y1 - 2018/12/1

N2 - Recently, the standardized reporting and data system for prostate-specific membrane antigen (PSMA)–targeted PET imaging studies, termed PSMA-RADS version 1.0, was introduced. We aimed to determine the interobserver agreement for applying PSMA-RADS to imaging interpretation of18F-DCFPyL (2-(3-{1-carboxy-5-[(6-18F-flu-oro-pyridine-3-carbonyl)-amino]-pentyl}-ureido)-pentanedioic acid) PET examinations in a prospective setting mimicking the typical clinical workflow at a prostate cancer referral center. Methods: Four readers (2 experienced readers (ERs, .3 y of PSMA-targeted PET interpretation experience) and 2 inexperienced readers (IRs,,1 y of experience)), who had all read the initial publication on PSMA-RADS 1.0, assessed 5018F-DCFPyL PET/CT studies independently. Per scan, a maximum of 5 target lesions was selected by the observers, and a PSMA-RADS score for every target lesion was recorded. No specific preexisting conditions were placed on the selection of the target lesions, although PSMA-RADS 1.0 suggests that readers focus on the most avid or largest lesions. An overall scan impression based on PSMA-RADS was indicated, and interobserver agreement rates on a target lesion–based, on an organ-based, and on an overall PSMA-RADS score–based level were computed. Results: The number of target lesions identified by each observer was as follows: ER 1, 123; ER 2, 134; IR 1, 123; and IR 2, 120. Among those selected target lesions, 125 were chosen by at least 2 individual observers (all 4 readers selected the same target lesion in 58 of 125 [46.4%] instances, 3 readers in 40 of 125 [32%], and 2 observers in 27 of 125 [21.6%]). The interobserver agreement for PSMA-RADS scoring among identical target lesions was good (intraclass correlation coefficient [ICC] for 4, 3, and 2 identical target lesions, $0.60, respectively). For lymph nodes, an excellent interobserver agreement was derived (ICC, 0.79). The interobserver agreement for an overall scan impression based on PSMA-RADS was also excellent (ICC, 0.84), with a significant difference for ER (ICC, 0.97) vs. IR (ICC, 0.74) (P 5 0.005). Conclusion: PSMA-RADS demonstrated a high concordance rate in this study, even among readers with different levels of experience. This finding suggests that PSMA-RADS can be effectively used for communication with clinicians and can be implemented in the collection of data for large prospective trials.

AB - Recently, the standardized reporting and data system for prostate-specific membrane antigen (PSMA)–targeted PET imaging studies, termed PSMA-RADS version 1.0, was introduced. We aimed to determine the interobserver agreement for applying PSMA-RADS to imaging interpretation of18F-DCFPyL (2-(3-{1-carboxy-5-[(6-18F-flu-oro-pyridine-3-carbonyl)-amino]-pentyl}-ureido)-pentanedioic acid) PET examinations in a prospective setting mimicking the typical clinical workflow at a prostate cancer referral center. Methods: Four readers (2 experienced readers (ERs, .3 y of PSMA-targeted PET interpretation experience) and 2 inexperienced readers (IRs,,1 y of experience)), who had all read the initial publication on PSMA-RADS 1.0, assessed 5018F-DCFPyL PET/CT studies independently. Per scan, a maximum of 5 target lesions was selected by the observers, and a PSMA-RADS score for every target lesion was recorded. No specific preexisting conditions were placed on the selection of the target lesions, although PSMA-RADS 1.0 suggests that readers focus on the most avid or largest lesions. An overall scan impression based on PSMA-RADS was indicated, and interobserver agreement rates on a target lesion–based, on an organ-based, and on an overall PSMA-RADS score–based level were computed. Results: The number of target lesions identified by each observer was as follows: ER 1, 123; ER 2, 134; IR 1, 123; and IR 2, 120. Among those selected target lesions, 125 were chosen by at least 2 individual observers (all 4 readers selected the same target lesion in 58 of 125 [46.4%] instances, 3 readers in 40 of 125 [32%], and 2 observers in 27 of 125 [21.6%]). The interobserver agreement for PSMA-RADS scoring among identical target lesions was good (intraclass correlation coefficient [ICC] for 4, 3, and 2 identical target lesions, $0.60, respectively). For lymph nodes, an excellent interobserver agreement was derived (ICC, 0.79). The interobserver agreement for an overall scan impression based on PSMA-RADS was also excellent (ICC, 0.84), with a significant difference for ER (ICC, 0.97) vs. IR (ICC, 0.74) (P 5 0.005). Conclusion: PSMA-RADS demonstrated a high concordance rate in this study, even among readers with different levels of experience. This finding suggests that PSMA-RADS can be effectively used for communication with clinicians and can be implemented in the collection of data for large prospective trials.

KW - F-DCFPyL

KW - Interobserver

KW - Interreader

KW - Prostate cancer

KW - PSMA

KW - PSMA-RADS

UR - http://www.scopus.com/inward/record.url?scp=85057580761&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057580761&partnerID=8YFLogxK

U2 - 10.2967/jnumed.118.217588

DO - 10.2967/jnumed.118.217588

M3 - Article

C2 - 30190304

AN - SCOPUS:85057580761

VL - 59

SP - 1857

EP - 1864

JO - Journal of Nuclear Medicine

JF - Journal of Nuclear Medicine

SN - 0161-5505

IS - 12

ER -