TY - JOUR
T1 - The OSCAR-MP Consensus Criteria for Quality Assessment of Retinal Optical Coherence Tomography Angiography
AU - IMSVISUAL Consortium
AU - Wicklein, Rebecca
AU - Yam, Charmaine
AU - Noll, Christina
AU - Aly, Lilian
AU - Banze, Nicolas
AU - Romahn, Eva Feodora
AU - Wolf, Elisabeth
AU - Hemmer, Bernhard
AU - Oertel, Frederike C.
AU - Zimmermann, Hanna
AU - Albrecht, Philipp
AU - Ringelstein, Marius
AU - Baumann, Carmen
AU - Feucht, Nikolaus
AU - Penkava, Josef
AU - Havla, Joachim
AU - Gernert, Jonathan A.
AU - Mardin, Christian
AU - Vasileiou, Eleni S.
AU - Van Der Walt, Anneke
AU - Al-Louzi, Omar
AU - Cabello, Sergio
AU - Vidal-Jordana, Angela
AU - Krämer, Julia
AU - Wiendl, Heinz
AU - Preiningerova, Jana Lizrova
AU - Ciccarelli, Olga
AU - Garcia-Martin, Elena
AU - Kana, Veronika
AU - Calabresi, Peter A.
AU - Paul, Friedemann
AU - Saidha, Shiv
AU - Petzold, Axel
AU - Toosy, Ahmed T.
AU - Knier, Benjamin
N1 - Publisher Copyright:
© 2023 The Author(s).
PY - 2023/10/9
Y1 - 2023/10/9
N2 - Background and Objectives Optical coherence tomography angiography (OCTA) is a noninvasive high-resolution imaging technique for assessing the retinal vasculature and is increasingly used in various ophthalmologic, neuro-ophthalmologic, and neurologic diseases. To date, there are no validated consensus criteria for quality control (QC) of OCTA. Our study aimed to develop criteria for OCTA quality assessment. Methods To establish criteria through (1) extensive literature review on OCTA artifacts and image quality to generate standardized and easy-to-apply OCTA QC criteria, (2) application of OCTA QC criteria to evaluate interrater agreement, (3) identification of reasons for interrater disagreement, revision of OCTA QC criteria, development of OCTA QC scoring guide and training set, and (4) validation of QC criteria in an international, interdisciplinary multicenter study. Results We identified 7 major aspects that affect OCTA quality: (O) obvious problems, (S) signal strength, (C) centration, (A) algorithm failure, (R) retinal pathology, (M) motion artifacts, and (P) projection artifacts. Seven independent raters applied the OSCAR-MP criteria to a set of 40 OCTA scans from people with MS, Sjogren syndrome, and uveitis and healthy individuals. The interrater kappa was substantial (κ 0.67). Projection artifacts were the main reason for interrater disagreement. Because artifacts can affect only parts of OCTA images, we agreed that prior definition of a specific region of interest (ROI) is crucial for subsequent OCTA quality assessment. To enhance artifact recognition and interrater agreement on reduced image quality, we designed a scoring guide and OCTA training set. Using these educational tools, 23 raters from 14 different centers reached an almost perfect agreement (κ 0.92) for the rejection of poor-quality OCTA images using the OSCAR-MP criteria. Discussion We propose a 3-step approach for standardized quality control: (1) To define a specific ROI, (2) to assess the occurrence of OCTA artifacts according to the OSCAR-MP criteria, and (3) to evaluate OCTA quality based on the occurrence of different artifacts within the ROI. OSCAR-MP OCTA QC criteria achieved high interrater agreement in an international multicenter study and is a promising QC protocol for application in the context of future clinical trials and studies.
AB - Background and Objectives Optical coherence tomography angiography (OCTA) is a noninvasive high-resolution imaging technique for assessing the retinal vasculature and is increasingly used in various ophthalmologic, neuro-ophthalmologic, and neurologic diseases. To date, there are no validated consensus criteria for quality control (QC) of OCTA. Our study aimed to develop criteria for OCTA quality assessment. Methods To establish criteria through (1) extensive literature review on OCTA artifacts and image quality to generate standardized and easy-to-apply OCTA QC criteria, (2) application of OCTA QC criteria to evaluate interrater agreement, (3) identification of reasons for interrater disagreement, revision of OCTA QC criteria, development of OCTA QC scoring guide and training set, and (4) validation of QC criteria in an international, interdisciplinary multicenter study. Results We identified 7 major aspects that affect OCTA quality: (O) obvious problems, (S) signal strength, (C) centration, (A) algorithm failure, (R) retinal pathology, (M) motion artifacts, and (P) projection artifacts. Seven independent raters applied the OSCAR-MP criteria to a set of 40 OCTA scans from people with MS, Sjogren syndrome, and uveitis and healthy individuals. The interrater kappa was substantial (κ 0.67). Projection artifacts were the main reason for interrater disagreement. Because artifacts can affect only parts of OCTA images, we agreed that prior definition of a specific region of interest (ROI) is crucial for subsequent OCTA quality assessment. To enhance artifact recognition and interrater agreement on reduced image quality, we designed a scoring guide and OCTA training set. Using these educational tools, 23 raters from 14 different centers reached an almost perfect agreement (κ 0.92) for the rejection of poor-quality OCTA images using the OSCAR-MP criteria. Discussion We propose a 3-step approach for standardized quality control: (1) To define a specific ROI, (2) to assess the occurrence of OCTA artifacts according to the OSCAR-MP criteria, and (3) to evaluate OCTA quality based on the occurrence of different artifacts within the ROI. OSCAR-MP OCTA QC criteria achieved high interrater agreement in an international multicenter study and is a promising QC protocol for application in the context of future clinical trials and studies.
UR - https://www.scopus.com/pages/publications/85179340220
U2 - 10.1212/NXI.0000000000200169
DO - 10.1212/NXI.0000000000200169
M3 - Article
C2 - 37813596
AN - SCOPUS:85179340220
SN - 2332-7812
VL - 10
JO - Neurology: Neuroimmunology and NeuroInflammation
JF - Neurology: Neuroimmunology and NeuroInflammation
IS - 6
M1 - e200169
ER -