TY - JOUR
T1 - The Role of Optical Coherence Tomography Criteria and Machine Learning in Multiple Sclerosis and Optic Neuritis Diagnosis
AU - Kenney, Rachel C.
AU - Liu, Mengling
AU - Hasanaj, Lisena
AU - Joseph, Binu
AU - Abu Al-Hassan, Abdullah
AU - Balk, Lisanne J.
AU - Behbehani, Raed
AU - Brandt, Alexander
AU - Calabresi, Peter A.
AU - Frohman, Elliot
AU - Frohman, Teresa C.
AU - Havla, Joachim
AU - Hemmer, Bernhard
AU - Jiang, Hong
AU - Knier, Benjamin
AU - Korn, Thomas
AU - Leocani, Letizia
AU - Martinez-Lapiscina, Elena Hernandez
AU - Papadopoulou, Athina
AU - Paul, Friedemann
AU - Petzold, Axel
AU - Pisa, Marco
AU - Villoslada, Pablo
AU - Zimmermann, Hanna
AU - Thorpe, Lorna E.
AU - Ishikawa, Hiroshi
AU - Schuman, Joel S.
AU - Wollstein, Gadi
AU - Chen, Yu
AU - Saidha, Shiv
AU - Galetta, Steven
AU - Balcer, Laura J.
N1 - Publisher Copyright:
© 2022 American Academy of Neurology.
PY - 2022/9/13
Y1 - 2022/9/13
N2 - Background and ObjectivesRecent studies have suggested that intereye differences (IEDs) in peripapillary retinal nerve fiber layer (pRNFL) or ganglion cell + inner plexiform (GCIPL) thickness by spectral domain optical coherence tomography (SD-OCT) may identify people with a history of unilateral optic neuritis (ON). However, this requires further validation. Machine learning classification may be useful for validating thresholds for OCT IEDs and for examining added utility for visual function tests, such as low-contrast letter acuity (LCLA), in the diagnosis of people with multiple sclerosis (PwMS) and for unilateral ON history.MethodsParticipants were from 11 sites within the International Multiple Sclerosis Visual System consortium. pRNFL and GCIPL thicknesses were measured using SD-OCT. A composite score combining OCT and visual measures was compared individual measurements to determine the best model to distinguish PwMS from controls. These methods were also used to distinguish those with a history of ON among PwMS. Receiver operating characteristic (ROC) curve analysis was performed on a training data set (2/3 of cohort) and then applied to a testing data set (1/3 of cohort). Support vector machine (SVM) analysis was used to assess whether machine learning models improved diagnostic capability of OCT.ResultsAmong 1,568 PwMS and 552 controls, variable selection models identified GCIPL IED, average GCIPL thickness (both eyes), and binocular 2.5% LCLA as most important for classifying PwMS vs controls. This composite score performed best, with area under the curve (AUC) = 0.89 (95% CI 0.85-0.93), sensitivity = 81%, and specificity = 80%. The composite score ROC curve performed better than any of the individual measures from the model (p < 0.0001). GCIPL IED remained the best single discriminator of unilateral ON history among PwMS (AUC = 0.77, 95% CI 0.71-0.83, sensitivity = 68%, specificity = 77%). SVM analysis performed comparably with standard logistic regression models.DiscussionA composite score combining visual structure and function improved the capacity of SD-OCT to distinguish PwMS from controls. GCIPL IED best distinguished those with a history of unilateral ON. SVM performed as well as standard statistical models for these classifications.Classification of EvidenceThis study provides Class III evidence that SD-OCT accurately distinguishes multiple sclerosis from normal controls as compared with clinical criteria.
AB - Background and ObjectivesRecent studies have suggested that intereye differences (IEDs) in peripapillary retinal nerve fiber layer (pRNFL) or ganglion cell + inner plexiform (GCIPL) thickness by spectral domain optical coherence tomography (SD-OCT) may identify people with a history of unilateral optic neuritis (ON). However, this requires further validation. Machine learning classification may be useful for validating thresholds for OCT IEDs and for examining added utility for visual function tests, such as low-contrast letter acuity (LCLA), in the diagnosis of people with multiple sclerosis (PwMS) and for unilateral ON history.MethodsParticipants were from 11 sites within the International Multiple Sclerosis Visual System consortium. pRNFL and GCIPL thicknesses were measured using SD-OCT. A composite score combining OCT and visual measures was compared individual measurements to determine the best model to distinguish PwMS from controls. These methods were also used to distinguish those with a history of ON among PwMS. Receiver operating characteristic (ROC) curve analysis was performed on a training data set (2/3 of cohort) and then applied to a testing data set (1/3 of cohort). Support vector machine (SVM) analysis was used to assess whether machine learning models improved diagnostic capability of OCT.ResultsAmong 1,568 PwMS and 552 controls, variable selection models identified GCIPL IED, average GCIPL thickness (both eyes), and binocular 2.5% LCLA as most important for classifying PwMS vs controls. This composite score performed best, with area under the curve (AUC) = 0.89 (95% CI 0.85-0.93), sensitivity = 81%, and specificity = 80%. The composite score ROC curve performed better than any of the individual measures from the model (p < 0.0001). GCIPL IED remained the best single discriminator of unilateral ON history among PwMS (AUC = 0.77, 95% CI 0.71-0.83, sensitivity = 68%, specificity = 77%). SVM analysis performed comparably with standard logistic regression models.DiscussionA composite score combining visual structure and function improved the capacity of SD-OCT to distinguish PwMS from controls. GCIPL IED best distinguished those with a history of unilateral ON. SVM performed as well as standard statistical models for these classifications.Classification of EvidenceThis study provides Class III evidence that SD-OCT accurately distinguishes multiple sclerosis from normal controls as compared with clinical criteria.
UR - http://www.scopus.com/inward/record.url?scp=85138445098&partnerID=8YFLogxK
U2 - 10.1212/WNL.0000000000200883
DO - 10.1212/WNL.0000000000200883
M3 - Article
C2 - 35764402
AN - SCOPUS:85138445098
SN - 0028-3878
VL - 99
SP - E1100-E1112
JO - Neurology
JF - Neurology
IS - 11
ER -