TY - JOUR
T1 - Mimicking the human expert
T2 - Pattern recognition for an automated assessment of data quality in MR spectroscopic images
AU - Menze, Bjoern H.
AU - Kelm, B. Michael
AU - Weber, Marc André
AU - Bachert, Peter
AU - Hamprecht, Fred A.
PY - 2008/6
Y1 - 2008/6
N2 - Besides the diagnostic evaluation of a spectrum, the assessment of its quality and a check for plausibility of its information remains a highly interactive and thus time-consuming process in MR spectroscopic imaging (MRSI) data analysis. In the automation of this quality control, a score is proposed that is obtained by training a machine learning classifier on a representative set of spectra that have previously been classified by experts into evaluable data and nonevaluable data. In the first quantitative evaluation of different quality measures on a test set of 45,312 long echo time spectra in the diagnosis of brain tumor, the proposed pattern recognition (using the random forest classifier) separated high- and low-quality spectra comparable to the human operator (area-under-the-curve of the receiver-operator-characteristic, AUC >0.993), and performed better than decision rules based on the signal-to-noise-ratio (AUC <0.934) or the estimated Cramér-Rao-bound on the errors of a spectral fitting (AUC <0.952). This probabilistic assessment of the data quality provides comprehensible confidence images and allows filtering the input of any subsequent data processing, i.e., quantitation or pattern recognition, in an automated fashion. It thus can increase robustness and reliability of the final diagnostic evaluation and allows for the automation of a tedious part of MRSI data analysis.
AB - Besides the diagnostic evaluation of a spectrum, the assessment of its quality and a check for plausibility of its information remains a highly interactive and thus time-consuming process in MR spectroscopic imaging (MRSI) data analysis. In the automation of this quality control, a score is proposed that is obtained by training a machine learning classifier on a representative set of spectra that have previously been classified by experts into evaluable data and nonevaluable data. In the first quantitative evaluation of different quality measures on a test set of 45,312 long echo time spectra in the diagnosis of brain tumor, the proposed pattern recognition (using the random forest classifier) separated high- and low-quality spectra comparable to the human operator (area-under-the-curve of the receiver-operator-characteristic, AUC >0.993), and performed better than decision rules based on the signal-to-noise-ratio (AUC <0.934) or the estimated Cramér-Rao-bound on the errors of a spectral fitting (AUC <0.952). This probabilistic assessment of the data quality provides comprehensible confidence images and allows filtering the input of any subsequent data processing, i.e., quantitation or pattern recognition, in an automated fashion. It thus can increase robustness and reliability of the final diagnostic evaluation and allows for the automation of a tedious part of MRSI data analysis.
KW - Artifact recognition
KW - Automated diagnostic systems
KW - Expert systems
KW - Magnetic resonance spectroscopic imaging
KW - Quality classification
UR - http://www.scopus.com/inward/record.url?scp=44949144064&partnerID=8YFLogxK
U2 - 10.1002/mrm.21519
DO - 10.1002/mrm.21519
M3 - Article
C2 - 18421692
AN - SCOPUS:44949144064
SN - 0740-3194
VL - 59
SP - 1457
EP - 1466
JO - Magnetic Resonance in Medicine
JF - Magnetic Resonance in Medicine
IS - 6
ER -