TY - JOUR
T1 - Accelerated MRI with Un-Trained Neural Networks
AU - Zalbagi Darestani, Mohammad
AU - Heckel, Reinhard
N1 - Publisher Copyright:
© 2015 IEEE.
PY - 2021
Y1 - 2021
N2 - Convolutional Neural Networks (CNNs) are highly effective for image reconstruction problems. Typically, CNNs are trained on large amounts of training images. Recently, however, un-trained CNNs such as the Deep Image Prior and Deep Decoder have achieved excellent performance for image reconstruction problems such as denoising and inpainting, without using any training data - except leveraging a few samples for hyper-parameter tuning. Motivated by this development, we address the reconstruction problem arising in accelerated MRI with un-trained neural networks. We propose a highly optimized un-trained recovery approach based on a variation of the Deep Decoder and show that it significantly outperforms other un-trained methods, in particular sparsity-based classical compressed sensing methods and naive applications of un-trained neural networks in terms of reconstruction performance. We also compare performance (both in terms of reconstruction accuracy and computational cost) in an ideal setup for trained methods, specifically on the fastMRI dataset, where the training and test data come from the same distribution. Here, we find that our un-trained algorithm achieves similar performance to a baseline trained neural network, but a state-of-the-art trained network outperforms the un-trained one. Finally, we perform a comparison on a non-ideal setup where the train and test distributions are slightly different, and find that our un-trained method achieves similar performance to a state-of-the-art accelerated MRI reconstruction method.
AB - Convolutional Neural Networks (CNNs) are highly effective for image reconstruction problems. Typically, CNNs are trained on large amounts of training images. Recently, however, un-trained CNNs such as the Deep Image Prior and Deep Decoder have achieved excellent performance for image reconstruction problems such as denoising and inpainting, without using any training data - except leveraging a few samples for hyper-parameter tuning. Motivated by this development, we address the reconstruction problem arising in accelerated MRI with un-trained neural networks. We propose a highly optimized un-trained recovery approach based on a variation of the Deep Decoder and show that it significantly outperforms other un-trained methods, in particular sparsity-based classical compressed sensing methods and naive applications of un-trained neural networks in terms of reconstruction performance. We also compare performance (both in terms of reconstruction accuracy and computational cost) in an ideal setup for trained methods, specifically on the fastMRI dataset, where the training and test data come from the same distribution. Here, we find that our un-trained algorithm achieves similar performance to a baseline trained neural network, but a state-of-the-art trained network outperforms the un-trained one. Finally, we perform a comparison on a non-ideal setup where the train and test distributions are slightly different, and find that our un-trained method achieves similar performance to a state-of-the-art accelerated MRI reconstruction method.
KW - Accelerated MRI reconstruction
KW - compressed sensing
KW - deep learning
KW - un-trained neural networks
UR - http://www.scopus.com/inward/record.url?scp=85110932089&partnerID=8YFLogxK
U2 - 10.1109/TCI.2021.3097596
DO - 10.1109/TCI.2021.3097596
M3 - Article
AN - SCOPUS:85110932089
SN - 2573-0436
VL - 7
SP - 724
EP - 733
JO - IEEE Transactions on Computational Imaging
JF - IEEE Transactions on Computational Imaging
M1 - 9488215
ER -