TY - GEN
T1 - Improving Robustness of Single Image Super-Resolution Models with Monte Carlo Method
AU - Yang, Cuixin
AU - Xiao, Jun
AU - Ju, Ya Kun
AU - Qiu, Guoping
AU - Lam, Kin Man
N1 - Publisher Copyright:
© 2023 IEEE.
PY - 2023/9/11
Y1 - 2023/9/11
N2 - Deep learning-based methods have achieved promising results in single image super-resolution (SISR). However, the performance of existing deep SISR methods is very sensitive to image degradation. In addition, these methods are deterministic and do not introduce any uncertainty to the generated images, so we have no way of knowing the reliability of these generated images. To address these two challenging issues, we propose a model-agnostic approach for existing deep SISR networks to improve their robustness under various degradations. Our proposed method follows a probabilistic framework and applies Monte Carlo dropout to existing deep SISR methods. Instead of performing point estimation, the proposed method predicts the posterior distribution of super-resolved images. Based on this, we can determine the uncertainty of the generated images. Experiment results show that the proposed method can effectively improve the robustness of existing deep SISR methods, leading to state-of-the-art performance when applied to images having different degradations. The code is available at https://github.com/YangTracy/MCD-SR.
AB - Deep learning-based methods have achieved promising results in single image super-resolution (SISR). However, the performance of existing deep SISR methods is very sensitive to image degradation. In addition, these methods are deterministic and do not introduce any uncertainty to the generated images, so we have no way of knowing the reliability of these generated images. To address these two challenging issues, we propose a model-agnostic approach for existing deep SISR networks to improve their robustness under various degradations. Our proposed method follows a probabilistic framework and applies Monte Carlo dropout to existing deep SISR methods. Instead of performing point estimation, the proposed method predicts the posterior distribution of super-resolved images. Based on this, we can determine the uncertainty of the generated images. Experiment results show that the proposed method can effectively improve the robustness of existing deep SISR methods, leading to state-of-the-art performance when applied to images having different degradations. The code is available at https://github.com/YangTracy/MCD-SR.
KW - deep learning models
KW - monte carlo method
KW - Single image super-resolution
UR - http://www.scopus.com/inward/record.url?scp=85180795832&partnerID=8YFLogxK
U2 - 10.1109/ICIP49359.2023.10222757
DO - 10.1109/ICIP49359.2023.10222757
M3 - Conference article published in proceeding or book
AN - SCOPUS:85180795832
T3 - Proceedings - International Conference on Image Processing, ICIP
SP - 2135
EP - 2139
BT - 2023 IEEE International Conference on Image Processing, ICIP 2023 - Proceedings
PB - IEEE Computer Society
T2 - 30th IEEE International Conference on Image Processing, ICIP 2023
Y2 - 8 October 2023 through 11 October 2023
ER -