Deep Model-Based Super-Resolution with Non-uniform Blur

April 15, 2024 · View on GitHub

Download

This repository implements the code of Deep Model-Based Super-Resolution with Non-uniform Blur

Train

To train the code please first download COCO dataset available at: https://cocodataset.org.

python main_train.py -opt options/train_nimbusr.json

Test

Pre-trained model is available at: model_zoo/DMBSR.pth

Our blur kernels are available for download here. They need to be added in the folder |-kernels

See test_model.ipynb to test the model on COCO dataset.

Results

We achieve state-of-the-art results in super-resolution in the presence of spatially-varying blur. Here are some of the results we obtained. Feel free to test on your own sample using the testing notebook.

LRSwinIRBlindSRUSRNetOursHR
LRSwinIRBlindSRUSRNetOurs

Real-world images

For this section, we used the code provided by https://github.com/GuillermoCarbajal/NonUniformBlurKernelEstimation to estimate the kernel and we combine their kernel estimation to our super-resolution model. We also use the dataset provided by "Laurent D’Andrès, Jordi Salvador, Axel Kochale, and Sabine Süsstrunk. Non-parametric blur map regression for depth of field extension".

Defocus x2 super-resolution

LRSwinIRBlindSROurs

Deblurring

LRDMPHNRealBlurMPRNetOurs

Acknowledgement

The codes use KAIR as base. Please also follow their licenses. I would like to thank them for the amazing repository.

Citation

If you use our work, please cite us with the following:

@InProceedings{laroche2023dmbsr,
  title = {Deep Model-Based Super-Resolution with Non-Uniform Blur},
  author = {Laroche, Charles and Almansa, Andrés and Tassano, Matias},
  booktitle = {IEEE/CVF Winter Conference on Applications of Computer Vision (WACV)}
  year = {2023}
}