Code and models for "Rethinking Deep Image Prior for Denoising" (ICCV 2021)

Last update: Dec 29, 2022

Related tags

Overview

DIP-denosing

This is a code repo for Rethinking Deep Image Prior for Denoising (ICCV 2021).

Addressing the relationship between Deep image prior and effective degrees of freedom, DIP-SURE with STE(stochestic temporal ensemble) shows reasonable result on single image denoising.

If you use any of this code, please cite the following publication:

@article{jo2021dipdenoising,
  author  = {Yeonsik Jo, Se young chun,  and Choi, Jonghyun},
  title     = {Rethinking Deep Image Prior for Denoising},
  booktitle = {Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV)},
  month     = {October},
  year      = {2021},
  pages     = {5087-5096}
}

Working environment

TITAN Xp
ubuntu 18.04.4
pytorch 1.6

Note: Experimental results were not checked in other environments.

Set-up

Make your own environment

conda create --name DIP --file requirements.txt
conda avtivate DIP
pip install tqdm

Inference

Produce CSet9 result

bash exp_denoising.sh CSet9 <GPU ID>

For your own data with sigma=25 setup

mkdir testset/<YOUR_DATASET>
python main.py --dip_type eSURE_new --net_type s2s --exp_tag <EXP_NAME> --optim RAdam --force_steplr --desc sigma25   denoising --sigma 25 --eval_data <YOUR_DATASET>

Browsing experimental result

We provide reporting code with invoke.

invoke showtable csv/<exp_type>/<exp_tag>

Example.

invoke showtable csv/poisson/MNIST/
PURE_dc_scale001_new                     optimal stopping : 384.30,     31.97/0.02      | ZCSC : 447.60,         31.26/0.02 | STE 31.99/0.02
PURE_dc_scale01_new                      optimal stopping : 94.70,      24.96/0.12      | ZCSC : 144.60,         24.04/0.14 | STE 24.89/0.12
PURE_dc_scale02_new                      optimal stopping : 70.30,      22.92/0.20      | ZCSC : 110.00,         21.82/0.22 | STE 22.83/0.20
<EXEPRIMENTAL NAME>                      optimal stopping :<STEP>,      <PSNR>/<LPIPS>  | ZCSC : <STEP>,      <PSNR>/<LPIPS>| STE <PSNR>/<LPIPS>

The reported numbers are PSNR/LPIPS.

Results in paper

For the result used on paper, please refer this link.

SSIM score

For SSIM score of color images, I used matlab code same as the author of S2S.
This is the demo code I received from the S2S author.
Thank you Mingqin!

% examples
ref = im2double(imread('gt.png'));
noisy = im2double(imread('noisy.png'));
psnr_result = psnr(ref, noisy);
ssim_result = ssim(ref, noisy);

License

MIT license.

Contacts

For questions, please send an email to [email protected]

Code and models for "Rethinking Deep Image Prior for Denoising" (ICCV 2021)

Related tags

Overview

DIP-denosing

Working environment

Set-up

Inference

Browsing experimental result

Results in paper

SSIM score

License

Contacts

Owner

Computer Vision Lab. @ GIST

How to Predict Stock Prices Easily Demo

PEPit is a package enabling computer-assisted worst-case analyses of first-order optimization methods.

🌾 PASTIS 🌾 Panoptic Agricultural Satellite TIme Series

A JAX implementation of Broaden Your Views for Self-Supervised Video Learning, or BraVe for short.

PyTorch version of the paper 'Enhanced Deep Residual Networks for Single Image Super-Resolution' (CVPRW 2017)

PyTorch implementation for the Neuro-Symbolic Sudoku Solver leveraging the power of Neural Logic Machines (NLM)

Python version of the amazing Reaction Mechanism Generator (RMG).

Computational modelling of ray propagation through optical elements using the principles of geometric optics (Ray Tracer)

An AI Assistant More Than a Toolkit

Semantically Contrastive Learning for Low-light Image Enhancement

Lowest memory consumption and second shortest runtime in NTIRE 2022 challenge on Efficient Super-Resolution

[ACM MM 2019 Oral] Cycle In Cycle Generative Adversarial Networks for Keypoint-Guided Image Generation

Web service for facial landmark detection, head pose estimation, facial action unit recognition, and eye-gaze estimation based on OpenFace 2.0

adversarial_multi_armed_bandit_variable_plays

Code for the ICML 2021 paper "Bridging Multi-Task Learning and Meta-Learning: Towards Efficient Training and Effective Adaptation", Haoxiang Wang, Han Zhao, Bo Li.

TransCD: Scene Change Detection via Transformer-based Architecture

A human-readable PyTorch implementation of "Self-attention Does Not Need O(n^2) Memory"

Official repository of DeMFI (arXiv.)

This codebase is the official implementation of Test-Time Classifier Adjustment Module for Model-Agnostic Domain Generalization (NeurIPS2021, Spotlight)

Code and models for "Pano3D: A Holistic Benchmark and a Solid Baseline for 360 Depth Estimation", OmniCV Workshop @ CVPR21.