Diffusion model-based Image/Video quality assessment

April 8, 2026 · View on GitHub

image

Purpose: We aim to provide a summary of diffusion model-based image processing, including restoration, enhancement, coding, and quality assessment. More papers will be summarized.

Contributors for this Repo

Xin Li, Yulin Ren, Bingchen Li, Xijun Wang, Xin Jin, Cuiling Lan, Xingrui Wang, Wenjun Zeng, Xinchao Wang, Zhibo Chen

University of Science and Technology of China (USTC), National University of Singapore (NUS), Microsoft Research Asia (MSRA), Eastern Institute of Technology (EIT)

Brief intro: The survey for diffusion model-based IR has been released.

arXiv visitors

:bookmark: News!!!

  • 2023-09-19: Updated new related works before 19/09/2023 in this GitHub.
  • 2023-11-25: Updated new related works before 25/11/2023 in this GitHub.
  • 2023-12-25: Updated new related works before 25/12/2023 in this GitHub.
  • 2024-04-25: Updated new related works before 25/04/2024 in this GitHub.
  • 2024-08-25: Updated new related works before 25/08/2024 in this GitHub.
  • 2024-12-25: Updated new related works before 25/12/2024 in this GitHub.
  • 2025-03-25: Updated new related works before 25/03/2025 in this GitHub.
  • 2025-05-25: Updated new related works before 25/05/2025 in this GitHub.
  • 2025-08-25: Updated new related works before 25/08/2025 in this GitHub.
  • 2025-11-25: Updated new related works before 25/08/2025 in this GitHub.
  • 2026-03-25: Updated new related works before 25/08/2025 in this GitHub.

📌 About new works. If you want to incorporate your studies (e.g., the link of paper or project) on diffusion model-based image processing in this repository. Welcome to raise an issue or email us. We will incorporate it into this repository and our survey report as soon as possible.

🌟 Features

  • Survey for diffusion model-based Image Restoration (Arxiv version is released)
  • Summary for diffusion model-based Image/Video Compression
  • Summary for diffusion model-based Quality Assessment

Diffusion model-based Image Restoration/Enhancement

Table of contents

Image Super-Resolution

ModelsPaperFirst AuthorTraining WayVenueTopicProject
SR3Image super-resolution via iterative refinementChitwan SahariaSupervisedTPAMI2022Super-resolutionStars
SRDiffSRDiff: Single Image Super-Resolution with Diffusion Probabilistic ModelsHaoying LiSupervisedNeurocomputing 2022Super-resolutionStars
SDE-SRFace super-resolution using stochastic differential equationsMarcelo dos SantosSupervisedSIBGRAPI 2022Super-resolutionStars
IDMImplicit diffusion models for continuous super-resolutionSicheng GaoSupervisedCVPR2023Super-resolutionStars
PromptSRImage Super-Resolution with Text Prompt DiffusionZheng ChenSupervisedPreprint'23Super-resolutionStars
DiffIRDiffIR: Efficient diffusion model for image restorationBin XiaSupervisedICCV 2023Super-resolutionStars
CDMCascaded Diffusion Models for High Fidelity Image GenerationJonathan HoSupervisedJ.Mach.Learn.Res 2022Super-resolution
StableSRExploiting diffusion prior for real-world image super-resolutionJianyi WangSupervisedPreprint'23Real-World Super-resolutionStars
ResShiftResShift: Efficient Diffusion Model for Image Super-resolution by Residual ShiftingZongsheng YueSupervisedNeurIPS 2023Real-World Super-resolutionStars
DFOSDDistillation-Free One-Step Diffusion for Real-World Image Super-ResolutionJianze LiSupervisedPreprint'24Real-World Super-resolutionStars
ECDPEfficient Conditional Diffusion Model with Probability Flow Sampling for Image Super-resolutionYutao YuanSupervisedAAAI 2024Super-resolutionStars
ClearSRClearSR: Latent Low-Resolution Image Embeddings Help Diffusion-Based Real-World Super Resolution Models See ClearerYuhao WanSupervisedPreprint' 2024Real-World Super-resolution
SinSRSinSR: Diffusion-Based Image Super-Resolution in a Single StepYufei WangSupervisedCVPR 2024Real-World Super-resolutionStars
TextDiffTextDiff: Mask-Guided Residual Diffusion Models for Scene Text Image Super-ResolutionBaolin LiuSupervisedPreprint'23Super-resolutionStars
PASDPixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized StylizationTao YangSupervisedPreprint'23Super-resolutionStars
CCSRImproving the Stability of Diffusion Models for Content Consistent Super-ResolutionLingchen SunSupervisedPreprint'23Super-resolutionStars
EDiffSREDiffSR: An Efficient Diffusion Probabilistic Model for Remote Sensing Image Super-ResolutionYi XiaoSupervisedIEEE TGRSSuper-resolutionStars
SeeSRSeeSR: Towards Semantics-Aware Real-World Image Super-ResolutionRongyuan WuSupervisedPreprint'23Super-resolutionStars
CoSeRCoSeR: Bridging Image and Language for Cognitive Super-ResolutionHaoze SunSupervisedCVPR 2024Super-resolutionStars
MegaSRMegaSR: Mining Customized Semantics and Expressive Guidance for Image Super-ResolutionXinrui LiSupervisedPrePrint' 25Super-resolution
FaithDiffFaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolutionJunyang ChenSupervisedCVPR 2025Super-resolutionStars
HoliSDiPHoliSDiP: Image Super-Resolution via Holistic Semantics and Diffusion PriorLi-Yuan TsaoSupervisedPrePrint' 25Super-resolutionStars
BI-DiffSRBinarized Diffusion Model for Image Super-ResolutionZheng ChenSupervisedNeurIPS 2024Super-resolutionStars
DoSSRTaming Diffusion Prior for Image Super-Resolution with Domain Shift SDEsQinpeng CuiSupervisedNeurIPS 2024Super-resolutionStars
DaLPSRDaLPSR: Leverage Degradation-Aligned Language Prompt for Real-World Image Super-ResolutionAiwen JiangSupervisedPreprint'24Super-resolution
FDDiffFrequency-Domain Refinement with Multiscale Diffusion for Super ResolutionXingjian WangSupervisedPreprint'24Super-resolution
PartDiffPartDiff: Image Super-resolution with Partial Diffusion ModelsKai ZhaoSupervisedPreprint'23Super-resolution
InstanceRSRInstanceRSR: Real-World Super-Resolution via Instance-Aware Representation AlignmentZixin GuoSupervisedPreprint'26Super-resolution
DeeDSRDeeDSR: Towards Real-World Image Super-Resolution via Degradation-Aware Stable DiffusionChunyang BiSupervisedPreprint'24(Real-World) Super-resolution
TDDSRTDDSR: SINGLE-STEP DIFFUSION WITH TWO DISCRIMINATORS FOR SUPER RESOLUTIONSohwi KimSupervisedPreprint'24Super-resolution
DiT-SREffective Diffusion Transformer Architecture for Image Super-ResolutionKun ChengSupervisedPreprint'24Super-resolution
SR3+Denoising diffusion probabilistic models for robust image super-resolution in the wildHshmat SahakSupervisedPreprint'23(Real-World) Super-resolution
DKPA Dynamic Kernel Prior Model for Unsupervised Blind Image Super-ResolutionZhixiong YangSupervisedCVPR 2024(Real-World) Super-resolutionStars
DiwaWaving Goodbye to Low-Res: A Diffusion-Wavelet Approach for Image Super-ResolutionBrian MoserSupervisedPreprint'23Super-resolutionStars
YODAYODA: You Only Diffuse Areas. An Area-Masked Diffusion Approach For Image Super-ResolutionBrian B. MoserSupervisedPreprint'23Super-resolution
CDPMSRCDPMSR: Conditional Diffusion Probabilistic Models for Single Image Super-ResolutionAxi NiuSupervisedPreprint'23Super-resolution
ACDPMSRACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-ResolutionAxi NiuSupervisedPreprint'23Super-resolution
ResDiffResDiff: Combining cnn and diffusion model for image superresolutionShuyao ShangSupervisedPreprint'23Super-resolutionStars
OSEDiffOne-Step Effective Diffusion Network for Real-World Image Super-ResolutionRongyuan WuSupervisedPreprint'24Super-resolutionStars
DiT-SREffective Diffusion Transformer Architecture for Image Super-ResolutionKun ChengSupervisedPreprint'25Super-resolutionStars
InvSRArbitrary-steps Image Super-resolution via Diffusion InversionZongsheng YueSupervisedCVPR 25Super-resolutionStars
DiffTSRDiffusion-based Blind Text Image Super-ResolutionYuzhe ZhangSupervisedCVPR 2024Super-resolution
SAM-DiffSRSAM-DiffSR: Structure-Modulated Diffusion Model for Image Super-ResolutionChengcheng WangSupervised
Preprint'24Super-resolutionStars
DiT4SRDiT4SR: Taming Diffusion Transformer for Real-World Image Super-ResolutionZheng-Peng DuanSupervised
Preprint'25Super-resolutionStars
TVTFine-structure Preserved Real-world Image Super-resolution via Transfer VAE TrainingQiaosi YiSupervisedICCV 2025Super-resolutionStars
DiT4SRDiT4SR: Taming Diffusion Transformer for Real-World Image Super-ResolutionZheng-Peng DuanSupervisedICCV 2025Super-resolutionStars
BlindDiffBlindDiff: Empowering Degradation Modelling in Diffusion Models for Blind Image Super-ResolutionFeng LiSupervisedPreprint'24Super-resolutionStars
DTPSRDisentangled Textual Priors for Diffusion-based Image Super-ResolutionLei JiangSupervisedCVPR 2026Super-resolution
MFSRMFSR: MeanFlow Distillation for One Step Real-World Image Super ResolutionRuiqing WangSupervisedPreprint'26Super-resolution
DualTSRDualTSR: Unified Dual-Diffusion Transformer for Scene Text Image Super-ResolutionAxi NiuSupervisedPreprint'26Super-resolution
ODTSROne-Step Diffusion Transformer for Controllable Real-World Image Super-ResolutionYushun FangSupervisedPreprint'25Super-resolutionStars
XPSRXPSR: Cross-modal Priors for Diffusion-based Image Super-ResolutionYunpeng QuSupervisedPreprint'24Super-resolutionStars
--Text-guided Explorable Image Super-resolutionKanchana Vaishnavi GandikotaZero-ShotPreprint'24Super-resolution
--Image Super-resolution Via Latent Diffusion: A Sampling-space Mixture Of Experts And Frequency-augmented Decoder ApproachFeng LuoSupervisedPreprint'23Super-resolutionStars
--Solving Diffusion ODEs with Optimal Boundary Conditions for Better Image Super-ResolutionYiyang MaSupervisedPreprint'23Super-resolution
--Diffusion Transformer meets Multi-level Wavelet Spectrum for Single Image Super-ResolutionPeng DuSupervisedICCV 2025Super-resolution

Image Restoration

ModelPaperFirst AuthorTraining WayVenueTopicProject
PalettePalette: Image-toimage diffusion modelsChitwan SahariaSupervisedSIGGRAPH 2022Multi-task RestorationStars
RefusionRefusion: Enabling large-size realistic image restoration with latent-space diffusion modelsZiwei LuoSupervisedCVPRW 2023Multi-task RestorationStars
SUPIRScaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the WildFanghua YuSupervisedCVPR 2024Image RestorationStars
Weather-DiffRestoring vision in adverse weather conditions with patch-based denoising diffusion modelsOzan ÖzdenizciSupervisedTPAMI2022Multi-task RestorationStars
IR-SDEImage Restoration with Mean-Reverting Stochastic Differential EquationsZiwei LuoSupervisedICML 2023Multi-task RestorationStars
DAVIDiffusion Prior-Based Amortized Variational Inference for Noisy Inverse ProblemsSojin LeeSupervisedECCV 2024Multi-task RestorationStars
SUD^2SUD ˆ2: Supervision by denoising diffusion models for image reconstructionMatthew A. ChanSupervisedPreprint'23Multi-task Restoration
InDIInversion by direct iteration: An alternative to denoising diffusion for image restorationMauricio DelbracioSupervisedPreprint'22Multi-task Restoration
AdaptBIRAdaptBIR: Adaptive Blind Image Restoration with latent diffusion prior for higher fidelityYingqi LiuSupervisedPattern Recognition 24Image Restoration
ILVRILVR: Conditioning method for denoising diffusion probabilistic modelsJooyoung ChoiZero-ShotICCV2021Image RestorationStars
CCDFCome-closer-diffusefaster: Accelerating conditional diffusion models for inverse problems through stochastic contractionHyungjin ChungZero-ShotCVPR2022Multi-task Restoration
SNIPSSNIPS: Solving noisy inverse problems stochasticallyBahjat KawaZero-ShotNeurIPS 2021Multi-task RestorationStars
DDRMDenoising diffusion restoration modelsBahjat KawarZero-ShotICLR2022Multi-task RestorationStars
DDNMZero-Shot image restoration using denoising diffusion null-space modelYinhuai WangZero-ShotICLR2023Multi-task RestorationStars
DPSDiffusion Posterior Sampling for General Noisy Inverse ProblemsHyungjin ChungZero-ShotICLR 2023Multi-task RestorationStars
DiffPIRDenoising diffusion models for plug-and-play image restorationYuanzhi ZhuZero-ShotCVPR 2023Multi-task RestorationStars
DPPSDiffusion Posterior Proximal Sampling for Image RestorationHongjie WuZero-ShotACMM 2024 OralMulti-task RestorationStars
DiracDiffusionDiracDiffusion: Denoising and incremental reconstruction with assured data-consistencyZalan FabianZero-ShotPreprint' 23Multi-task Restoration
IIGDMPseudoinverse-guided diffusion models for inverse problemsJiaming SongZero-ShotICLR 2023Multi-task Restoration
GDPGenerative diffusion prior for unified image restoration and enhancementBen FeiZero-ShotCVPR2023Multi-task RestorationStars
RED-DiffA variational perspective on solving inverse problems with diffusion modelsMorteza MardaniZero-ShotPrePrint'23Multi-task RestorationStars
DeqIRDeep Equilibrium Diffusion Restoration with Parallel SamplingJiezhang CaoZero-ShotCVPR 2024Multi-task RestorationStars
SaFaRISpatial-and-Frequency-aware Restoration method for Images based on Diffusion ModelsKyungsung LeeZero-ShotPrePrint'24Multi-task Restoration
OmniSSROmniSSR: Zero-Shot Omnidirectional Image Super-Resolution using Stable Diffusion ModelRunyi LiZero-ShotPreprint'24Blind Restoration
DriftRecDriftRec: Adapting diffusion models to blind image restoration tasksSimon WelkerSupervisedPreprint'22Blind Restoration
DR2DR2: Diffusion-based robust degradation remover for blind face restorationZhixin WangZero-ShotCVPR2023Blind Face RestorationStars
PFStorerPFStorer: Personalized Face Restoration and Super-ResolutionTuomas VarankaSupervisedPreprint'24Blind Face Restoration
DiffBFRDiffBFR: Bootstrapping diffusion model towards blind face restorationXinmin QiuSupervisedPreprint'23Blind Face Restoration
DifFaceDifFace: Blind face restoration with diffused error contractionZongsheng YuZero-ShotPrePrint'23Blind RestorationStars
--Towards Unsupervised Blind Face Restoration using Diffusion PriorTianshu KuaiSupervisedPrePrint'24Blind Restoration
GibbsDDRMGibbsDDRM: A partially collapsed gibbs sampler for solving blind inverse problems with denoising diffusion restorationNaoki MurataZero-ShotICML 2023Blind RestorationStars
ADIRADIR: Adaptive diffusion for image reconstructionShady Abu-HusseinZero-ShotPrePrint'22Blind Restoration
PSLDSolving Linear Inverse Problems Provably via Posterior Sampling with Latent Diffusion ModelsLitu RoutZero-ShotPrePrint'23Image RestorationStars
IDMTowards Authentic Face Restoration with Iterative Diffusion Models and BeyondYang ZhaoSupervisedICCV 2023Face Restoration
DiffBIRDiffBIR: Towards Blind Image Restoration with Generative Diffusion PriorXinqi LinSupervisedPreprint' 2023Image RestorationStars
RDDMResidual Denoising Diffusion ModelsJiawei LiuSupervisedPreprint' 2023Image RestorationStars
C2F-DFTLearning A Coarse-to-Fine Diffusion Transformer for Image RestorationLiyan WangSupervisedPreprint' 2023Image RestorationStars
Diff-PluginDiff-Plugin: Revitalizing Details for Diffusion-based Low-level tasksYuhao LiuSupervisedCVPR 2024All-in-one RestorationStars
DDPGImage Restoration by Denoising Diffusion Models with Iteratively Preconditioned GuidanceTomer GarberZero-ShotCVPR 2024Image RestorationStars
DiffUIRSelective Hourglass Mapping for Universal Image Restoration Based on Diffusion ModelDian ZhengSupervisedCVPR 2024Image RestorationStars
DMPlugDMPlug: A Plug-in Method for Solving Inverse Problems with Diffusion ModelsHengkang WangSupervisedNeurIPS 2024Image RestorationStars
MPerceiverMultimodal Prompt Perceiver: Empower Adaptiveness, Generalizability and Fidelity for All-in-One Image RestorationYuang AiSupervisedCVPR 2024All-in-one Restoration
MCGdiffMonte Carlo guided Diffusion for Bayesian linear inverse problemsGabriel CardosoZero-ShotPreprint' 2023Image Restoration
PromptFixPromptFix: You Prompt and We Fix the PhotoYongsheng YuSupervisedPreprint' 2024Image RestorationStars
AutoDIRAutoDIR: Automatic All-in-One Image Restoration with Latent DiffusionYitong JiangSupervisedPreprint' 2023Image Restoration
DiffLossUsing diffusion model as constraint: Empower Image Restoration Network Training with Diffusion ModelJiangtong TanSupervisedPreprint' 2024Image Restoration
ZeroAIRExploiting Diffusion Priors for All-in-One Image RestorationYuanbiao GouSupervisedPreprint' 2023Image Restoration
FastDiffusionEMFast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolutionCharles LarocheSupervisedWACV 2024Blind Image Restoration
P2LPROMPT-TUNING LATENT DIFFUSION MODELS FOR INVERSE PROBLEMSHyungjin ChungSupervisedPreprint' 2023Image Restoration
JCDMJoint Conditional Diffusion Model for Image Restoration with Mixed DegradationsYufeng YueSupervisedPreprint' 2024Image Restoration
DACLIP-IRPhoto-Realistic Image Restoration in the Wild with Controlled Vision-Language ModelsZiwei LuoSupervisedPreprint' 2024Image RestorationStars
MoE-DiffIRMoE-DiffIR: Task-customized Diffusion Priors for Universal Compressed Image RestorationYulin RenSupervisedECCV 2024Image RestorationStars
OneRestoreOneRestore: A Universal Restoration Framework for Composite DegradationYu GuoSupervisedECCV 2024Image RestorationStars
Noise-DADenoising as Adaptation: Noise-Space Domain Adaptation for Image RestorationKang LiaoSupervisedPreprint' 2024Image RestorationStars
T^3^-DiffWeatherTeaching Tailored to Talent: Adverse Weather Restoration via Prompt Pool and Depth-Anything ConstraintSixiang ChenSupervisedECCV 2024Adverse Weather RestorationStars
VSPBFRVisual Style Prompt Learning Using Diffusion Models for Blind Face RestorationWanglong LuSupervisedPreprint' 24Blind Face RestorationStars
--Boosting Diffusion-Based Text Image Super-Resolution Model Towards Generalized Real-World ScenariosChenglu PanSupervisedPreprint' 25Blind Face Restoration
ReviveDiffReviveDiff: A Universal Diffusion Model for Restoring Images in Adverse Weather ConditionsWenfeng HuangSupervisedPreprint' 24Adverse Weather Restoration
GenDegGenDeg: Diffusion-Based Degradation Synthesis for Generalizable All-in-One Image RestorationSudarshan RajagopalanSupervisedPreprint' 24All in one Image Restoration
CyclicPromptPrompt to Restore, Restore to Prompt: Cyclic Prompting for Universal Adverse Weather RemovalRongxin LiaoSupervisedPreprint' 25All in one Image Restoration
Diff-RestorerDiff-Restorer: Unleashing Visual Prompts for Diffusion-based Universal Image RestorationYuhong ZhangSupervisedPreprint' 24Image Restoration
WaveLLDMWaveLLDM: Design and Development of a Lightweight Latent Diffusion Model for Speech Enhancement and RestorationKevin Putra SantosoSupervisedPreprint' 2025Image Restoration
TinySRTinySR: Pruning Diffusion for Real-World Image Super-ResolutionLinwei DongSupervisedPreprint' 2025Image Restoration
--Unlocking the Potential of Diffusion Priors in Blind Face RestorationYunqi MiaoSupervisedPreprint' 2025Image Restoration
Res-CaptionerBeyond Pixels: Text Enhances Generalization in Real-World Image RestorationHaoze SunSupervisedPreprint' 2024Image Restoration
HAODiffHAODiff: Human-Aware One-Step Diffusion via Dual-Prompt GuidanceJue GongSupervisedPreprint'25Image Restoration
BIR-AdapterBIR-Adapter: A Low-Complexity Diffusion Model Adapter for Blind Image RestorationCem EtekeSupervisedPreprint'25Image Restoration
--Diffusion Posterior Proximal Sampling for Image RestorationHongjie WuZero-ShotPreprint'24Multi-task Restoration
--Multiscale Structure Guided Diffusion for Image DeblurringMengwei RenSupervisedPreprint'22Blind Restoration
--Synthesizing realistic image restoration training pairs: A diffusion approachTao YangSupervisedPreprint'22Blind Restoration

Video Restoration

ModelPaperFirst AuthorTraining WayVenueTopicProject
Diff-TTAGenuine Knowledge from Practice: Diffusion Test-Time Adaptation for Video Adverse Weather RemovalYijun YangSupervisedCVPR 2024Video RestorationStars
TDMTDM: Temporally-Consistent Diffusion Model for All-in-One Real-World Video RestorationYizhou LiSupervisedMMM 2025Video Restoration
UniFlowRestoreUniFlowRestore: A General Video Restoration Framework via Flow Matching and Prompt GuidanceShuning SunSupervisedPreprint' 25Video Restoration
DUO-VSRDUO-VSR: Dual-Stream Distillation for One-Step Video Super-ResolutionZhengyao LvSupervisedPreprint' 26Video Super-resolution
DiTVRDiTVR: Zero-Shot Diffusion Transformer for Video RestorationSicheng GaoSupervisedPreprint' 25Video Restoration
AverNetAverNet: All-in-one Video Restoration for Time-varying Unknown DegradationsHaiyu ZhaoSupervisedNeurIPS 2024Video RestorationStars
SeedVRSeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video RestorationJianyi WangSupervisedCVPR 2025Video RestorationStars
SeedVR2One-Step Video Restoration via Diffusion Adversarial Post-TrainingJianyi WangSupervisedPreprint' 2025Video RestorationStars
FlashVSRFlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-ResolutionJunhao ZhuangSupervisedPreprint' 2025Video RestorationStars
InstaVSRInstaVSR: Taming Diffusion for Efficient and Temporally Consistent Video Super-ResolutionJintong HuSupervisedPreprint' 2026Video Super-Resolution
HATIRHATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-ResolutionYang ZouSupervisedPreprint' 2026Video Super-resolution
Stream-DiffVSRStream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive DiffusionHau-Shiang ShiuSupervisedPreprint' 2025Video Super-resolution

Image Inpainting

ModelPaperFirst AuthorTraining WayVenueTopicProject
RePaintRePaint: Inpainting using denoising diffusion probabilistic modelsAndreas LugmayrZero-ShotCVPR2022Image InpaintingStars
CoPaintTowards coherent image inpainting using denoising diffusion implicit modelsGuanhua ZhangZero-ShotPrePrint'23Image InpaintingStars
PVAPersonalized Face Inpainting with Diffusion Models by Parallel Visual AttentionJianjin XuZero-ShotPrePrint'23Image Inpainting

Image Shadow Removal

ModelPaperFirst AuthorTraining WayVenueTopicProject
BCDiffBoundary-Aware Divide and Conquer: A Diffusion-based Solution for Unsupervised Shadow RemovalLanqing GuoUnsupervisedICCV 2023Image Shadow Removal
ShadowDiffusionShadowdiffusion: When degradation prior meets diffusion model for shadow removalLanqing GuoSupervisedCVPR2023Image Shadow RemovalStars
DeS3DeS3: Attention-driven Self and Soft Shadow Removal using ViT Similarity and Color ConvergenceYeying JinSupervisedAAAI'24Image Shadow RemovalStars
Diff-ShadowDiff-Shadow: Global-guided Diffusion Model for Shadow RemovalJinting LuoSupervisedPreprint'24Image Shadow Removal
LFG-DiffusionLatent Feature-Guided Diffusion Models for Shadow RemovalKangfu MeiSupervisedWACV 2024Image Shadow Removal
Deshadow-AnythingDeshadow-Anything: When Segment Anything Model Meets Zero-Shot shadow removalXiao Feng ZhangSupervisedPreprint'23Image Shadow Removal

Image Denoising

PaperFirst AuthorTraining WayVenueTopicProject
Diffusion model for generative image denoisingYutong XieSupervisedPreprint'23Image Denoising
Score-Based Diffusion Models as Principled Priors for Inverse ImagingBerthy T. FengZero-ShotICCV 2023Image Denoising, Image DeblurringStars
Real-World Denoising via Diffusion ModelCheng YangSupervisedPrePrint'23Image Denoising

Image Dehazing

ModelPaperFirst AuthorTraining WayVenueTopicProject
HazeDDPMHigh-quality Image Dehazing with Diffusion ModelHu YuSupervisedPreprint'23Image Dehazing
--Frequency Compensated Diffusion Model for Real-scene DehazingJing WangSupervisedPreprint'23Image Dehazing

Image Deblurring

PaperFirst AuthorTraining WayVenueTopicProject
Deblurring via stochastic refinementJay WhangSupervisedCVPR2022Image Deblurring
Score-Based Diffusion Models as Principled Priors for Inverse ImagingBerthy T. FengZero-ShotICCV 2023Image Denoising, Image DeblurringStars
BlindDPS:Parallel diffusion models of operator and image for blind inverse problemsHyungjin ChungZero-ShotCVPR2023Blind DeblurringStars
HI-Diff:Hierarchical Integration Diffusion Model for Realistic Image DeblurringZheng ChenSupervisedPrepreint'23Image DeblurringStars
Swintormer:Efficient Image Deblurring Networks based on Diffusion ModelsKang ChenSupervisedPrepreint'24Image DeblurringStars

Medical Restoration (MRI,CT)

ModelPaperFirst AuthorTraining WayVenueTopicProject
MCGImproving diffusion models for inverse problems using manifold constraintsHyungjin ChungZero-ShotNeurIPS 2022CT ReconstructionStars
--Solving inverse problems in medical imaging with score-based generative modelsYang SongZero-ShotICLR 2022CT Reconstruction
AdaDiffAdaptive diffusion priors for accelerated mri reconstructionAlper GüngörSupervisedPreprint'23MRI ReconstructionStars
HFS-SDEHigh-Frequency Space Diffusion Models for Accelerated MRIChentao CaoSupervisedPreprint'22MRI Reconstruction
SWORDStage-by-stage Wavelet Optimization Refinement Diffusion Model for Sparse-View CT ReconstructionKai XuSupervisedPreprint'23MRI ReconstructionStars
FDBLearning Fourier-Constrained Diffusion Bridges for MRI ReconstructionMuhammad U. MirzaSupervisedPreprint'23MRI ReconstructionStars

Low-Light Enchancement

ModelPaperFirst AuthorTraining WayVenueTopicProject
PyDiffPyramid Diffusion Models For Low-light Image EnhancementDewei ZhouSupervisedPreprint'23Low-light EnhancemnentStars
LightenDiffusionLightenDiffusion: Unsupervised Low-Light Image Enhancement with Latent-Retinex Diffusion ModelsHai JiangSupervisedECCV 2024Low-light EnhancemnentStars
DiffLLLowlight image enhancement with wavelet-based diffusion modelsHai JiangSupervisedPreprint'23Low-light EnhancemnentStars
ExploreDiffusionExposureDiffusion: Learning to Expose for Low-light Image EnhancementYufei WangSupervisedICCV 2023Low-light EnhancemnentStars
Diff-RetinexRethinking Low-light Image Enhancement with A Generative Diffusion ModelXunpeng YiSupervisedICCV 2023Low-light Enhancemnent
CLE DiffusionCLE Diffusion: Controllable Light Enhancement Diffusion ModelYuyang YinSupervisedPreprint'23Low-light EnhancemnentStars
DiffLLEDiffLLE: Diffusion-guided Domain Calibration for Unsupervised Low-light Image EnhancementShuzhou YangSupervisedPreprint'23Low-light Enhancemnent
PASDiffPASDiff: Physics-Aware Semantic Guidance for Joint Real-world Low-Light Face Enhancement and RestorationYilin NiSupervisedPreprint'26Low-light Enhancemnent
LLDiffusionLLDiffusion: Learning Degradation Representations in Diffusion Models for Low-Light Image EnhancementTao WangSupervisedPreprint'23Low-light EnhancemnentStars
Entropy-SDEEquipping Diffusion Models with Differentiable Spatial Entropy for Low-Light Image EnhancementWenyi LianSupervisedCVPRW 2024Low-light EnhancemnentStars

Other tasks

ModelPaperFirst AuthorTraining WayVenueTopicProject
RainDiffusionRainDiffusion: When Unsupervised Learning Meets Diffusion Models for Real-world Image DerainingMingqiang WeiSupervisedPreprint'23Image Deraining
GaussianSRGaussianSR: 3D Gaussian Super-Resolution with 2D Diffusion PriorsXiqian YuSupervisedPreprint'243D Gaussian Super-resolution
DIffSteISRDIffSteISR: Harnessing Diffusion Prior for Superior Real-world Stereo Image Super-ResolutionYuanbo ZhouSupervisedPreprint'24Stereo Image Super-Resolution
DiffGARDiffGAR: Model-agnostic restoration from generative artifacts using image-to-image diffusion modelsYueqin YinSupervisedPreprint'22Generative Artifacts Removal
HSR-DiffHSR-Diff: Hyperspectral Image Super-Resolution via Conditional Diffusion ModelsChanyue WuSupervisedPreprint'23hyperspectral images super-resolution
DMGASREnhancing Hyperspectral Images via Diffusion Model and Group-Autoencoder Super-resolution NetworkZhaoyang WangSupervisedPreprint'24hyperspectral images super-resolution
DRUSUltrasound Image Reconstruction with Denoising Diffusion Restoration ModelsYuxin ZhangZero-ShotPreprint'23Ultrasound Image ReconstructionStars
PromptRRPromptRR: Diffusion Models as Prompt Generators for Single Image Reflection RemovalTao WangSupervisedPreprint'24Image Reflection Removal

|ColorFLUX|ColorFLUX: A Structure-Color Decoupling Framework for Old Photo Colorization | Bingchen Li | Supervised | CVPR 2026 | Old Photo Colorization | |

|--| Jpeg artifact correction using denoising diffusion restoration models | Bahjat Kawar| Zero-Shot | NeurIPS 2022 | JPEG Artifacts Removal | Stars | |--|Improved Diffusion-based Image Colorization via Piggybacked Models | Hanyuan Liu | Zero-Shot | PrePrint'23 | Image Colorization | Stars |

Benchmark Datasets

DatasetTaskUsageYear
DIV2KImage Super-resolutionTraining,Testing2017
Flickr2KImage Super-resolutionTraining2017
Set5Image Super-resolutionTesting2012
Set14Image Super-resolutionTesting2012
BSD100Image Super-resolutionTesting2012
Manga109Image Super-resolutionTesting2015
Urban100Image Super-resolutionTesting2015
OST300Image Super-resolutionTesting2018
DIV8KImage Super-resolutionTraining,Testing2019
RealSRImage Super-resolutionTraining,Testing2019
DRealSRImage Super-resolutionTraining,Testing2020
GoProImage DeblurringTraining,Testing2017
HIDEImage DeblurringTraining,Testing2019
RealBlurImage DeblurringTraining,Testing2020
KodakImage DenoisingTesting1999
CBSD68Image DenoisingTesting2001
McMasterImage DenoisingTesting2011
ImageNetImage ClassificationTraining,Testing2010
ImageNet1kImage ClassificationTesting2020
LSUNImage ClassificationTraining,Testing2015
Places365Image ClassificationTraining,Testing2019
LFWFace GenerationTraining2008
FFHQFace GenerationTraining2019
Celeba-HQFace GenerationTraining2018
AFHQFace GenerationTraining2020
CelebAFace GenerationTraining2015
ISTDImage Shadow RemovalTraining,Testing2018
SRDImage Shadow RemovalTraining,Testing2017
CSDImage DesnowingTraining,Testing2021
Snow100kImage DesnowingTraining,Testing2017
SRRSImage DesnowingTraining,Testing2020
RainDropImage DerainingTraining2018
RainDropClarityImage DerainingTraining,Testing2024
Outdoor-RainImage DerainingTraining,Testing2019
DDN-dataImage DerainingTraining,Testing2017
SPA-dataImage DerainingTraining,Testing2019
Rain100HImage DerainingTraining,Testing2017
Rain100LImage DerainingTraining,Testing2017
Haze-4KImage DehazingTraining2021
Dense-HazeImage DehazingTraining2019
RESIDEImage DehazingTraining2019

Diffusion model-based Image/Video Compression

ModelPaperFirst AuthorVenueTopicProject
DiffCLossy Compression with Gaussian DiffusionLucas TheislPreprint'22Lossy Image Compression
CDCLossy Image Compression with Conditional Diffusion ModelsRuihan YangNeurIPS 2023Lossy Image CompressionStars
CorrDiffCorrecting Diffusion-Based Perceptual Image Compression with Privileged End-to-End DecoderYiyang MaICML 2024Image Compression
I2VCI2VC: A Unified Framework for Intra- & Inter-frame Video CompressionMeiqin LiuNeurIPS2024 submissionVideo CompressionStars
DiffEICTowards Extreme Image Compression with Latent Feature Guidance and Diffusion PriorZhiyuan LiIEEE TCSVTLossy Image Compression
PSCZero-Shot Image Compression with Diffusion-Based Posterior SamplingNoam ElataPreprint'24Lossy Image Compression
DIRACA Residual Diffusion Model for High Perceptual Quality Codec AugmentationNoor Fathima GhousePreprint'23Image Compression
HFDHigh-Fidelity Image Compression with Score-based Generative ModelsEmiel HoogeboomPreprint'23Lossy Image Compression
PerCoTowards image compression with perfect realism at ultra-low bitratesMarl` ene CareilICLR 2024Lossy Image Compression
PICText + Sketch: Image Compression at Ultra Low RatesEric LeiICML 2023 workshop Lossy Image Compression
Idempotence and Perceptual Image CompressionTongda XuICLR2024Lossy Image CompressionStars
--Lossy Image Compression with Foundation Diffusion ModelsLucas RelicPreprint'24Image Compression
--Extreme Generative Image Compression by Learning Text Embedding from Diffusion ModelsZhihong PanPreprint'22Image Compression

Diffusion model-based Image/Video quality assessment

ModelPaperFirst AuthorVenueTopicProject
DifFIQADifFIQA: Face Image Quality Assessment Using Denoising Diffusion Probabilistic ModelsŽiga BabnikPreprint'23Image quality assessmentStars
PFD-IQAFeature Denoising Diffusion Model for Blind Image Quality AssessmentXudong LiPreprint'24Image quality assessment
DP-IQADP-IQA: Utilizing Diffusion Prior for Blind Image Quality Assessment in the WildHonghao FuPreprint'24Image quality assessmentStars
GenzIQAGenzIQA: Generalized Image Quality Assessment using Prompt-Guided Latent Diffusion ModelsDiptanu DePreprint'24Image quality assessment
DiffV2IQADiffusion Model Based Visual Compensation Guidance and Visual Difference Analysis for No-Reference Image Quality AssessmentZhaoyang WangPreprint'24Image quality assessment

VAR-based SR/IR

ModelPaperFirst AuthorVenueTopicProject
VARSRVisual Autoregressive Modeling for Image Super-ResolutionYunpeng QuPreprint'25Image Super ResolutionStars
RestoreVARRestoreVAR: Visual Autoregressive Generation for All-in-One Image RestorationSudarshan RajagopalanPreprint'25Image RestorationStars

Cite US

If this work is helpful to you, we expect you can cite this work and star this repo. Thanks.

@article{li2023diffusion,
  title={Diffusion Models for Image Restoration and Enhancement--A Comprehensive Survey},
  author={Li, Xin and Ren, Yulin and Jin, Xin and Lan, Cuiling and Wang, Xingrui and Zeng, Wenjun and Wang, Xinchao and Chen, Zhibo},
  journal={arXiv preprint arXiv:2308.09388},
  year={2023}
}

Star History Chart