Holistic-Super-Resolution-Review

September 17, 2025 · View on GitHub

Review of deep-learning based super-resolution method in different fields.

:blush: The wealth of the literature on SR is so rich that we could not give an exhaustic review. We just list the major methods along the timeline.

:heavy_exclamation_mark: Single Image Super-Resolution (SISR)

We categorize the SISR into TWO types, Regression-Based Models and Generative-Based Models, for their purpose.

:boom: Datasets
:one: Set5
:two: Set14
:three: BSD100
:four: Urban100
:five: Manga109
:six: DIV2K
:seven: Flickr1024

:dart: Experimental Results on X4 Task

ModelParams (K)Set5Set14BSD100Urban100Training Set/s
Bicubic-28.43/0.810926.00/0.702325.96/0.667823.14/0.6574-
TPSR-D26129.60/-26.88/-26.23/-24.12/-DIV2K
LUT127429.82/0.847827.01/0.735526.53/0.695324.02/0.6990DIV2K
SRCNN2430.48/0.862827.50/0.751326.90/0.710324.52/0.7226T91+ImageNet
ESPCN2530.52/0.869727.42/0.760626.87/0.721624.39/0.7241T91+ImageNet
SPLUT1800030.52/0.863027.54/0.752026.87/0.709024.46/0.7190DIV2K
RankSRGAN--26.57/-25.57/--DIV2K+Flickr2K
FSRCNN1230.70/0.865727.59/0.753526.96/0.712824.60/0.7258T91+General-100
CSCN-30.86/0.873227.64/0.757827.03/0.7161-T91
NatSR480030.98/0.860627.42/0.732926.44/0.682725.46/0.7602DIV2K
ZSSR22531.13/0.879628.01/0.765127.12/0.7211--
VDSR66531.35/0.883828.01/0.767427.29/0.725125.18/0.7524BSD+T91
DSRN120031.40/0.883028.07/0.770027.25/0.724025.08/0.7470T91
DRCN177531.53/0.885428.02/0.767027.23/0.723325.14/0.7510T91
SESR11531.54/0.886628.12/0.771227.31/0.727725.31/0.7604DIV2K
LapSRN81231.54/0.885028.19/0.772027.32/0.727025.21/0.7560BSD+T91
DRRN20731.68/0.888828.21/0.772027.38/0.728425.44/0.7638BSD+T91
ENet-PAT-31.74/-28.42/-27.50/-25.66/-MSCOCO
MemNet67731.74/0.889328.26/0.772327.40/0.728125.50/0.7630BSD+T91
IDN67831.82/0.890328.25/0.773027.41/0.729725.41/0.7632BSD+T91
SRResNet150031.92/0.899828.39/0.816627.52/0.7603-ImageNet
NAPS12531.93/0.890628.42/0.776327.44/0.730725.66/0.7715DIV2K
SRMDNF-31.96/0.893028.35/0.777027.49/0.734025.68/0.7730BSD+DIV2K+WED
SRDenseNet545232.02/0.781928.50/0.778227.53/0.733726.05/0.7819ImageNet
MSRN630032.07/0.890328.60/0.775127.52/0.727326.04/0.7896DIV2K
SMSR100632.12/0.893228.55/0.780827.55/0.735126.11/0.7868DIV2K
DCLS-32.12/0.889028.54/0.772827.60/0.728526.15/0.7809DIV2K+Flickr2K
EDSR-SLS363-28.49/-27.51/-25.84/-DIV2K
CARN160032.13/0.893728.60/0.780627.58/0.734926.07/0.7837BSD+T91+DIV2K
ESRT75132.19/0.894728.69/0.783327.69/0.737926.39/0.7962DIV2K
IMDN71532.21/0.894828.58/0.781127.56/0.735326.04/0.7838DIV2K
SRFeat618932.27/0.893828.71/0.783527.64/0.7378-DIV2K
LatticeNet77732.30/0.896228.68/0.783027.62/0.736726.25/0.7873DIV2K
RDN-MetaSR-32.38/-28.78/-27.71/-26.55/-DIV2K
SCN120032.39/0.898128.74/0.786927.69/0.741526.50/0.8000DIV2K
SRFBN350032.46/0.896828.80/0.787627.71/0.742026.64/0.8033DIV2K+Flickr2K
EDSR4300032.46/0.896828.80/0.787627.71/0.742026.64/0.8033DIV2K
RDN2190032.47/0.899028.81/0.787127.72/0.741926.61/0.8028DIV2K
DBPN1000032.47/0.898028.82/0.786027.72/0.740026.38/0.7946DIV2K+Flickr2K
RNAN22532.49/0.898228.83/0.787827.72/0.742126.61/0.8023DIV2K
RDN-LIIF-32.50/-28.80/-27.74/-26.68/-DIV2K
OISR1559232.53/0.899228.86/0.787827.75/0.742826.79/0.8068DIV2K
ArbRCAN1660032.55/-28.87/-27.76/-26.68/-DIV2K
NLSN-32.59/0.900028.87/0.789127.78/0.744426.96/0.8109DIV2K
RCAN1600032.63/0.900228.87/0.788927.77/0.743626.82/0.8087DIV2K
SAN1570032.64/0.900328.92/0.788827.78/0.743626.79/0.8068DIV2K
HAN6419932.64/0.900228.90/0.789027.80/0.744226.85/0.8094DIV2K
IPT11500032.64/-29.01/-27.82/-27.26/-ImageNet
FAD-RCAN-32.65/0.900728.88/0.788927.78/0.743726.86/0.8092DIV2K
RFANet1100032.66/0.900428.88/0.789427.79/0.744226.92/0.8112DIV2K
CSNLN3000032.68/0.900428.95/0.788827.80/0.743927.12/0.8168DIV2K
CRAN1994032.72/0.901229.01/0.791827.86/0.746027.13/0.8167DIV2K
DRN980032.74/0.902028.98/0.792027.83/0.745027.03/0.8130DIV2K+Flickr2K
ELAN831232.75/0.902228.96/0.791427.83/0.745927.13/0.8167DIV2K
EBRN790032.79/0.903229.01/0.790327.85/0.746427.03/0.8114DIV2K
DFSA-32.79/0.901929.06/0.792227.87/0.745827.17/0.8163DIV2K+Flickr2K
SwinIR-LTE-32.81/-29.06/-27.86/-27.24/-DIV2K
SwinIR1180032.92/0.904429.09/0.795027.92/0.748927.45/0.8254DIV2K+Flickr2K
OmniSR79232.49/0.898828.78/0.785927.71/0.741526.64/0.8018DIV2K
ASSLN67732.29/0.896428.69/0.784427.66/0.738426.27/0.7907DIV2K+Flickr2K
SPSR-31.04/0.877227.07/0.807626.05/0.681825.23.0.9531DIV2K
DLGSANet76132.54/0.899328.84/0.787127.73/0.741526.66/0.8033DIV2K
CRAFT75332.52/0.898928.85/0.787227.72/0.741826.56/0.7995DIV2K
SRFormer87332.51/0.898828.82/0.787227.73/0.742226.67/0.8032DIV2K
WGSR-31.51/0.869026.69/0.716026.37/0.684025.61/0.7770DIV2K
EQSR-32.71/-29.12/-27.86/-27.30/-DIV2K+Flickr2K
HAT2080033.04/0.905629.23/0.797328.00/0.751727.97/0.8368DIV2K+Flickr2K
DAT1121233.08/0.905529.23/0.797328.00/0.751527.87/0.8343DIV2K+Flickr2K
SAFMN24032.18/0.894828.60/0.781327.58/0.735925.97/0.7809DIV2K+Flickr2K
CFAT2207033.19/ 0.906829.30/0.798528.17/0.752428.11/0.8380DIV2K+Flickr2K

:heavy_exclamation_mark: Video Super-Resolution (VSR)

We categorize the SISR into TWO types, Regression-Based Models and Generative-Based Models, for their purpose.

:boom: Datasets
:one: REDS
:two: Video-90K
:three: Vid4
:four: UDM10
:five: UDF
:six: SPMC

:dart: Experimental Results on X4 Task

ModelParams (M)Vid4Video-90KREDSTraining Set/s
Bicubic-23.78/0.634731.32/0.868423.72/0.7559-
VESPCN-25.35/0.7557-/-24.93/0.8107CDVL
FRVSR5.126.69/0.8220-/-25.27/0.8256Vimeo-90K
SPMC-25.88/0.7752-/--/-SPMCS
DUF5.827.33/0.831936.37/0.938728.63/0.8251DUF
RBPN12.227.12/0.818037.07/0.943525.17/0.8187Vimeo-90K
PFNL3.026.73/0.802936.14/0.936329.63/0.8502UDM10
VSR_TGA-27.59/0.8419-/--/-Vimeo-90K
MuCAN--/-37.32/0.946530.88/0.8750REDS+Vimeo-90K
RSDN6.227.79/0.847437.05/0.9454-/-Vimeo-90K
BasicVSR6.327.24/0.825137.18/0.945031.42/0.8909REDS+Vimeo-90K
IconVSR8.727.39/0.8827937.47/0.947631.67/0.8948REDS+Vimeo-90K
DSMC--/--/-25.73/0.8428REDS
VSRT32.627.36/0.825837.71/0.949425.73/0.8428REDS+Vimeo-90K
VRT35.627.93/0.842538.20/0.953025.73/0.8428REDS
TOFlow1.425.89/0.765133.08/0.905427.98/0.7990Vimeo-90K
DNSTNet-27.21/0.822036.86/0.9387-Vimeo-90K
SATeCo-27.44/0.842038.22/0.953231.62/0.8932Vimeo-90K
MIAVSR6.3528.20/0.850738.22/0.953230.46/-REDS+Vimeo-90K
VideoGigaGAN36926.78/-35.97/-32.78/0.9220REDS+Vimeo-90K
FTVSR++10.828.80/0.8680-32.42/0.9070REDS+Vimeo-90K
MFPI7.328.11/0.848138.28/0.953432.81/0.9106REDS+Vimeo-90K
RVRT10.827.99/0.846238.15/0.952732.75/0.9113REDS+Vimeo-90K

:heavy_exclamation_mark: Stereo Super-Resolution (SSR)

We categorize the SSR into TWO types, Regression-Based Models and Generative-Based Models, for their purpose.

:boom: Datasets
:one: Middlebury
:two: Tsukuba
:three: KITTI 2012
:four: KITTI 2015
:five: Flickr1024

:dart: Experimental Results on X4 Task

ModelParams (M)KITTI2015KITTI2012MiddleburyTraining Set/s
Bicubic-23.90/0.710024.64/0.733426.39/0.7564-
StereoSR1.0625.12/0.767925.94/0.783928.24/0.8133Middlebury+KITTI+Tsukuba
PASSRnet1.3525.34/0.772226.18/0.787428.36/0.8153Middlebury+Flickr1024
DASSR1.125.35/0.874026.96/0.882029.83/0.9090Flickr1024
SRRes+SAM1.7325.55/0.782526.35/0.795728.76/0.8287Flickr1024
CPASSRNet42.3925.12/0.769325.31/0.771228.31/0.8194Middlebury
iPASSR1.4225.61/0.785026.47/0.799329.07/0.8363Middlebury+Flickr1024
SSRDE-FNet2.2425.74/0.788426.61/0.802829.29/0.8407Flickr1024
IMSSRnet6.8925.59/-26.44/-29.02/-Middlebury+Flickr1024
CVCNet0.9925.55/0.780126.35/0.793528.65/0.8231Flickr1024
PFT-SSR-25.76/0.777526.64/0.791329.58/0.8418Flickr1024+Middlebury
LSSR1.1126.12/0.799726.93/0.809729.86/0.8489Flickr1024+Middlebury
SCGLANet25.2926.94/0.826827.10/0.820430.23/0.8628Flickr1024+Middlebury
MSSFNet1.8226.07/0.799026.88/0.809829.67/0.8498Flickr1024+Middlebury
Steformer1.3425.74/0.790626.61/0.803729.29/0.8424Flickr1024

:heavy_exclamation_mark: Light Field Super-Resolution (LFSR)

We categorize the LFSR into TWO types, Regression-Based Models and Generative-Based Models, for their purpose.

:boom: Datasets
:one: EPFL
:two: HCInew
:three: HCIold
:four: INRIA | Code:pkyv
:five: STFgantry | Code:qjwv

:dart: Experimental Results on X4 Task

ModelParams (M)EPFLHCInewHCIoldINRIASTFgantry
Bicubic-25.14/0.831127.61/0.850732.42/0.933526.82/0.886025.93/0.8431
VDSR0.6727.25/0.878229.31/0.882834.81/0.951829.19/0.920828.51/0.9012
EDSR1227.84/0.885829.60/0.887435.18/0.953829.66/0.925928.70/0.9075
RCAN2527.88/0.886329.63/0.888035.20/0.954029.76/0.927328.90/0.9110
resLF6.7927.46/0.889929.92/0.901136.12/0.965129.64/0.933928.99/0.9214
LFSSR1.1628.27/0.908030.72/0.912436.70/0.969030.31/0.944630.15/0.9385
LF-ATO1.3628.25/0.912030.88/0.914037.00/0.970030.71/0.949030.61/0.9430
MEG-Net1.7728.74/0.916031.10/0.918037.28/0.972030.66/0.949030.77/0.9450
LF-InterNet5.2328.67/0.914330.98/0.916537.11/0.971530.64/0.948630.53/0.9426
LF-IINet4.8929.11/0.920031.36/0.921037.62/0.974031.08/0.952031.21/0.9500
LF-DFnet3.9928.77/0.916531.23/0.919637.32/0.971830.83/0.950331.15/0.9494
DPT3.7828.93/0.916731.19/0.918637.39/0.972030.96/0.950231.14/0.9487
LFT1.1629.25/0.921031.46/0.922037.63/0.974031.20/0.952031.86/0.9550
DistgSSR3.5828.98/0.919031.38/0.922037.55/0.973030.99/0.952031.63/0.9530
EPIT1.4729.34/0.919731.51/0.923137.68/0.973731.37/0.952632.18/0.9571
LFSAV1.5429.37/0.922331.45/0.921737.50/0.972131.27/0.953131.36/0.9505