SplitSR

January 24, 2021 ยท View on GitHub

Unofficial implementation of SplitSR: An End-to-End Approach to Super-Resolution on Mobile Devices

a) SplitSRBlock, b) SplitSR

Keys from the Paper

  • Split convolution splits input by alpha ratio along depth channel.
  • The conv-processed part is concatenated at the end.
  • By the second key point, every channel would be processed after 1/ฮฑ blocks.
  • The theoretical computation reduction that can be obtained by using SplitSR is ๐›ผ^2, where ๐›ผ โˆˆ (0, 1]
  • The architecture is very much similar to RCAN's, by replacing channelwise attention blocks with split convolutions.
  • Many proposed details are ambiguous. We've to guess.

Config

  • ๐›ผ = 0.250
  • Groups = 6, Blocks = 6
  • Hybrid Index = 3
  • Loss - L1
  • Base LR - 1e-4
  • LR Decay - 2.0 every 2 ร— 10210^{2}
  • Adam, ๐›ฝ1 = 0.9, ๐›ฝ2 = 0.999
  • ๐œ– = 1eโˆ’7
  • Steps = 6 ร— 10510^{5}

Progress

  • Splitted Convolution Block is done.
  • Residual Block is done.
  • Mean shift layer is done.
  • Beta version of model is ready.