Swin, three degrees! Eth open source VRT: a transformer that refreshes multi domain indicators of video restoration

Thesis link ：https://arxiv.org/abs/2201.12288

Code link ：https://github.com/JingyunLiang/VRT

 

stay Swin Transformer+Image Restoration The combination aspect tasted “ benefit ” after ,SwinIR The author of the book aims at 3D Version combination ：Video Swin Transformer + Video Restoration, Once again, it refreshes many fields of video restoration “ Height ”.

The figure above shows the VRT Overall architecture diagram ( notes ： The above figure is only a schematic diagram of the core part , There is also a preprocessing part of optical flow alignment which is not shown , At the same time, the visualization part in the above figure is 2D form , But the reality is 3D form ).VRT It can be divided into two parts: feature extraction and image reconstruction .