Deep learning MEMC framing paper list

Sort out the list of papers on deep learning for motion estimation and motion compensation . Roughly according to the content and time . In view of the heavy workload , and MEMC The number of hits is very small , Don't introduce the content of the article .
Be original ：https://blog.csdn.net/longshaonihaoa/article/details/125953575

1、 Optical flow estimation algorithm

This kind of algorithm only estimates optical flow , No subsequent processing .
1.1 FlowNet（ICCV 2015）
lowNet: Learning Optical Flow with Convolutional Networks（ Cited 2700+）
On ⽂ Address ：https://arxiv.org/abs/1504.06852v2
You know ： https://zhuanlan.zhihu.com/p/37736910

1.2 FlowNet2.0（CVPR2017）
FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networks
On ⽂ Address ：https://arxiv.org/abs/1612.01925

1.3 Spynet（CVPR2017）
Optical Flow Estimation Using a Spatial Pyramid Network （ Cited 688）
On ⽂ https://arxiv.org/abs/1611.00850
Code https://github.com/sniklaus/pytorch-spynet/blob/master/run.py
detailed ⻅ https://blog.csdn.net/u010087277/article/details/111593541

1.4 PWCNet（NVIDIA,2018）
On ⽂ Address ：https://arxiv.org/abs/1709.02371
⼯ Program code ：https://github.com/NVlabs/PWC-Net
Introduce ：https://blog.csdn.net/u012348774/article/details/112123638

1.5 LiteFlownet(CVPR2018) https://openaccess.thecvf.com/content_cvpr_2018/papers/Hui_LiteFlowNet_A_Lightweigh t_CVPR_2018_paper.pdf ( Cited 437)
Tangxiaoou ⼤ Guy's lab

1.6 IRR-PWC（CVPR2019）
Iterative Residual Refinement for Joint Optical Flow and Occlusion Estimation（ Cited 137）
On ⽂ https://arxiv.org/pdf/1904.05290.pdf

1.7 MaskFlownet(CVPR2020 oral)
Maskflownet: Asymmetric feature matching with learnable occlusion mask ( Cited 70+)
Microsoft research Asia

1.8 RAFT（ECCV 2020 best paper)
On ⽂ Address ：https://arxiv.org/pdf/2003.12039.pdf
⼯ Program code ：https://github.com/princeton-vl/RAFT

2、 Video frame insertion algorithm based on optical flow

2.1 Super SloMo（2018）
⼯ Program code ：https://github.com/avinashpaliwal/Super-SloMo（ Original theory ⽂ Not open source ）
On ⽂ Address ：https://arxiv.org/abs/1712.00080

2.2 MEMC-Net （TPAMI19）
Memc-net: Motion estimation and motion compensation driven neural network for video interpolation and enhancement Cited 157
On ⽂ https://arxiv.org/pdf/1810.08768.pdf
Code https://github.com/baowenbo/MEMC-Net
Explain https://zhuanlan.zhihu.com/p/120810121

2.3 DAIN（2019）
⼯ Program code ：https://github.com/baowenbo/DAIN（ Open source ）
On ⽂ Address ：https://arxiv.org/pdf/1904.00830.pdf

2.4 ToFlow（IJCV2019）
Video Enhancement with Task-Oriented Flow（ Cited 520+）
On ⽂ https://arxiv.org/pdf/1711.09078.pdf

2.5 QVI（NeurIPS 2019 Spotlight）
Quadratic Video Interpolation
On ⽂ https://arxiv.org/pdf/1911.00627.pdf
Explain https://www.sohu.com/a/361120785_99963310
lead ⼊ Acceleration concept , solve ⾮ Linear motion ME Inaccurate questions .

2.6 SoftSplat（CVPR 2020）
Softmax Splatting for Video Frame Interpolation
On ⽂ https://arxiv.org/pdf/2003.05534.pdf
Code https://github.com/JHLew/SoftSplat-Full
Explain https://www.p-chao.com/2020-03-22/%E8%A7%86%E9%A2%91%E5%B8%A7%E9%97%B 4%E6%8F%92%E5%80%BC%EF%BC%88%E4%B8%80%EF%BC%89softmax-splatting-for-video -frame-interpolation/

2.7 BMBC（ECCV2020）
BMBC:Bilateral Motion Estimation with Bilateral Cost Volume for Video Interpolation
On ⽂ https://arxiv.org/pdf/2007.12622.pdf
translate https://blog.csdn.net/hahameier/article/details/110732069

2.8 RIFE（ECCV 2022）
Real-Time Intermediate Flow Estimation for Video Frame Interpolation
⼯ Program code ：https://github.com/hzwer/arXiv2020-RIFE
On ⽂ Address ：https://arxiv.org/pdf/2011.06294.pdf

2.9 ABME（ICCV2021）
Asymmetric Bilateral Motion Estimation for Video Frame Interpolation
On ⽂ https://arxiv.org/pdf/2108.06815.pdf
brief introduction https://hub.baai.ac.cn/view/9262

2.10 XVFI（ICCV 2021 oral）
⼯ Program code ：https://github.com/JihyongOh/XVFI（ Open source ）
On ⽂ Address ：https://arxiv.org/pdf/2103.16206.pdf

2.11 ST-MFNet（CVPR2022）
ST-MFNet: A Spatio-Temporal Multi-Flow Network for Frame Interpolation
On ⽂ https://arxiv.org/pdf/2111.15483.pdf

2.12 M2M（CVPR 2022）
Many-to-many Splatting for Efficient Video Frame Interpolation
On ⽂ https://arxiv.org/pdf/2204.03513.pdf
Splatting Explain ：https://baike.baidu.com/item/%E6%8A%9B%E9%9B%AA%E7%90%83%E6%B3%95/7 658460

3、 Video frame insertion algorithm independent of optical flow

3.1 DVF（ICCV2017 oral）
Video Frame Synthesis using Deep Voxel Flow （ Cited 500+）
The paper https://openaccess.thecvf.com/content_ICCV_2017/papers/Liu_Video_Frame_Synthesis_IC CV_2017_paper.pdf
Code https://github.com/liuziwei7/voxel-flow

3.2 CAIN（AAAI 2020）
Channel Attention Is All You Need for Video Frame Interpolation （ Cited 75）
⼯ Program code ：https://github.com/myungsub/CAIN
On ⽂ Address ：https://ojs.aaai.org/index.php/AAAI/article/download/6693/6547

3.3 FLAVR（CVPR 2021）
⼯ Program code ：https://github.com/tarun005/FLAVR
On ⽂ Address ：https://www.dropbox.com/s/b62wnroqdd5lhfc/AAAI-ChoiM.4773.pdf?dl=0

4、 Based on kernel estimation ⽅ Law

4.1 AdaConv(ICCV 2017)
Video Frame Interpolation via Adaptive Convolution （Niklaus Cited 350）
On ⽂ https://openaccess.thecvf.com/content_cvpr_2017/papers/Niklaus_Video_Frame_Interpol ation_CVPR_2017_paper.pdf

4.2 SepConv(CVPR 2017)
Video Frame Interpolation via Adaptive Separable Convolution （Niklaus Cited 488）
On ⽂ https://openaccess.thecvf.com/content_ICCV_2017/papers/Niklaus_Video_Frame_Interpol ation_ICCV_2017_paper.pdf

4.3 CyclicGen（AAAI2019）
Deep Video Frame Interpolation using Cyclic Frame Generation
On ⽂ https://www.csie.ntu.edu.tw/~cyy/publications/papers/Liu2019DVF.pdf

4.4 AdaCoF（CVPR2020）
AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolation（ Cited 100+）
On ⽂ https://openaccess.thecvf.com/content_CVPR_2020/papers/Lee_AdaCoF_Adaptive_Collab oration_of_Flows_for_Video_Frame_Interpolation_CVPR_2020_paper.pdf
Simple explanation https://its301.com/article/shengshibo_/121325026

4.5 CDFI（CVPR2021）
CDFI: Compression-Driven Network Design for Frame Interpolation
On ⽂ https://openaccess.thecvf.com/content/CVPR2021/papers/Ding_CDFI_Compression-Driven _Network_Design_for_Frame_Interpolation_CVPR_2021_paper.pdf
The author is ⻚ Tianyu Ding’s Homepage
The author explains https://zhuanlan.zhihu.com/p/438912570

4.6 EDSC（TPAMI 2021）
Multiple Video Frame Interpolation via Enhanced Deformable Separable Convolution （ Cited 20）
On ⽂ https://arxiv.org/pdf/2006.08070.pdf
Code https://github.com/Xianhang/EDSC-pytorch

5、 Video frame insertion based on phase ⽅ Law

5.1 Phase（CVPR 2015）
Phase-Based Frame Interpolation for Video
On ⽂ https://www.cv-foundation.org/openaccess/content_cvpr_2015/papers/Meyer_Phase-Bas ed_Frame_Interpolation_2015_CVPR_paper.pdf
Code ⻅ https://github.com/owang/PhaseBasedInterpolation

6、 Other weird

6.1 Time Lens
Time Lens: Event-based Video Frame Interpolation
On ⽂ https://openaccess.thecvf.com/content/CVPR2021/papers/Tulyakov_Time_Lens_Event-Bas ed_Video_Frame_Interpolation_CVPR_2021_paper.pdf
send ⽤ Event camera , Amalgamation event and Optical flow Into the ⾏ Inset frame

6.2 Time Lens++（CVPR 2022）
Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fus
On ⽂ https://arxiv.org/pdf/2203.17191.pdf

6.3 AIM 2019 （ICCVw 2019）
AIM 2019 Challenge on Video Temporal Super-Resolution: Methods and Results
On ⽂ https://arxiv.org/pdf/2005.01233.pdf