GFPGAN (CVPR 2021)
Paper | Project Page English | 简体中文
GFPGAN is a blind face restoration algorithm towards real-world face images.
📖
GFP-GAN: Towards Real-World Blind Face Restoration with Generative Facial Prior
[Paper] [Project Page] [Demo]
Xintao Wang, Yu Li, Honglun Zhang, Ying Shan
Applied Research Center (ARC), Tencent PCG
Abstract
Blind face restoration usually relies on facial priors, such as facial geometry prior or reference prior, to restore realistic and faithful details. However, very low-quality inputs cannot offer accurate geometric prior while high-quality references are inaccessible, limiting the applicability in real-world scenarios. In this work, we propose GFP-GAN that leverages rich and diverse priors encapsulated in a pretrained face GAN for blind face restoration. This Generative Facial Prior (GFP) is incorporated into the face restoration process via novel channel-split spatial feature transform layers, which allow our method to achieve a good balance of realness and fidelity. Thanks to the powerful generative facial prior and delicate designs, our GFP-GAN could jointly restore facial details and enhance colors with just a single forward pass, while GAN inversion methods require expensive image-specific optimization at inference. Extensive experiments show that our method achieves superior performance to prior art on both synthetic and real-world datasets.
BibTeX
@InProceedings{wang2021gfpgan,
author = {Xintao Wang and Yu Li and Honglun Zhang and Ying Shan},
title = {Towards Real-World Blind Face Restoration with Generative Facial Prior},
booktitle={The IEEE Conference on Computer Vision and Pattern Recognition (CVPR)},
year = {2021}
}
🔧
Dependencies and Installation
- Python >= 3.7 (Recommend to use Anaconda or Miniconda)
- PyTorch >= 1.7
- NVIDIA GPU + CUDA
Installation
-
Clone repo
git clone https://github.com/xinntao/GFPGAN.git cd GFPGAN -
Install dependent packages
# Install basicsr - https://github.com/xinntao/BasicSR # We use BasicSR for both training and inference # Set BASICSR_EXT=True to compile the cuda extensions in the BasicSR - It may take several minutes to compile, please be patient BASICSR_EXT=True pip install basicsr # Install facexlib - https://github.com/xinntao/facexlib # We use face detection and face restoration helper in the facexlib package pip install facexlib pip install -r requirements.txt
⚡
Quick Inference
Download pre-trained models: GFPGANv1.pth
wget https://github.com/TencentARC/GFPGAN/releases/download/v0.1.0/GFPGANv1.pth -P experiments/pretrained_models
python inference_gfpgan_full.py --model_path experiments/pretrained_models/GFPGANv1.pth --test_path inputs/whole_imgs
# for aligned images
python inference_gfpgan_full.py --model_path experiments/pretrained_models/GFPGANv1.pth --test_path inputs/cropped_faces --aligned
💻
Training
We provide complete training codes for GFPGAN.
You could improve it according to your own needs.
-
Dataset preparation: FFHQ
-
Download pre-trained models and other data. Put them in the
experiments/pretrained_modelsfolder. -
Modify the configuration file
train_gfpgan_v1.ymlaccordingly. -
Training
python -m torch.distributed.launch --nproc_per_node=4 --master_port=22021 train.py -opt train_gfpgan_v1.yml --launcher pytorch
📜
License and Acknowledgement
GFPGAN is realeased under Apache License Version 2.0.
📧
Contact
If you have any question, please email [email protected] or [email protected].
gpu看情况是进入训练状态的。
ps：之前复现您的BasicSR中的esrgan也是类似情况
torch.config.show()
'PyTorch built with:\n - GCC 7.3\n - C++ Version: 201402\n
and also,When i want to reinstall basicsr,I find i can't install it with this error
248 Sep 02, 2022
1.4k Dec 30, 2022
326 Nov 09, 2022
852 Dec 02, 2022
2.8k Dec 29, 2022
61 Dec 18, 2022
1.2k Dec 29, 2022
2.5k Jan 01, 2023
62 Nov 18, 2022
0 Jan 10, 2022
7k Jan 07, 2023
3.4k Dec 31, 2022
50 Nov 29, 2022
462 Jan 02, 2023
1.1k Dec 31, 2022
279 Jan 05, 2023
236 Dec 15, 2022
144 Dec 13, 2022