PyTorch Implementation of AnimeGANv2

Last update: Jan 07, 2023

Overview

PyTorch Implementation of AnimeGANv2

Updates

2021-10-17 Add weights for FacePortraitV2
2021-11-07 Thanks to ak92501, a web demo is integrated to Huggingface Spaces with Gradio.

See demo:
2021-11-07 Thanks to xhlulu, the torch.hub model is now available. See Torch Hub Usage.
2021-11-07 Add FacePortraitV2 style demo to a telegram bot. See @face2stickerbot by sxela

Basic Usage

Weight Conversion from the Original Repo (Requires TensorFlow 1.x)

git clone https://github.com/TachibanaYoshino/AnimeGANv2
python convert_weights.py

Inference

python test.py --input_dir [image_folder_path] --device [cpu/cuda]

Results from converted [Paprika] style model

(input image, original tensorflow result, pytorch result from left to right)

Note: Training code not included / Results from converted weights slightly different due to the bilinear upsample issue

Additional Model Weights

Webtoon Face [ckpt]

samples

Trained on 256x256 face images. Distilled from webtoon face model with L2 + VGG + GAN Loss and CelebA-HQ images. See test_faces.ipynb for details.

Face Portrait v1 [ckpt]

samples

Trained on 512x512 face images.

📺

Face Portrait v2 [ckpt]

samples

Trained on 512x512 face images. Compared to v1, 🔻beautify 🔺robustness

🦑 🎮 🔥

Torch Hub Usage

You can load Animegan v2 via torch.hub:

import torch
model = torch.hub.load('bryandlee/animegan2-pytorch', 'generator').eval()
# convert your image into tensor here
out = model(img_tensor)

You can load with various configs (more details in the torch docs):

model = torch.hub.load(
    "bryandlee/animegan2-pytorch:main",
    "generator",
    pretrained=True, # or give URL to a pretrained model
    device="cuda", # or "cpu" if you don't have a GPU
    progress=True, # show progress
)

Currently, the following pretrained shorthands are available:

model = torch.hub.load("bryandlee/animegan2-pytorch:main", "generator", pretrained="celeba_distill")
model = torch.hub.load("bryandlee/animegan2-pytorch:main", "generator", pretrained="face_paint_512_v1")
model = torch.hub.load("bryandlee/animegan2-pytorch:main", "generator", pretrained="face_paint_512_v2")
model = torch.hub.load("bryandlee/animegan2-pytorch:main", "generator", pretrained="paprika")

You can also load the face2paint util function. First, install dependencies:

pip install torchvision Pillow numpy

Then, import the function using torch.hub:

face2paint = torch.hub.load(
    'bryandlee/animegan2-pytorch:main', 'face2paint', 
    size=512, device="cpu"
)

img = Image.open(...).convert("RGB")
out = face2paint(model, img)

PyTorch Implementation of AnimeGANv2

Related tags

Overview

PyTorch Implementation of AnimeGANv2

Basic Usage

Additional Model Weights

Torch Hub Usage

Owner

Code for HodgeNet: Learning Spectral Geometry on Triangle Meshes, in SIGGRAPH 2021.

SoK: Vehicle Orientation Representations for Deep Rotation Estimation

KeypointDeformer: Unsupervised 3D Keypoint Discovery for Shape Control

Python implementation of NARS (Non-Axiomatic-Reasoning-System)

Pytorch implementation of Implicit Behavior Cloning.

Malmo Collaborative AI Challenge - Team Pig Catcher

Official Code for AdvRush: Searching for Adversarially Robust Neural Architectures (ICCV '21)

A multi-functional library for full-stack Deep Learning. Simplifies Model Building, API development, and Model Deployment.

Machine learning framework for both deep learning and traditional algorithms

Official source code of paper 'IterMVS: Iterative Probability Estimation for Efficient Multi-View Stereo'

python debugger and anti-vm that checks if you're in a virtual machine or if someones trying to debug your file

Development kit for MIT Scene Parsing Benchmark

Food Drinks and groceries Images Multi Lingual (FooDI-ML) dataset.

Source Code of NeurIPS21 paper: Recognizing Vector Graphics without Rasterization

PyTorch code to run synthetic experiments.

Script that attempts to force M1 macs into RGB mode when used with monitors that are defaulting to YPbPr.

In Search of Probeable Generalization Measures

[Link]mareteutral - pars tradg wth M []

Code for the Population-Based Bandits Algorithm, presented at NeurIPS 2020.

Inverse Rendering for Complex Indoor Scenes: Shape, Spatially-Varying Lighting and SVBRDF From a Single Image