PyTorch Implementation of AnimeGANv2

Last update: Jan 07, 2023

Overview

PyTorch Implementation of AnimeGANv2

Updates

2021-10-17 Add weights for FacePortraitV2
2021-11-07 Thanks to ak92501, a web demo is integrated to Huggingface Spaces with Gradio.

See demo:
2021-11-07 Thanks to xhlulu, the torch.hub model is now available. See Torch Hub Usage.
2021-11-07 Add FacePortraitV2 style demo to a telegram bot. See @face2stickerbot by sxela

Basic Usage

Weight Conversion from the Original Repo (Requires TensorFlow 1.x)

git clone https://github.com/TachibanaYoshino/AnimeGANv2
python convert_weights.py

Inference

python test.py --input_dir [image_folder_path] --device [cpu/cuda]

Results from converted [Paprika] style model

(input image, original tensorflow result, pytorch result from left to right)

Note: Training code not included / Results from converted weights slightly different due to the bilinear upsample issue

Additional Model Weights

Webtoon Face [ckpt]

samples

Trained on 256x256 face images. Distilled from webtoon face model with L2 + VGG + GAN Loss and CelebA-HQ images. See test_faces.ipynb for details.

Face Portrait v1 [ckpt]

samples

Trained on 512x512 face images.

📺

Face Portrait v2 [ckpt]

samples

Trained on 512x512 face images. Compared to v1, 🔻beautify 🔺robustness

🦑 🎮 🔥

Torch Hub Usage

You can load Animegan v2 via torch.hub:

import torch
model = torch.hub.load('bryandlee/animegan2-pytorch', 'generator').eval()
# convert your image into tensor here
out = model(img_tensor)

You can load with various configs (more details in the torch docs):

model = torch.hub.load(
    "bryandlee/animegan2-pytorch:main",
    "generator",
    pretrained=True, # or give URL to a pretrained model
    device="cuda", # or "cpu" if you don't have a GPU
    progress=True, # show progress
)

Currently, the following pretrained shorthands are available:

model = torch.hub.load("bryandlee/animegan2-pytorch:main", "generator", pretrained="celeba_distill")
model = torch.hub.load("bryandlee/animegan2-pytorch:main", "generator", pretrained="face_paint_512_v1")
model = torch.hub.load("bryandlee/animegan2-pytorch:main", "generator", pretrained="face_paint_512_v2")
model = torch.hub.load("bryandlee/animegan2-pytorch:main", "generator", pretrained="paprika")

You can also load the face2paint util function. First, install dependencies:

pip install torchvision Pillow numpy

Then, import the function using torch.hub:

face2paint = torch.hub.load(
    'bryandlee/animegan2-pytorch:main', 'face2paint', 
    size=512, device="cpu"
)

img = Image.open(...).convert("RGB")
out = face2paint(model, img)

PyTorch Implementation of AnimeGANv2

Related tags

Overview

PyTorch Implementation of AnimeGANv2

Basic Usage

Additional Model Weights

Torch Hub Usage

Owner

3D ResNet Video Classification accelerated by TensorRT

DIT is a DTLS MitM proxy implemented in Python 3. It can intercept, manipulate and suppress datagrams between two DTLS endpoints and supports psk-based and certificate-based authentication schemes (RSA + ECC).

Code for "Learning From Multiple Experts: Self-paced Knowledge Distillation for Long-tailed Classification", ECCV 2020 Spotlight

The Pytorch code of "Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification", CVPR 2022 (Oral).

Official code release for: EditGAN: High-Precision Semantic Image Editing

My course projects for the 2021 Spring Machine Learning course at the National Taiwan University (NTU)

Low-code/No-code approach for deep learning inference on devices

'Aligned mixture of latent dynamical systems' (amLDS) for stimulus decoding probabilistic manifold alignment across animals. P. Herrero-Vidal et al. NeurIPS 2021 code.

Artificial intelligence technology inferring issues and logically supporting facts from raw text

Deep-Learning-Image-Captioning - Implementing convolutional and recurrent neural networks in Keras to generate sentence descriptions of images

Constrained Logistic Regression - How to apply specific constraints to logistic regression's coefficients

Elevation Mapping on GPU.

Quantization library for PyTorch. Support low-precision and mixed-precision quantization, with hardware implementation through TVM.

VIsually-Pivoted Audio and(N) Text

Food Drinks and groceries Images Multi Lingual (FooDI-ML) dataset.

50-days-of-Statistics-for-Data-Science - This repository consist of a 50-day program

Collection of sports betting AI tools.

A neuroanatomy-based augmented reality experience powered by computer vision. Features 3D visuals of the Atlas Brain Map slices.

CARLA: A Python Library to Benchmark Algorithmic Recourse and Counterfactual Explanation Algorithms

[NeurIPS 2020] This project provides a strong single-stage baseline for Long-Tailed Classification, Detection, and Instance Segmentation (LVIS).