SketchEdit: Mask-Free Local Image Manipulation with Partial Sketches

SketchEdit: Mask-Free Local Image Manipulation with Partial Sketches

[Paper]  [Project Page]  [Interactive Demo]  [Supplementary Material]

Usage

environment

The code only has been tested on Ubuntu 20.04.

GPU is required.

0. Clone the repo:

git clone --single-branch https://github.com/zengxianyu/sketchedit
git submodule init
git submodule update

1. Install using the provided docker file Dockerfile or

conda env create -f environment.yml

2. Switch to the installed environment

conda activate editline

Testing

0. Download pretrained model

chmod +x download/*
./download/download_model.sh

1. Use the model trained on CelebAHQ

./test_celeb.sh

2. Use the model trained on Places

./test_places.sh

Interactive demo

http://47.57.135.203:8001/

Training code and data

Training code and data will be released after the paper is published.

Acknowledgments

• DeepFill https://github.com/jiahuiyu/generative_inpainting
• Pix2PixHD https://github.com/NVIDIA/pix2pixHD
• SPADE https://github.com/NVlabs/SPADE