Progressive Image Reconstruction Network With Edge and Color Domain

When I was a schoolchild,

I dreamed about becoming a painter.

With PI-REC, we realize it nowadays.

For you, for everyone.

English | 中文版

We propose a universal image reconstruction method to represent detailed images purely from binary sparse edge and flat color domain. Here is the open source code and the drawing tool.
*The codes of training for release are no completed yet, also waiting for release license of lab.

Find more details in our paper: Paper on arXiv

• Figure (a): Image reconstruction from extreme sparse inputs.
  
• Figure (b): Hand drawn draft translation.
  
• Figure (c): User-defined edge-to-image (E2I) translation.
  

We strongly recommend you to understand our model architecture before running our drawing tool. Refer to the paper for more details.

• Python 3+
• PyTorch 1.0 (0.4 is not supported)
• NVIDIA GPU + CUDA cuDNN

• Clone this repo
• Install PyTorch and dependencies from http://pytorch.org
• Install python requirements:

pip install -r requirements.txt

• Basic command line mode for batch test
• Drawing tool GUI mode for creation

Firstly, follow steps below to prepare pre-trained models with patience:

1. Download the pre-trained models you want here: Google Drive | Baidu (Extraction Code: 9qn1)
2. Unzip the .7z and put it under your dir ./models/.
   So make sure your path now is: ./models/celeba/<xxxxx.pth>
3. Complete the above Prerequisites and Installation

自己看上面的咯~

我们提出了一种基于GAN的渐进式训练方法 PI-REC，能从超稀疏二值边缘以及色块中还原重建真实图像。 这属于图像重建，图像翻译，条件图像生成，AI自动绘画的前沿交叉领域，而非简单的以图搜图。更多相关可以阅读论文里的 Related Work。
这里包含了测试代码以及交互式绘画工具。
*由于训练过程过于复杂，用于训练的发布版代码还未完成

在我们的论文中你可以获得更多信息(强烈推荐阅读): Paper on arXiv

• Figure (a): 超稀疏输入信息重建原图。
  
• Figure (b): 手绘草图转换。
  
• Figure (c): 用户自定义的 edge-to-image (E2I) 转换.
  

我们强烈建议你先仔细阅读论文熟悉我们的模型结构，对运行使用大有裨益。

• Python 3
• PyTorch 1.0 (0.4 会报错)
• NVIDIA GPU + CUDA cuDNN （当前版本已可选cpu，请修改config.yml中的DEVICE）

• Clone this repo
• 安装PyTorch和torchvision --> http://pytorch.org
• 安装 python requirements:

pip install -r requirements.txt

• 基础命令行模式 用来批处理测试整个文件夹的图片
• 绘画GUI工具模式 用来创作

首先，请耐心地按照以下步骤做准备：

1. 在这里下载你想要的预训练模型文件：Google Drive | Baidu (提取码: 9qn1)
2. 解压，放到目录./models下
   现在你的目录应该像这样： ./models/celeba/<xxxxx.pth>
3. 完成上面的基础环境和第三方库安装

Code structure is modified from Anime-InPainting, which is based on Edge-Connect.

@article{you2019pirec,
  title={PI-REC: Progressive Image Reconstruction Network With Edge and Color Domain},
  author={You, Sheng and You, Ning and Pan, Minxue},
  journal={arXiv preprint arXiv:1903.10146},
  year={2019}
}