Table of Contents
Shortcuts

图像修复

概览

  • 预训练权重个数: 9

  • 配置文件个数: 0

  • 论文个数: 5

    • ALGORITHM: 5

AOT-GAN (TVCG’2021)

任务: 图像修复

摘要

结果与模型

Places365-Challenge

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
AOT-GAN free-form (50-60%) 512x512 500k Places365-val 7.07 19.01 0.682 4 (GeForce GTX 1080 Ti) 模型 | 日志
评估指标 掩膜缺损 论文结果 复现结果
L1 (10^-2) 1 – 10% 0.55 0.54
(lower better) 10 – 20% 1.19 1.47
20 – 30% 2.11 2.79
30 – 40% 3.20 4.38
40 – 50% 4.51 6.28
50 – 60% 7.07 10.16
PSNR 1 – 10% 34.79 inf
(higher better) 10 – 20% 29.49 31.22
20 – 30% 26.03 27.65
30 – 40% 23.58 25.06
40 – 50% 21.65 23.01
50 – 60% 19.01 20.05
SSIM 1 – 10% 0.976 0.982
(higher better) 10 – 20% 0.940 0.951
20 – 30% 0.890 0.911
30 – 40% 0.835 0.866
40 – 50% 0.773 0.815
50 – 60% 0.682 0.739

快速开始

训练

训练说明

您可以使用以下命令来训练模型。

## CPU上训练
CUDA_VISIBLE_DEVICES=-1 python tools/train.py configs/aot_gan/aot-gan_smpgan_4xb4_places-512x512.py

## 单个GPU上训练
python tools/train.py configs/aot_gan/aot-gan_smpgan_4xb4_places-512x512.py

## 多个GPU上训练
./tools/dist_train.sh configs/aot_gan/aot-gan_smpgan_4xb4_places-512x512.py 8

更多细节可以参考 train_test.md 中的 Train a model 部分。

测试

测试说明

您可以使用以下命令来测试模型。

## CPU上测试
CUDA_VISIBLE_DEVICES=-1 python tools/test.py configs/aot_gan/aot-gan_smpgan_4xb4_places-512x512.py https://download.openmmlab.com/mmediting/inpainting/aot_gan/AOT-GAN_512x512_4x12_places_20220509-6641441b.pth

## 单个GPU上测试
python tools/test.py configs/aot_gan/aot-gan_smpgan_4xb4_places-512x512.py https://download.openmmlab.com/mmediting/inpainting/aot_gan/AOT-GAN_512x512_4x12_places_20220509-6641441b.pth

## 多个GPU上测试
./tools/dist_test.sh configs/aot_gan/aot-gan_smpgan_4xb4_places-512x512.py https://download.openmmlab.com/mmediting/inpainting/aot_gan/AOT-GAN_512x512_4x12_places_20220509-6641441b.pth 8

更多细节可以参考 train_test.md 中的 Test a pre-trained model 部分。

引用

@inproceedings{yan2021agg,
  author = {Zeng, Yanhong and Fu, Jianlong and Chao, Hongyang and Guo, Baining},
  title = {Aggregated Contextual Transformations for High-Resolution Image Inpainting},
  booktitle = {Arxiv},
  pages={-},
  year = {2020}
}

DeepFillv2 (CVPR’2019)

任务: 图像修复

DeepFillv2 (CVPR'2019) 
@inproceedings{yu2019free,
  title={Free-form image inpainting with gated convolution},
  author={Yu, Jiahui and Lin, Zhe and Yang, Jimei and Shen, Xiaohui and Lu, Xin and Huang, Thomas S},
  booktitle={Proceedings of the IEEE International Conference on Computer Vision},
  pages={4471--4480},
  year={2019}
}

CelebA-HQ

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
DeepFillv2 free-form 256x256 20k CelebA-val 5.411 25.721 0.871 8 模型 | 日志

Places365-Challenge

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
DeepFillv2 free-form 256x256 100k Places365-val 8.635 22.398 0.815 8 模型 | 日志

快速开始

训练

训练说明

您可以使用以下命令来训练模型。

## CPU上训练
CUDA_VISIBLE_DEVICES=-1 python tools/train.py configs/deepfillv2/deepfillv2_8xb2_places-256x256.py

## 单个GPU上训练
python tools/train.py configs/deepfillv2/deepfillv2_8xb2_places-256x256.py

## 多个GPU上训练
./tools/dist_train.sh configs/deepfillv2/deepfillv2_8xb2_places-256x256.py 8

更多细节可以参考 train_test.md 中的 Train a model 部分。

测试

测试说明

您可以使用以下命令来测试模型。

## CPU上测试
CUDA_VISIBLE_DEVICES=-1 python tools/test.py configs/deepfillv2/deepfillv2_8xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/deepfillv2/deepfillv2_256x256_8x2_places_20200619-10d15793.pth

## 单个GPU上测试
python tools/test.py configs/deepfillv2/deepfillv2_8xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/deepfillv2/deepfillv2_256x256_8x2_places_20200619-10d15793.pth

## 多个GPU上测试
./tools/dist_test.sh configs/deepfillv2/deepfillv2_8xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/deepfillv2/deepfillv2_256x256_8x2_places_20200619-10d15793.pth 8

更多细节可以参考 train_test.md 中的 Test a pre-trained model 部分。

PConv (ECCV’2018)

任务: 图像修复

PConv (ECCV'2018) 
@inproceedings{liu2018image,
  title={Image inpainting for irregular holes using partial convolutions},
  author={Liu, Guilin and Reda, Fitsum A and Shih, Kevin J and Wang, Ting-Chun and Tao, Andrew and Catanzaro, Bryan},
  booktitle={Proceedings of the European Conference on Computer Vision (ECCV)},
  pages={85--100},
  year={2018}
}

Places365-Challenge

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
PConv_Stage1 free-form 256x256 500k Places365-val - - - 8 -
PConv_Stage2 free-form 256x256 500k Places365-val 8.776 22.762 0.801 4 模型 | 日志

CelebA-HQ

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
PConv_Stage1 free-form 256x256 500k CelebA-val - - - 8 -
PConv_Stage2 free-form 256x256 500k CelebA-val 5.990 25.404 0.853 4 模型 | 日志

快速开始

训练

训练说明

您可以使用以下命令来训练模型。

## CPU上训练
CUDA_VISIBLE_DEVICES=-1 python tools/train.py configs/partial_conv/pconv_stage2_4xb2_places-256x256.py

## 单个GPU上训练
python tools/train.py configs/partial_conv/pconv_stage2_4xb2_places-256x256.py

## 多个GPU上训练
./tools/dist_train.sh configs/partial_conv/pconv_stage2_4xb2_places-256x256.py 8

更多细节可以参考 train_test.md 中的 Train a model 部分。

测试

测试说明

您可以使用以下命令来测试模型。

## CPU上测试
CUDA_VISIBLE_DEVICES=-1 python tools/test.py configs/partial_conv/pconv_stage2_4xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/pconv/pconv_256x256_stage2_4x2_places_20200619-1ffed0e8.pth

## 单个GPU上测试
python tools/test.py configs/partial_conv/pconv_stage2_4xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/pconv/pconv_256x256_stage2_4x2_places_20200619-1ffed0e8.pth

## 多个GPU上测试
./tools/dist_test.sh configs/partial_conv/pconv_stage2_4xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/pconv/pconv_256x256_stage2_4x2_places_20200619-1ffed0e8.pth 8

更多细节可以参考 train_test.md 中的 Test a pre-trained model 部分。

DeepFillv1 (CVPR’2018)

任务: 图像修复

DeepFillv1 (CVPR'2018) 
@inproceedings{yu2018generative,
  title={Generative image inpainting with contextual attention},
  author={Yu, Jiahui and Lin, Zhe and Yang, Jimei and Shen, Xiaohui and Lu, Xin and Huang, Thomas S},
  booktitle={Proceedings of the IEEE conference on computer vision and pattern recognition},
  pages={5505--5514},
  year={2018}
}

CelebA-HQ

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
DeepFillv1 square bbox 256x256 1500k CelebA-val 6.677 26.878 0.911 4 模型 | 日志

Places365-Challenge

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
DeepFillv1 square bbox 256x256 3500k Places365-val 11.019 23.429 0.862 8 模型 | 日志

快速开始

训练

训练说明

您可以使用以下命令来训练模型。

## CPU上训练
CUDA_VISIBLE_DEVICES=-1 python tools/train.py configs/deepfillv1/deepfillv1_8xb2_places-256x256.py

## 单个GPU上训练
python tools/train.py configs/deepfillv1/deepfillv1_8xb2_places-256x256.py

## 多个GPU上训练
./tools/dist_train.sh configs/deepfillv1/deepfillv1_8xb2_places-256x256.py 8

更多细节可以参考 train_test.md 中的 Train a model 部分。

测试

测试说明

您可以使用以下命令来测试模型。

## CPU上测试
CUDA_VISIBLE_DEVICES=-1 python tools/test.py configs/deepfillv1/deepfillv1_8xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/deepfillv1/deepfillv1_256x256_8x2_places_20200619-c00a0e21.pth

## 单个GPU上测试
python tools/test.py configs/deepfillv1/deepfillv1_8xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/deepfillv1/deepfillv1_256x256_8x2_places_20200619-c00a0e21.pth

## 多个GPU上测试
./tools/dist_test.sh configs/deepfillv1/deepfillv1_8xb2_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/deepfillv1/deepfillv1_256x256_8x2_places_20200619-c00a0e21.pth 8

更多细节可以参考 train_test.md 中的 Test a pre-trained model 部分。

Global&Local (ToG’2017)

任务: 图像修复

Global&Local (ToG'2017) 
@article{iizuka2017globally,
  title={Globally and locally consistent image completion},
  author={Iizuka, Satoshi and Simo-Serra, Edgar and Ishikawa, Hiroshi},
  journal={ACM Transactions on Graphics (ToG)},
  volume={36},
  number={4},
  pages={1--14},
  year={2017},
  publisher={ACM New York, NY, USA}
}

请注意，为了与当前的深度图像修复方法进行公平比较，我们没有在 Global&Local 中使用后处理模块。

Places365-Challenge

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
Global&Local square bbox 256x256 500k Places365-val 11.164 23.152 0.862 8 模型 | 日志

CelebA-HQ

算法 掩膜类型 分辨率 训练集容量 测试集 l1 损失 PSNR SSIM GPU 信息 下载
Global&Local square bbox 256x256 500k CelebA-val 6.678 26.780 0.904 8 模型 | 日志

快速开始

训练

训练说明

您可以使用以下命令来训练模型。

## CPU上训练
CUDA_VISIBLE_DEVICES=-1 python tools/train.py configs/global_local/gl_8xb12_places-256x256.py

## 单个GPU上训练
python tools/train.py configs/global_local/gl_8xb12_places-256x256.py

## 多个GPU上训练
./tools/dist_train.sh configs/global_local/gl_8xb12_places-256x256.py 8

更多细节可以参考 train_test.md 中的 Train a model 部分。

测试

测试说明

您可以使用以下命令来测试模型。

## CPU上测试
CUDA_VISIBLE_DEVICES=-1 python tools/test.py configs/global_local/gl_8xb12_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/global_local/gl_256x256_8x12_places_20200619-52a040a8.pth

## 单个GPU上测试
python tools/test.py configs/global_local/gl_8xb12_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/global_local/gl_256x256_8x12_places_20200619-52a040a8.pth

## 多个GPU上测试
./tools/dist_test.sh configs/global_local/gl_8xb12_places-256x256.py https://download.openmmlab.com/mmediting/inpainting/global_local/gl_256x256_8x12_places_20200619-52a040a8.pth 8

更多细节可以参考 train_test.md 中的 Test a pre-trained model 部分。

Read the Docs v: latest
Versions
latest
stable
0.x
Downloads
pdf
epub
On Read the Docs
Project Home
Builds
Free document hosting provided by Read the Docs.