DeepCreamPy

Plausibly Reconstruct Anime-style Artworks with Deep Neural Networks.

A deep learning-based tool to automatically replace parts of artworks with plausible reconstructions.

Before using DeepCreamPy, the user must mark regions in the artwork using green color with an image editing program (e.g., GIMP, Photoshop). DeepCreamPy takes the images with green colored regions as input, and a neural network automatically fills in the highlighted regions.

You can download the latest release for Windows 64-bit here.

For users interested in compiling DeepCreamPy themselves, DeepCreamPy can run on Windows, Mac, and Linux.

Before opening a new issue, please check closed issues and refer to the table of contents.

Features

• Reconstructing images of any size
• Reconstruction of ANY shaped censor (e.g. black lines, pink hearts, etc.)
• Decensoring of mosaic censors
• Limited support for black-and-white/monochrome images
• Generate multiple variations of reconstructions from the same image

Limitations

The reconstruction is mainly for anime-style human-like figures that have minor to moderate redactions. If an organ (e.g. arms, legs) is completely deleted, reconstruction will fail.

It does NOT work with:

• Screentones (e.g. printed material)
• Real life photos
• Animated gifs and videos

Table of Contents

Setup:

• Running latest Window 64-bit release
• Running code yourself

Usage:

• Tutorial
• Troubleshooting for installing
• Troubleshooting for poor quality outputs

Miscellaneous:

• FAQ

To do

• Moving to PyTorch or newer versions of TensorFlow
• Improving UI
• Error logging

Contributions

We welcome contributions as long as they comply with the GNU Affero General Public License v3.0. Be advised of GitHub's inbound=outbound rule.

Previously, contributors had to sign a Contributor License Agreement (the "CLA"). This requirement is currently no longer in place.

This project was initially created by deeppomf and all credit goes to them. Special thanks to ccppoo, IAmTheRedSpy, 0xb8, deniszh, Smethan, harjitmoe, itsVale, StartleStars, SoftArmpit and everyone else for their contributions!

License

Source code and official releases/binaries are distributed under the GNU Affero General Public License v3.0.

Acknowledgements

Example mermaid image by Shurajo & AVALANCHE Game Studio under CC BY 3.0 License. The example image is modified from the original, which can be found here.

Neural network code is modified from Forty-lock's project PEPSI, which is the official implementation of the paper PEPSI : Fast Image Inpainting With Parallel Decoding Network. PEPSI is licensed under the MIT license.

Training data is modified from gwern's project Danbooru2017: A Large-Scale Crowdsourced and Tagged Anime Illustration Dataset and other sources.

See ACKNOWLEDGEMENTS.md for full license text of these projects.