AI Computer Vision & Graphics Machine Learning & Data Science Research

Unsupervised Image-to-Image Translation Turns Selfies Into Anime Characters

Anyone can simply upload a selfie to the ‘Selfie 2 Waifu’ website to create their own AI-generated waifu-style anime character in seconds.

With the release of the new Tensorflow implementation of unsupervised generative network U-GAT-IT, anyone can simply upload a selfie to the ‘Selfie 2 Waifu’ website to create their own AI-generated waifu-style anime character in seconds.

For best results, participants are advised to submit a clear passport-style picture with a plain background. Although the site can also generate male anime results, as the name suggests the system generally performs better on female selfies.

Proposed by researchers from South Korea’s Clova AI Research, NCSOFT, and the Boeing Korea Engineering and Technology Center, U-GAT-IT incorporates a new attention module and new learnable normalization function in an end-to-end setup for unsupervised image-to-image translation.

“Our model guides the translation to focus on more important regions and ignore minor regions by distinguishing between source and target domains based on the attention map obtained by the auxiliary classifier,” the researchers explain. “These attention maps are embedded into the generator and discriminator to focus on semantically important areas, thus facilitating the shape transformation.”

An Adaptive Layer-Instance Normalization (AdaLIN) normalization function helps the model to flexibly control changes in shape and texture without modifying model architecture or hyperparameters. This is essential for translating datasets that contain different amounts of geometry and style changes.

The researchers compared their method with existing models CycleGAN, UNIT, MUNIT, DRIT, AGGAN, and CartoonGAN, evaluating performance on four representative unpaired image translation datasets and a newly created unpaired image dataset consisting of real photos and anime artwork.

dn-416.png

In a user study with 135 participants the proposed method scored higher than existing state-of-the-art models on not only style transfer but also object transfiguration.

The paper U-Gat-It: Unsupervised Generative Attentional Networks With Adaptive Layerinstance Normalization for Image-To-Image Translation has been accepted as a conference paper at ICLR 2020 and is on arXiv. The code is on GitHub.


Journalist: Yuan Yuan | Editor: Michael Sarazen

5 comments on “Unsupervised Image-to-Image Translation Turns Selfies Into Anime Characters

  1. Pingback: Unsupervised Image-to-Image Translation Turns Selfies Into Anime Characters – The AGANS

  2. Pingback: Unsupervised Image-to-Image Translation Turns Selfies Into Anime Characters – Frank's World of Data Science & AI

  3. Pingback: AI Generator Learns to ‘Draw’ Like Cartoonist Lee Mal-Nyeon in Just 10 Hours - Adolfo Eliazàt - Artificial Intelligence - AI News

  4. garry hilton

    What about hentai? Can you recommend it? In Japanese, the term hentai loosely translates to ‘perversion’ or ‘abnormality’ in English. The word has a distinctly negative connotation abroad and can be used to insult some for their sexual preferences.

  5. Jessy Miller

    As an anime fan, I have always been curious about anime comics. Recently I decided to read something more erotic such as hentai comics and found that I really like them. There is a great selection of different genres on https://aw-hentai.com and I spend a lot of time reading them. If you’re looking for something to diversify your sexual fantasy, you might want to give them a try.

Leave a Reply

Your email address will not be published. Required fields are marked *

%d bloggers like this: