AI Computer Vision & Graphics Machine Learning & Data Science Research

DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches

A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.

A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.

Recent deep image-to-image translation techniques have enabled the prompt generation of human face images from sketches, but these methods tend to suffer from overfitting to their inputs. They thus achieve the most realistic results only when the source drawings have high-quality artistry or are accompanied by edge maps.

Unlike most deep learning based solutions for sketch-to-image translation that take input sketches as fixed, ‘hard’ constraints and then attempt to reconstruct the missing texture or shading information between strokes, the key idea behind the new approach is to implicitly learn a space of plausible face sketches from real face sketch images and find the point in this space that best approximates the input sketch. Because this approach treats input sketches more as ‘soft’ constraints that will guide image synthesis, it is able to produce high-quality face images with increased plausibility even from rough and/or incomplete inputs.

dn-6.4.png
Illustration of the model’s deep learning framework architecture

The system consists of three main modules — CE (Component Embedding), FM (Feature Mapping), and IS (Image Synthesis). The CE module adopts an auto-encoder architecture and separately learns five feature descriptors — left-eye, right-eye, nose, mouth, and remainder — from the face sketch data. The FM and IS modules together form another deep learning sub-network for conditional image generation, and map component feature vectors to realistic images.

The researchers also provide a shadow-guided interface, implemented based on CE, that makes it easier for users to refine the input sketches. Their system can produce high-quality realistic face images — with resolution of 512 × 512 — that faithfully respect and reflect the input sketches.

Both qualitative and quantitative evaluations show that the method produces visually more pleasing face images, according to the researchers. The system’s usability and expressiveness were also favourably confirmed in a user study.

The researchers say their tool is easy to use, even for non-artists, while still supporting fine-grained control of shape details. They are working on releasing the source code soon.

The paper DeepFaceDrawing: Deep Generation of Face Images from Sketches has been accepted by SIGGRAPH 2020 and is available on arXiv.


Journalist: Yuan Yuan | Editor: Michael Sarazen

130 comments on “DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches

  1. Hello, this is the Companion Powerball Association. We provide you with the latest silverware material. Please come and enjoy.은꼴

  2. We provide easy-to-view and convenient sites for sale. We will satisfy you with high quality design and system. Work with Powersoft.카지노 분양

  3. Hello, this is Powersoft. Are you thinking of making slots? If so, Powersoft will help you make it. The best results are waiting for you.슬롯 제작

  4. Have you ever used a safe site? If you have not used it yet, our Safety Site Promotion Agency will help you. Please use the verified safe site!안전사이트

  5. This is the Safety Site Promotion Agency that introduces only the safety site majors. If you are looking for a major safety site, do not hesitate to visit the site.안전사이트 메이저

  6. Hello, this is Powersoft. Anyone in need of a casino egg supply? If so, please visit Powersoft right now. We will supply you with casino eggs in the best conditions.카지노 알공급

  7. Are there still people who are being victimized by scams? Don’t take any more damage with the scam verification site. We are here to help.먹튀검증사이트

  8. Don’t take any more damage with the scam verification site. We are here to help.먹튀검증사이트

  9. It is the companion Powerball Association that recommends and provides the best private Powerball site to you. Thank you for your interest.사설 파워볼사이트

  10. This is Powersoft operating the site based on professional knowledge and information on Casino Albonsa. If you would like to inquire about Casino Albonsa, please contact us immediately.카지노 알본사

  11. Definitely a great site and very informative posts.

  12. Hello, this is Paldang Powerball, a website specializing in Evolution Casino subscription coupons. We provide all information related to Evolution Casino, and if you have any questions, we will solve them right away.에볼루션카지노 가입쿠폰

  13. Everything I threw away because I couldn’t handle it.
    He left without waiting for me.
    I lost so much, but I have no regrets.
    So if I can go further,먹튀

  14. Eat-and-go community! Still looking? Betterzone is here to help you save your troubles. We will provide you with the latest food verification community information!먹튀검증 커뮤니티

  15. We will always provide 100% member satisfaction with the latest materials. The Companion Powerball Association will do its best with the mindset that it is always the best in the field of powerball sites.파워볼사이트

  16. We will always provide 100% member satisfaction with the latest materials. The Companion Powerball Association will do its best with the mindset that it is always the best in the field of powerball sites.파워볼사이트

  17. The Companion Powerball Association will do its best with the mindset that it is always the best in the field of powerball sites.파워볼사이트

  18. I learn something new and challenging on websites I stumbleupon on a daily basis.

  19. I’d rather you hate me Don’t look foolish to me anymore
    코인파워볼

  20. When I’m rollin’ through my ends though
    You stuck in the friend zone
    I tell that four five the fifth ayy
    카지노 제작

  21. You gave me even more new perspectives.

  22. Very good article post. Really looking forward to read more. Really Cool.

  23. youm112

    에볼루션카지노 추천It provides the best safe powerball that anyone can enjoy.

  24. INTERESTING!! you should upload more☺️ this is really good!!!

  25. This article is in fact a nice one it assists new the web people, who
    are wishing in favor of blogging.

  26. Could you visit my website if you have time?
    슬롯사이트

    Hi there excellent blog!
    검증카지노

  27. ohh my gote my love밤의민족

  28. lii yaa

    ohh my gote my love밤의민족

  29. My eyes are so hot that the place of love can’t be, and I hear the treasure. The ice that blooms is powerful. It is sending.
    https://www.sportstotomen.com

  30. today i’m so happy, because i have time to visite my family at home town, but i also feel worried,토토직원

Leave a Reply

Your email address will not be published.

%d bloggers like this: