AI Computer Vision & Graphics Machine Learning & Data Science Research

DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches

A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.

A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.

Recent deep image-to-image translation techniques have enabled the prompt generation of human face images from sketches, but these methods tend to suffer from overfitting to their inputs. They thus achieve the most realistic results only when the source drawings have high-quality artistry or are accompanied by edge maps.

Unlike most deep learning based solutions for sketch-to-image translation that take input sketches as fixed, ‘hard’ constraints and then attempt to reconstruct the missing texture or shading information between strokes, the key idea behind the new approach is to implicitly learn a space of plausible face sketches from real face sketch images and find the point in this space that best approximates the input sketch. Because this approach treats input sketches more as ‘soft’ constraints that will guide image synthesis, it is able to produce high-quality face images with increased plausibility even from rough and/or incomplete inputs.

dn-6.4.png
Illustration of the model’s deep learning framework architecture

The system consists of three main modules — CE (Component Embedding), FM (Feature Mapping), and IS (Image Synthesis). The CE module adopts an auto-encoder architecture and separately learns five feature descriptors — left-eye, right-eye, nose, mouth, and remainder — from the face sketch data. The FM and IS modules together form another deep learning sub-network for conditional image generation, and map component feature vectors to realistic images.

The researchers also provide a shadow-guided interface, implemented based on CE, that makes it easier for users to refine the input sketches. Their system can produce high-quality realistic face images — with resolution of 512 × 512 — that faithfully respect and reflect the input sketches.

Both qualitative and quantitative evaluations show that the method produces visually more pleasing face images, according to the researchers. The system’s usability and expressiveness were also favourably confirmed in a user study.

The researchers say their tool is easy to use, even for non-artists, while still supporting fine-grained control of shape details. They are working on releasing the source code soon.

The paper DeepFaceDrawing: Deep Generation of Face Images from Sketches has been accepted by SIGGRAPH 2020 and is available on arXiv.


Journalist: Yuan Yuan | Editor: Michael Sarazen

77 comments on “DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches

  1. Thanks for sharing with us this important Content. I feel strongly about it and really enjoyed learning more about this topic. 릴게임

  2. I savour, lead to I found exactly what I used to be having a look for. You’ve ended my four day long hunt! God Bless you man. Have a nice day. Bye

  3. It’s impressive that you are getting ideas from this post. 온라인바둑이

  4. Thanks for share amazing content. Hope to read more post from you. 바카라사이트

  5. Such an amazing and helpful post this is. i love it. 카지노사이트탑

  6. I don’t know whether it’s just me or if everyone else experiencing problems with your blog.
    It appears as if some of the text in your content are running off the screen. Can someone else please provide feedback and
    let me know if this is happening to them as well?
    This may be a issue with my web browser because I’ve had this happen before.
    Thanks.Click Me Here인터넷경마

    2YAnGsKIE

  7. Your article is very interesting. I think this article has a lot of information needed, looking forward to your new posts.
    카지노사이트

  8. Your blog is really nice. Its sound really good
    토토사이트

  9. Your article is very interesting. I think this article has a lot of information needed, looking forward to your new posts.
    바카라사이트

  10. Thank you for providing a good quality article.
    바카라사이트

  11. My site also has a lot of useful information.
    If time allows, please visit once 온라인바둑이

  12. I wonder why the other experts of this sector don’t notice this. You must continue your writing. I’m sure, you’ve a huge readers’ base already! want to learn more? click the link here: https://www.casinositehot.com

  13. I wonder why the other experts of this sector don’t notice this. You must continue your writing. I’m sure, you’ve a huge readers’ base already! want to learn more? click the link here: https://www.casinositehot.com

  14. Absolutely love all your blogs and enjoy reading the “story’ behind each. Can’t thank you enough! Keep up the amazing work… https://www.casinositehome.com

  15. Cool stuff you have got and you keep update all of us. https://www.totosafedb.com

  16. Just about each amazing really own & each methods to your website are extraordinary 토토365프로

  17. I really fascinated by this excellent blog, thanks for such wonderful blog! Good job and more power!

  18. Nice response in return of this question with real arguments and explaining the whole thing about that.

  19. I am regular visitor, how are you everybody?
    This article posted at this website is in fact good
    I

  20. I have read many articles on this topic. There are many benefits Thank you for sharing good things.

  21. you can also add to it sunglasses like ray ban maroc

  22. Thank you for sharing this great and useful post.thanks helpful
    Co 800 trieu nen dau tu gi

  23. Thanks for sharing this marvelous post. I m very pleased to read this article.

  24. The drunker you happen to be, the low your inhibitions will be, and the less you will likely be
    able to believe clearly. The final simple truth is that if the jackpot hits 185 million Euros, then there is going to be no more roll over.
    Playtech has answered the calls of video slots enthusiasts everywhere you go by
    releasing their quite 1st multi-player video bonus slot,
    Fishing with Buddies. 경마

  25. I like this web site its a master peace ! Glad I noticed this on google . 경마사이트

  26. Hey, you used to write great, but the last several posts have been kinda boring?K I miss your super writings. Past several posts are just a bit out of track! come on!경마

  27. Keep up the great work I read an article on this site. And I think your blog is really interesting. and store a lot of great information 123bet vip

Leave a Reply to 송송넷 Cancel reply

Your email address will not be published.

%d bloggers like this: