AI Computer Vision & Graphics Machine Learning & Data Science Research

DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches

A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.

A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.

Recent deep image-to-image translation techniques have enabled the prompt generation of human face images from sketches, but these methods tend to suffer from overfitting to their inputs. They thus achieve the most realistic results only when the source drawings have high-quality artistry or are accompanied by edge maps.

Unlike most deep learning based solutions for sketch-to-image translation that take input sketches as fixed, ‘hard’ constraints and then attempt to reconstruct the missing texture or shading information between strokes, the key idea behind the new approach is to implicitly learn a space of plausible face sketches from real face sketch images and find the point in this space that best approximates the input sketch. Because this approach treats input sketches more as ‘soft’ constraints that will guide image synthesis, it is able to produce high-quality face images with increased plausibility even from rough and/or incomplete inputs.

dn-6.4.png
Illustration of the model’s deep learning framework architecture

The system consists of three main modules — CE (Component Embedding), FM (Feature Mapping), and IS (Image Synthesis). The CE module adopts an auto-encoder architecture and separately learns five feature descriptors — left-eye, right-eye, nose, mouth, and remainder — from the face sketch data. The FM and IS modules together form another deep learning sub-network for conditional image generation, and map component feature vectors to realistic images.

The researchers also provide a shadow-guided interface, implemented based on CE, that makes it easier for users to refine the input sketches. Their system can produce high-quality realistic face images — with resolution of 512 × 512 — that faithfully respect and reflect the input sketches.

Both qualitative and quantitative evaluations show that the method produces visually more pleasing face images, according to the researchers. The system’s usability and expressiveness were also favourably confirmed in a user study.

The researchers say their tool is easy to use, even for non-artists, while still supporting fine-grained control of shape details. They are working on releasing the source code soon.

The paper DeepFaceDrawing: Deep Generation of Face Images from Sketches has been accepted by SIGGRAPH 2020 and is available on arXiv.


Journalist: Yuan Yuan | Editor: Michael Sarazen

136 comments on “DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches

  1. Thanks for sharing with us this important Content. I feel strongly about it and really enjoyed learning more about this topic. 릴게임

  2. I savour, lead to I found exactly what I used to be having a look for. You’ve ended my four day long hunt! God Bless you man. Have a nice day. Bye

  3. It’s impressive that you are getting ideas from this post. 온라인바둑이

  4. Thanks for share amazing content. Hope to read more post from you. 바카라사이트

  5. Such an amazing and helpful post this is. i love it. 카지노사이트탑

  6. I don’t know whether it’s just me or if everyone else experiencing problems with your blog.
    It appears as if some of the text in your content are running off the screen. Can someone else please provide feedback and
    let me know if this is happening to them as well?
    This may be a issue with my web browser because I’ve had this happen before.
    Thanks.Click Me Here인터넷경마

    2YAnGsKIE

  7. Your article is very interesting. I think this article has a lot of information needed, looking forward to your new posts.
    카지노사이트

  8. Your blog is really nice. Its sound really good
    토토사이트

  9. Your article is very interesting. I think this article has a lot of information needed, looking forward to your new posts.
    바카라사이트

  10. Thank you for providing a good quality article.
    바카라사이트

  11. My site also has a lot of useful information.
    If time allows, please visit once 온라인바둑이

  12. I wonder why the other experts of this sector don’t notice this. You must continue your writing. I’m sure, you’ve a huge readers’ base already! want to learn more? click the link here: https://www.casinositehot.com

  13. I wonder why the other experts of this sector don’t notice this. You must continue your writing. I’m sure, you’ve a huge readers’ base already! want to learn more? click the link here: https://www.casinositehot.com

  14. Absolutely love all your blogs and enjoy reading the “story’ behind each. Can’t thank you enough! Keep up the amazing work… https://www.casinositehome.com

  15. Cool stuff you have got and you keep update all of us. https://www.totosafedb.com

  16. Just about each amazing really own & each methods to your website are extraordinary 토토365프로

  17. I really fascinated by this excellent blog, thanks for such wonderful blog! Good job and more power!

  18. Nice response in return of this question with real arguments and explaining the whole thing about that.

  19. I am regular visitor, how are you everybody?
    This article posted at this website is in fact good
    I

  20. I have read many articles on this topic. There are many benefits Thank you for sharing good things.

  21. you can also add to it sunglasses like ray ban maroc

  22. Thank you for sharing this great and useful post.thanks helpful
    Co 800 trieu nen dau tu gi

  23. Thanks for sharing this marvelous post. I m very pleased to read this article.

  24. The drunker you happen to be, the low your inhibitions will be, and the less you will likely be
    able to believe clearly. The final simple truth is that if the jackpot hits 185 million Euros, then there is going to be no more roll over.
    Playtech has answered the calls of video slots enthusiasts everywhere you go by
    releasing their quite 1st multi-player video bonus slot,
    Fishing with Buddies. 경마

  25. I like this web site its a master peace ! Glad I noticed this on google . 경마사이트

  26. Hey, you used to write great, but the last several posts have been kinda boring?K I miss your super writings. Past several posts are just a bit out of track! come on!경마

  27. Keep up the great work I read an article on this site. And I think your blog is really interesting. and store a lot of great information 123bet vip

  28. Thank you for sharing such wonderful information. keep up posting all the best.

  29. Nice post very informative, thanks for this amazing post

  30. If you desire to get a great deal from this post then you have to apply such techniques to your won web site. 스포츠중계

  31. 토토365프로 Quality content is the crucial to interest the viewers to go to see the site, that’s what this website is providing.

  32. I really fascinated by this excellent blog, thanks for such wonderful blog!
    Hope you visit my blog vninvestment

  33. There’s a lot of amazing information here. I enjoyed reading good information while searching. I will also share useful information. I’ll stop by again.

  34. Among several blogs, the information here was very helpful. I want to visit often. I want to share good information, too. Thank you.파워볼사이트 제작

  35. Thanks for sharing such an incredible contents, its very helpful and educating.

  36. What a post I’ve been looking for! I’m very happy to finally read this post.
    파워볼게임

  37. Are you looking for a lot of sites to see the Powerball strategy? Here are some Powerball recommendations that we recommend. Come in and feel free to share information. 파워볼사이트 추천

  38. The site I recommend from now on is a site related to Powerball. If you’re interested in Powerball, come in right now. 파워볼 추천

  39. Where the Powerball sites gather! Don’t waste your time looking for sites here and there, go to the sites I recommend! Time saving and a variety of sites await you. 파워볼 모음

  40. Anonymous

    It was a very useful site for information, tips and all the details. Whenever I have time, I will try to visit you. thank you. 파워볼 중계

  41. 토토사이트순위

    I accidentally searched and visited your site. I still saw several posts during my visit, but the text was neat and readable. I will quote this post and post it on my blog. Would you like to visit my blog later? 토토사이트순위

  42. Do you know the distributor site? I would like to recommend a Powerball distributor site. This site boasts the number one powerball distributor in the industry.파워볼사이트 추천 총판

  43. Anonymous

    This is my favorite article. I’m really glad that there is a site like this that we can share with each other through the Internet. I will visit again. 파워볼 중계 사이트

  44. Anyone curious about the Powerball distributor site? Our companion Powerball Association will answer your questions.파워볼사이트 총판

  45. youm11231

    파워볼 사이트 동행복권 I’ll give you information about the game that you’ll be satisfied with.

  46. Anonymous

    Powerball Netball Ladder Come and see various famous games in Korea. There are various mini-games and a lot of information. 넷볼

  47. nice to meet you. We are the accompanying Powerball Association. Our site is a place to recommend information and sites related to Powerball.파워볼

  48. The private site you are looking for. I am with the Powerball Association. There are various sites to suit your taste.사설 파워볼

  49. I searched a lot on this topic and finally found it. I read your post and was very impressed. We visit this site frequently to appreciate your comments. keo nhacai

Leave a Reply to betmagusoyang Cancel reply

Your email address will not be published. Required fields are marked *