AI Computer Vision & Graphics Machine Learning & Data Science Research

DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches

A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.

A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.

Recent deep image-to-image translation techniques have enabled the prompt generation of human face images from sketches, but these methods tend to suffer from overfitting to their inputs. They thus achieve the most realistic results only when the source drawings have high-quality artistry or are accompanied by edge maps.

Unlike most deep learning based solutions for sketch-to-image translation that take input sketches as fixed, ‘hard’ constraints and then attempt to reconstruct the missing texture or shading information between strokes, the key idea behind the new approach is to implicitly learn a space of plausible face sketches from real face sketch images and find the point in this space that best approximates the input sketch. Because this approach treats input sketches more as ‘soft’ constraints that will guide image synthesis, it is able to produce high-quality face images with increased plausibility even from rough and/or incomplete inputs.

dn-6.4.png
Illustration of the model’s deep learning framework architecture

The system consists of three main modules — CE (Component Embedding), FM (Feature Mapping), and IS (Image Synthesis). The CE module adopts an auto-encoder architecture and separately learns five feature descriptors — left-eye, right-eye, nose, mouth, and remainder — from the face sketch data. The FM and IS modules together form another deep learning sub-network for conditional image generation, and map component feature vectors to realistic images.

The researchers also provide a shadow-guided interface, implemented based on CE, that makes it easier for users to refine the input sketches. Their system can produce high-quality realistic face images — with resolution of 512 × 512 — that faithfully respect and reflect the input sketches.

Both qualitative and quantitative evaluations show that the method produces visually more pleasing face images, according to the researchers. The system’s usability and expressiveness were also favourably confirmed in a user study.

The researchers say their tool is easy to use, even for non-artists, while still supporting fine-grained control of shape details. They are working on releasing the source code soon.

The paper DeepFaceDrawing: Deep Generation of Face Images from Sketches has been accepted by SIGGRAPH 2020 and is available on arXiv.


Journalist: Yuan Yuan | Editor: Michael Sarazen

31 comments on “DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches

  1. Pingback: [R] DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches – tensor.io

  2. Pingback: DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches – 備忘6

  3. Pingback: DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches – EVENTA

  4. Pingback: DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches - Synced | Synced - Buzzing Startups

  5. Pingback: DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches - Synced - Down to the Block

  6. Pingback: DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches – frinkcoin.tech

  7. Pingback: DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches - News Himalaya

  8. Pingback: DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches - honynews.com

  9. Pingback: Deep Learning: Software wandelt Handskizzen in echte Gesichter um – Golem.de – Golem.de – ZITUB.COM

  10. Pingback: Deep Learning: Software wandelt Handskizzen in echte Gesichter um – Golem.de – Golem.de –

  11. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista - Prensa Objetiva

  12. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista - Sinetec

  13. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista | prueba

  14. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista | TECNODUKES

  15. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista - Tec Ofertas España

  16. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista | ReportateRD

  17. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista | Blog de Soportec Panama

  18. Pingback: DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches – Gadgets and Technology News

  19. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista - Diario España

  20. Pingback: Esta IA solo necesita un garabato de una cara para crear un retrato fotorrealista

  21. Alexandre Loeblein Heinen

    Why your algorithm always “paint” the faces with white skin colors?

    The technology may seem impressive at first time, until you realize this fault which makes it completely pointless. Which population is still composed only by white people? There is not such a society in the whole world.

    With this criticism, I encourage you to keep your eyes open to the racist bias of your work. In today’s society, this kind of problem can give a really bad image to any company.

    Hope you give a more humanized look to your work.

  22. If the face had started out non-white you might have a point.

  23. When you see “Chinese Academy of Sciences” then it’s Red alert, they’re very dangerous organization.

  24. Pingback: Web Picks (week of 8 June 2020) | DataMiningApps

  25. Pingback: Freepik Acquired By EQT and Tradeinn Exceeds €100 Million in Sales

  26. Ion Casino

    Ion casino is a trustworthy and best online casino site from 2010 which includes offered millions of gamers in Asia.
    Ion casino or also known as Ionclub is the particular
    top ranking selection site because it provides the greatest experience for gambling online players
    in Philippines. With an recognized license to run, this provider guarantees that players make bets without risk, credibility and can be relied upon.

    Varieties of Gambling Games Live Casino Ioncasino

    Ionclub provides various types of live casino at redbet gambling games,
    one of many advantages of ioncasino video games is available within the kind of html5 in order that you no longer need to
    be able to download the application. Reside casino games usually are broadcast in real-time
    accompanied by beautiful dealers, where gamers can observe dealers hands
    out cards on the game desk directly. So that will the player will
    not find virtually any discrepancies or video games that have been established.

    The following varieties of games are usually commonly played by simply players:
    – Baccarat
    Baccarat is a type of live casino online game that is basic really popular abroad,
    such as The far east and France. Baccarat uses playing
    playing cards media decks within his game, exactly where each player will
    certainly face the dealer directly and should place bets privately of the banker or player.
    Typically the player who will get the highest credit card wins this game.

    – Roulette
    Roulette is a game that uses balls and the wheel board machine the location where the edges have got numbers
    as betting tools. The method to play it is that the player must guess the particular
    position from the amounts that will come out and be determined from the ball of which stops.

    – Blackjack
    The particular game of blackjack card gambling
    will be simple enough to try out, the goal regarding the blackjack
    online game is to attain the number of cards near twenty one.
    If you obtain a card value previous 21 then you will automatically end up being declared lost.
    Inside this game you must deal with the seller, therefore
    you should get a higher cards value than the dealer.

    Login in addition to Register for Ion Casino

    To be able to log in and play on line casino gambling games out
    of this provider, you should first to have account from a reliable agent as a new place to place wagers.
    One of the recommendations for a list of ion casino is
    Depobola, here you are able to appreciate tons of advantages and facilities.
    Please register via the particular ion casino enrollment form or by simply clicking the
    register button at the top of this page. After you
    effectively register, contact the customer service to be able to activate your bank account.

    All ion casino games can be played on a smartphone or computer anywhere you
    are. Simply by registering ioncasino you can even get bonus gives given to fresh members using a fifty percent
    deposit bonus, plus a 1% live casino at redbet rebate for just about all players.
    Of training course, the words and conditions with this bonus offer require players to
    guess a particular amount to be able to withdraw the profits that result
    from the bonus offer you.

    The Latest Ionclub Option Hyperlinks
    Site obstructing often occurs inside Indonesia, which can be one of the discontentment of Ion casino gambling players.
    Associated with course it is now not difficult to access, because we
    possess anticipated it simply by providing alternative links to overcome in case the primary site should
    not be accessed by players. Here are several of the latest alternative
    links regarding players and don’t forget
    to save:
    – ionklub.com
    – ionclub.com
    – highlucky.com
    – ion777.com
    – ion888.com

    When the over link you can not employ in accessing,
    members can contact the customer service to
    be able to get the newest link. In addition there are
    furthermore several other methods, namely by making use of
    the application or VPN plugin that may be found on your own computer or mobile phone browser.

  27. href="https://gurbetporthosting.com">諛붿뭅?쇱궗?댄듃
  28. in a gruesome campaign of torture, beheadings and other acts of violence against four Americans and others captured and held hostage in Syria.
    https://www.shine900.com

  29. Anonymous

    The charges are a milestone in a yearslong effort by U.S. authorities to bring to justice members of the group known for beheadings and barbaric treatment of aid workers, journalists and other hostages in Syria.

  30. The case underscores the Justice Department’s commitment to prosecuting in American civilian court militants captured overseas, said Assistant Attorney General John Demers, who vowed that other extremists
    https://www.gain777.com

  31. The indictment charges the men in connection with the deaths of four American hostages — Foley, journalist Steven Sotloff and aid workers Peter Kassig and Kayla Mueller
    https://www.syy577.com

Leave a Reply

Your email address will not be published.

%d bloggers like this: