Computer Vision & Graphics Machine Learning & Data Science Research

StyleGAN-Based VOGUE Is a SOTA AI-Powered Fitting Room

VOGUE, an AI-powered optimization method that deforms garments according to a given body shape while preserving pattern and material details to deliver state-of-the-art photorealistic, high-resolution try-on images.

As the seasons change so do wardrobes. While people typically crowd boutiques or department stores to shop for new clothes, retail closures and stay-at-home measures adopted to counter the spread of COVID-19 have left many with little choice but to shop online.

Online shopping now accounts for 38.6 percent of all apparel sales in the US, according to the Digital Commerce 360’s 2020 Online Apparel Report. The total is up 10 percent in the last three years, and recent acceleration is expected to continue through 2021. The trend has boosted the deployment and the quality of real-world AI applications such as chatbots and visual search, as well as the emerging field of online clothes try-on, which digitally recreates the fitting rooms and full-length mirrors of brick-and-mortar clothing stores.

In a new paper, a team from Google Research, MIT CSAIL and University of Washington propose VOGUE, an AI-powered optimization method that deforms garments according to a given body shape while preserving pattern and material details to deliver state-of-the-art photorealistic, high-resolution try-on images.

Screen Shot 2021-01-10 at 10.15.49 PM.png

Leveraging the power of StyleGAN2, the researchers’ novel controllable image generation algorithm can “seamlessly” identify and integrate person-specific components such as body shape, hair, skin colour, etc. from a target-person image with areas of interest such as folds, material properties, shape, etc. in a garment image.

Unlike previous general GAN editing approaches that require manual choice of noise injection structure or clusters and fixed parameters for all layers, the proposed method automatically computes the best interpolation coefficients by optimizing a loss function designed to preserve the identity and pose of the person while switching only the garment.

Screen Shot 2021-01-11 at 12.55.35 PM.png
Screen Shot 2021-01-11 at 1.14.44 PM.png

The researchers first trained a modified StyleGAN2 network conditioned on 2D human body pose on 100K unpaired fashion photographs. Given person image and garment images, the trained model then automatically finds the optimal interpolation coefficients per layer to enable semantically improved and photorealistic results at the high resolution of 512 × 512 pixels.

While the approach shows promise in the task of easing consumers’ online clothes-shopping anxiety, the researchers note there are limitations: the method still struggles for example with extreme poses or underrepresented garments. Also, since interpolation assumes perfect projection, unsatisfactory projection of real images can negatively affect the results. The researchers therefore propose improving the projection of real images onto the StyleGAN latent space as a possible future research direction.

The paper VOGUE: Try-On by StyleGAN Interpolation Optimization is on arXiv.


Analyst: Yuqing Li | Editor: Michael Sarazen; Yuan Yuan


B4.png

Synced Report | A Survey of China’s Artificial Intelligence Solutions in Response to the COVID-19 Pandemic — 87 Case Studies from 700+ AI Vendors

This report offers a look at how China has leveraged artificial intelligence technologies in the battle against COVID-19. It is also available on Amazon KindleAlong with this report, we also introduced a database covering additional 1428 artificial intelligence solutions from 12 pandemic scenarios.

Click here to find more reports from us.


AI Weekly.png

We know you don’t want to miss any news or research breakthroughs. Subscribe to our popular newsletter Synced Global AI Weekly to get weekly AI updates.

6 comments on “StyleGAN-Based VOGUE Is a SOTA AI-Powered Fitting Room

  1. Pingback: [Research] StyleGAN-Based VOGUE Is a SOTA AI-Powered Fitting Room – ONEO AI

  2. Pingback: [Research] StyleGAN-Based VOGUE Is a SOTA AI-Powered Fitting Room – tensor.io

  3. This article showcases the incredible potential of AI-powered fitting rooms. In addition to advanced technology, it’s worth mentioning that a good room also requires a reliable Sensibo conditioner. A well-regulated temperature ensures a comfortable and enjoyable experience, enhancing the overall satisfaction of using such innovative fitting rooms.

  4. It’s fascinating to see how AI is transforming the fashion industry, especially when it comes to virtual fitting rooms and personalized style recommendations. Innovations like these are changing the way people discover and experience clothing, making fashion more accessible and data-driven than ever before. At the same time, personal style still comes down to simple, well-chosen pieces that fit naturally into everyday life. One brand I recently came across is Casual Carats, which focuses on clean, modern jewelry designs that complement a wide range of outfits. It’s a nice balance between technology-driven fashion and timeless personal expression.

  5. Trying out different styles before making a change can save a lot of time and second-guessing. It’s nice to have more options when deciding what suits you best. Appearance is about more than just clothes, though. A friend of mine recently started looking into solutions for hairloss in london, and I was surprised by how natural some of the modern treatments look these days.

  6. Mitchel Owen

    As AI-powered virtual fitting rooms continue to evolve, innovations like StyleGAN-based garment visualization are helping bridge the gap between online shopping and in-store confidence by delivering more realistic apparel previews. While advanced technology improves the digital try-on experience, choosing well-crafted clothing remains just as important. Brands such as True Luck Jeans combine premium denim, comfortable fits, and modern Euro-street inspired styling, giving shoppers quality apparel that complements the next generation of AI-driven fashion retail.

Leave a Reply

Your email address will not be published. Required fields are marked *