Denoising diffusion probabilistic models (DDPMs) with classifier-free guidance such as DALL·E 2, GLIDE, and Imagen have achieved state-of-the-art results in high-resolution image generation. The downside to such models is that their inference process requires evaluating both a class-conditional model and an unconditional model hundreds of times, rendering them prohibitively compute-expensive for many real-world applications.
In the new paper On Distillation of Guided Diffusion Models, researchers from Google Brain and Stanford University propose a novel approach for distilling classifier-free guided diffusion models with high sampling efficiency. The resulting models achieve performance comparable to the original model but with sampling steps reduced by up to 256 times.
The researchers’ distillation approach comprises two steps: Given a trained guided teacher model, a single student model first matches the combined output of the teacher’s two diffusion models, and this learned student model is then progressively distilled to a fewer-step model. The resulting single distilled model can handle a wide range of different guidance strengths and enable efficient tradeoffs between sample quality and diversity.
The proposed sampling method employs a deterministic sampler and a novel stochastic sampling process. One deterministic sampling step is first applied with two times the original step length, and one stochastic step is then performed backward (i.e., perturb with noise) using the original step length. This approach was inspired by Karras et al.’s paperElucidating the Design Space of Diffusion-Based Generative Models, published earlier this year.
In their empirical study, the team applied their method to classifier-free guidance DDPMs and performed image generation experiments on the ImageNet 64×64 and CIFAR-10 datasets. The results show that the proposed approach can achieve “visually decent” samples using as few as one step and obtain FID/IS (Frechet Inception Distance/Inception) scores comparable to that of the original baseline models while being up to 256 times faster to sample from.
Overall, this work demonstrates the effectiveness of the proposed approach in addressing the high computational costs that have limited the deployment of denoising diffusion probabilistic models.
The paper On Distillation of Guided Diffusion Models is on arXiv.
Author: Hecate He | Editor: Michael Sarazen
We know you don’t want to miss any news or research breakthroughs. Subscribe to our popular newsletter Synced Global AI Weekly to get weekly AI updates.
Pingback: ▷Google and also Stanford Scientist Suggest an Unique Strategy for Distilling Classifier-Free Guided Diffusion Designs with High Experiencing Performance ✔️
Pingback: Google and Stanford Researchers Propose a Novel Approach for Distilling Classifier-Free Guided Diffusion Models with High Sampling Efficiency | Blockchain Consultants
Pingback: Google and Stanford Researchers Propose a Novel Approach for Distilling Classifier-Free Guided Diffusion Models with High Sampling Efficiency
Pingback: Google- und Stanford-Forscher schlagen einen neuartigen Ansatz zur Destillation klassifikatorfreier geführter Diffusionsmodelle mit hoher Abtasteffizienz vor - News
Cricut is famous for its premium quality cutting and heat press machines. These machines are best for making customized art projects and crafts. Also, these machines are compatible with vinyl and iron-on products and can cut more than a hundred different materials. Before using these machines, it is necessary to complete the setup process for your printer, so you can go to cricut.com/setup and get a complete guide.
Canon printers can print, copy, scan, and fax documents. With the ability to handle two-sided scanning and printing, it can handle high-output tasks with a 500-sheet paper tray. It features sharp, crisp prints and great text quality and boasts a 30,000-page duty cycle. You can finalize your print tasks quickly, which will increase business efficiency. Are you looking for a Canon Setup Guide? If so, go to Canon’s site at ij.start.canon.
Visit cricut.com/setup to set up your Cricut machine right away. The link will take you to Cricut’s product setup page. You can select your machine there and download the Cricut Design Space application. The Design Space software lets you create beautiful design pieces easily. In case you don’t know what a Cricut Machine is, It is a DIY cutting machine used to cut various materials.