diffusion model

by Synced 2023-04-20 0

Huawei’s DiffFit Unlocks the Transferability of Large Diffusion Models to New Domains

In the new paper DiffFit: Unlocking Transferability of Large Diffusion Models via Simple Parameter-Efficient Fine-Tuning, a Huawei Noah’s Ark Lab research team introduces DiffFit, a parameter-efficient fine-tuning technique that enables fast adaptation to new domains for diffusion image generation. Compared to full fine-tuning approaches, DiffFit achieves 2x training speed-ups while using only ~0.12 percent of trainable parameters.

by Synced 2023-03-08 1

AI Machine Learning & Data Science Research

OpenAI’s Consistency Models Support Fast One-Step Generation for Diffusion Models

Diffusion-based AI models continue to wow the world with remarkable image, audio, and video generation capabilities. This performance however comesContinue Reading

by Synced 2023-02-23 0

AI Computer Vision & Graphics Machine Learning & Data Science Research

Oxford U Presents RealFusion: 360° Reconstructions of Any Object from a Single Image

In the new paper RealFusion: 360° Reconstruction of Any Object from a Single Image, an Oxford University research team leverages a diffusion model to generate 360° reconstructions of objects from a single image. Their RealFusion approach achieves state-of-the-art performance on monocular 3D reconstruction benchmarks.

by Synced 2023-02-13 2

AI Machine Learning & Data Science Research

Hugging Face Releases LoRA Scripts for Efficient Stable Diffusion Fine-Tuning

A Hugging Face team collaborates with researcher Simo Ryu to provide a general approach that enables users to implement Low-Rank Adaptation (LoRA) in diffusers via both Dreambooth and full fine-tuning methods.

by Synced 2023-02-07 1

AI Computer Vision & Graphics Machine Learning & Data Science Research

Google & HUJI Present Dreamix: The First Diffusion Model for General Video Editing

In the new paper Dreamix: Video Diffusion Models Are General Video Editors, a team from Google Research and the Hebrew University of Jerusalem presents Dreamix, a novel approach that leverages a video diffusion model (VDM) to enable text-based motion and appearance video editing.

by Synced 2022-06-27 2

AI Machine Learning & Data Science Research

Google’s Novel Lossy Compression Method Targets Perfect Realism with Only a Single Diffusion Model

In the new paper Lossy Compression with Gaussian Diffusion, a Google Research team presents DiffC, a novel and simple lossy compression method that relies only on an unconditionally trained diffusion generative model and achieves state-of-the-art image compression results despite lacking an encoder transform.

by Synced 2022-06-01 0

AI Machine Learning & Data Science Nature Language Tech Research

Google’s Imagen Text-to-Image Diffusion Model With Deep Language Understanding Defeats DALL-E 2

In the new paper Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding, a Google Brain research team presents Imagen, a text-to-image diffusion model that combines deep language understanding and photorealistic image generation capabilities to achieve a new state-of-the-art FID score of 7.27 on the COCO dataset.