Facebook Proposes Free-Viewpoint Rendering on Monocular Video
Facebook’s new model enables free-viewpoint rendering of dynamic scenes in a single video.
Tag: Media Synthesis
Nvidia Releases ‘Imaginaire’ Library for Image and Video Synthesis
Imaginaire, a universal PyTorch library designed for various GAN-based tasks and methods.
Love-Love: Stanford Researchers Generate Realistic ‘Fake’ Wimbledon
A Stanford University research team has responded with an AI-powered model capable of realistically simulating a Wimbledon final and more.
Adobe and Stanford Unveil SOTA Method for Human Pose Estimation
The researchers say the approach produces motions that are visually and physically much more plausible than state-of-the-art methods.
Joint Spatial-Temporal Transformation Learning Boosts Video Inpainting Performance
Researchers introduce a joint Spatial-Temporal Transformer Network (STTN) to tackle such video inpainting challenges.
NVIDIA Novel vid2vid Framework Synthesizes Realistic World-Consistent Videos
NVIDIA researchers propose a novel vid2vid framework that utilizes all past generated frames during rendering.
DeepFaceDrawing Generates Photorealistic Portraits from Freehand Sketches
A team of researchers from the Chinese Academy of Sciences and the City University of Hong Kong has introduced a local-to-global approach that can generate lifelike human portraits from relatively rudimentary sketches.
Cross-domain Correspondence Learning for Exemplar-based Image Translation
We present a general framework for exemplar-based image translation, which synthesizes a photo-realistic image from the input in a distinct domain, given an exemplar image.
Bringing Old Photos Back to Life
The proposed method outperforms supervised methods and unsupervised translation methods on restoring real photos.
Sing Along! Japanese Researchers Develop Multispeaker Corpus for Singing Voice Synthesis
In an effort to enrich resources for multispeaker singing-voice synthesis, a team of researchers from the University of Tokyo has developed a Japanese multispeaker singing-voice corpus.
Attention Please! Remastering Vintage Films With Temporal Source-Reference Attention Networks
Researchers from the University of Tsukuba and Waseda University in Japan recently introduced a single framework designed to tackle an entire range of remastering tasks for films that have been converted to digital data.
Deep Learning Model Morphs VTube Talking Heads With a Few Mouse Clicks
A Google researcher has released a deep neural network model that makes animating a VTube persona a little easier.
MarioNETte: Few-Shot Identity Preservation in Facial Reenactment
Researchers from the South Korea-based tech company Hyperconnect recently proposed a new framework, MarioNETte, which aims to reenact target faces in a few-shot manner (from even a single image) while preserving identity without any fine-tuning.
AI Is Tearing Up the Dancing Floor Again
For decades machines have been able to understand simple musical features like beats per minute. Now AI is boosting their abilities to the point that they can not only figure out what particular genre of music is playing, but also how to appropriately dance to it.
Shake Your Booty: AI Deepfakes Dance Moves From a Single Picture
Do you have two left feet? Do you avoid the dance floor out of fear of embarrassment? If you’ve ever secretly wished you could move your body like Joaquín Cortés — well, at least in a video — a new AI-powered 3D body mesh recovery module called Liquid Warping GAN can give you a leg up.
Robot Music Through the Ages
With recent developments in artificial intelligence and automation in machines, robots are advancing into previously unexplored industries such as music and entertainment.