MIT Researcher Neil Thompson on Deep Learning’s Insatiable Compute Demands and Possible Solutions
“The Computational Limits of Deep Learning” first author Neil Thompson of MIT says DL’s economic and environmental footprints are growing worrying fast
Category: Popular
NeurIPS 2020 Workshop | Indie GAN Interpolation Method Turns Selfies Into Cartoon Characters
Pinkney and Adler NeurIPS 2020 workshop paper enables realistic image generation in domains such as animation and ukiyo-e with creative control on the output.
PwC-Powered Code Tab Added to arXiv ML Papers
PwC and arXiv jointly announced their partnership yesterday, unveiling a convenient new Code tab on the abstract page of arXiv Machine Learning articles.
‘Farewell Convolutions’ – ML Community Applauds Anonymous ICLR 2021 Paper That Uses Transformers for Image Recognition at Scale
ICLR 2021 paper An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale suggests Transformers can outperform top CNNs on CV at scale.
Breakthrough Neuron-Mimicking Nanoscale Electronic Circuit Element for Neuromorphic AI
Researchers introduce an isolated nanoscale electronic circuit element that can perform nonmonotonic operations and transistorless all-analogue computations.
Google, Cambridge, DeepMind & Alan Turing Institute’s ‘Performer’ Transformer Slashes Compute Costs
A team from Google, University of Cambridge, DeepMind, and Alan Turing Institute have proposed a new type of Transformer dubbed Performer, based on a Fast Attention Via positive Orthogonal Random features (FAVOR+) backbone mechanism.
Nvidia Releases ‘Imaginaire’ Library for Image and Video Synthesis
Imaginaire, a universal PyTorch library designed for various GAN-based tasks and methods.
Facebook’s Flexible ‘RAG’ Language Model Achieves SOTA Results on Open-Domain QA
Researchers introduced retrieval-augmented generation - a hybrid, end-to-end differentiable model that combines an information retrieval component with a seq2seq generator.
Facebook AI Wav2Vec 2.0: Automatic Speech Recognition From 10 Minute Sample
Facebook AI researchers have open-sourced the new wav2vec 2.0 algorithm for self-supervised language learning.
Google Approaches BERT-Level Performance Using 300x Fewer Parameters with Extension of Its New NLP model PRADO
The trimmed-down pQRNN extension to Google AI’s projection attention neural network PRADO compares to BERT on text classification tasks for on-device use.
Facebook Reality Labs’ Vision of the Future: ‘Tools that Help People Feel Connected’
VR and AR will converge to combine the real and virtual, as Facebook Reality Labs researchers, developers, and engineers aim to change how we see the world.
Tracking Recent Topics & Trends in 3D Photo Generation
Synced has identified a few significant technical advancements in the 3D photo field that we believe may be of interest to our readers.
Adobe’s DL-Based ‘HDMatt’ Handles Image Details Thinner Than Hair
UIUC, Adobe Research and University of Oregon propose HDMatt, a Deep Learning-based image matting Cross-Patch Context module for high-resolution image inputs.
UC Berkeley Reward-Free RL Beats SOTA Reward-Based RL
Augmented Temporal Contrast (ATC), a new unsupervised learning (UL) task for learning visual representations agnostic to rewards and without degrading the control policy.
After 15 Long Years, a NumPy Paper Finally Appears!
NumPy is the foundation upon which the scientific Python ecosystem is constructed.
Ex-Uber AI Chief Scientist Zoubin Ghahramani Joins Google Brain Leadership Team
Former Uber Chief Scientist and VP for AI Zoubin Ghahramani has joined Google Research as part of the Google Brain team leadership.
Argo AI Model Jointly Plots Vehicle Pose and Shape From LiDAR Data
Researchers have introduced a novel network architecture for jointly estimating the shape and pose of vehicles even from partial LiDAR observations.
OpenAI ‘GPT-f’ Delivers SOTA Performance in Automated Mathematical Theorem Proving
OpenAI researchers introduce GPT-f, an automated prover and proof assistant for the Metamath formalization language.
TinySpeech: Novel Attention Condensers Enable Deep Recognition Networks on Edge Devices
Novel attention condensers designed to enable the building of low-footprint, highly-efficient deep neural networks for on-device speech recognition on the edge.
New Multitask Benchmark Suggests Even the Best Language Models Don’t Have a Clue What They’re Doing
Researchers introduce a test covering topics such as elementary mathematics, designed to measure language models’ multitask accuracy.
Is OpenAI’s GPT-3 API Beta Pricing Too Rich for Researchers?
Although OpenAI hasn’t yet officially announced the GPT-3 pricing scheme, Branwen’s sneak peek has piqued the interest of the NLP community.
DeepMind Uses GNNs to Boost Google Maps ETA Accuracy by up to 50%
DeepMind unveiled a partnership with Google Maps that has leveraged advanced GNNs to improve ETA accuracy.
Nvidia Launches GeForce RTX 30 Series GPUs: ‘a Giant Step Into the Future’
Nvidia CEO Jensen Huang today unveiled the company’s new GeForce RTX 30 Series GPUs.
Elon Musk’s Neuralink Demos Brain-Computer Link in Live Pigs
Last Wednesday, Elon Musk caught the AI community’s attention with a tweet announcing an upcoming “Live webcast of working @Neuralink device…” On Friday, the billionaire tech entrepreneur delivered. With pigs.
Intel Lab Transforms Your Phone into a Robot for $50
Intel Labs researchers have proposed a novel method for building a robot called “OpenBot” on just a US$50 budget.
ECCV 2020 Best Paper Award Goes to Princeton Team
The 16th European Conference on Computer Vision (ECCV) kicked off on Sunday as a fully online conference. In the Conference Opening Session this morning, the ECCV organizing committee announced the conference’s paper submission stats and Best Paper selections.
Sepp Hochreiter on Parallels Between Attention Mechanisms and Modern Hopfield Networks
Researchers argue that “attention mechanism is the update rule of a modern Hopfield network with continuous states.”
Tesla Video Data Processing Supercomputer ‘Dojo’ – Building a 4D System Aiming at L5 Self-Driving
Elon Musk tweeted that Tesla is recruiting AI or chip talents for the company’s neural network training supercomputer project “Dojo.”
DeepMind & McGill Employ Operations Generalization to Divide & Conquer Complex RL Problems
DeepMind and McGill University researchers believe the problem could be solved through a strategic “divide-and-conquer” approach.
Love-Love: Stanford Researchers Generate Realistic ‘Fake’ Wimbledon
A Stanford University research team has responded with an AI-powered model capable of realistically simulating a Wimbledon final and more.
Tour the World From Your Couch: Google ‘NeRF-W’ Delivers Accurate 3D Scene Reconstruction of Complex Outdoor Environments
Google researchers have introduced a series of extensions to the SOTA view-synthesis method Neural Radiance Fields (NeRF) that enable it to produce high-quality 3D representations of complex scenes with only unstructured image collections as input.
Eyes on Me: Google AI ‘MediaPipe Iris’ Improves Iris Tracking and Distance Estimation
MediaPipe Iris, a novel machine learning model designed to deliver accurate iris estimation without using depth sensors.
Pixel2Style2Pixel: Novel Encoder Architecture Boosts Facial Image-To-Image Translation
Researchers from Penta-AI and Tel-Aviv University introduce a generic image-to-image translation framework dubbed Pixel2Style2Pixel (pSp).