Amazon Alexa AI’s ‘Language Model Is All You Need’ Explores NLU as QA
Amazon Alexa AI paper asks whether NLU problems could be mapped to question-answering (QA) problems using transfer learning.
Category: Popular
German Startup’s “AI Expert Roadmap” Gets 3.5k GitHub Stars
A new AI Expert Roadmap developed by German software company AMAI is garnering keen interest from aspiring AI professionals around the world.
Google, OpenAI & DeepMind: Shared Task Behaviour Priors Can Boost RL and Generalization
In a new paper, researchers from Google, OpenAI, and DeepMind introduce “behaviour priors,” a framework designed to capture common movement and interaction patterns that are shared across a set of related tasks or contexts.
Facebook AI Says Class Selectivity In Neurons May Impair DNN Performance
Facebook AI says DNNs can perform well without class specific neurons and overreliance on intuition-based methods for understanding DNNs can be misleading.
DeepMind Introduces Algorithms for Causal Reasoning in Probability Trees
Probability trees may have been around for decades, but they have received little attention from the AI and ML community.
Amazon’s BERT Optimal Subset: 7.9x Faster & 6.3x Smaller Than BERT
Amazon extracts an optimal subset of architectural parameters for BERT architecture by applying recent breakthroughs in algorithms for neural architecture search.
AI Halloween Avatars! StyleGAN2 Generator Reveals Your Inner Zombie
Now, just in time for costume season, another indie developer has taken facial image transfer tech to the opposite end of the cuteness spectrum, building a zombie generator.
A Look at Google’s Efforts to Earn Public Trust Through ML Fairness and Responsible AI
“Trust in AI systems is becoming, if not already, the biggest barrier for enterprises — as they start to move from exploring AI or potentially piloting or doing some proof of concept works into deploying AI into a production system”
ICLR 2021 Submission | ‘Lambda Networks’ Achieve SOTA Accuracy, Save Massive Memory
ICLR 2021 submission proposes LambdaNetworks, a transformer-specific method that reduces costs of modeling long-range interactions for CV and other applications.
Google Open-Sources 3D System That Shows How Places Looked in the Past
Google AI recently launched the open-source browser-based toolset “rǝ,” which was created to enable the exploration of city transitions from 1800 to 2000 virtually in a three-dimensional view.
MIT Researcher Neil Thompson on Deep Learning’s Insatiable Compute Demands and Possible Solutions
“The Computational Limits of Deep Learning” first author Neil Thompson of MIT says DL’s economic and environmental footprints are growing worrying fast
NeurIPS 2020 Workshop | Indie GAN Interpolation Method Turns Selfies Into Cartoon Characters
Pinkney and Adler NeurIPS 2020 workshop paper enables realistic image generation in domains such as animation and ukiyo-e with creative control on the output.
PwC-Powered Code Tab Added to arXiv ML Papers
PwC and arXiv jointly announced their partnership yesterday, unveiling a convenient new Code tab on the abstract page of arXiv Machine Learning articles.
‘Farewell Convolutions’ – ML Community Applauds Anonymous ICLR 2021 Paper That Uses Transformers for Image Recognition at Scale
ICLR 2021 paper An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale suggests Transformers can outperform top CNNs on CV at scale.
Breakthrough Neuron-Mimicking Nanoscale Electronic Circuit Element for Neuromorphic AI
Researchers introduce an isolated nanoscale electronic circuit element that can perform nonmonotonic operations and transistorless all-analogue computations.
Google, Cambridge, DeepMind & Alan Turing Institute’s ‘Performer’ Transformer Slashes Compute Costs
A team from Google, University of Cambridge, DeepMind, and Alan Turing Institute have proposed a new type of Transformer dubbed Performer, based on a Fast Attention Via positive Orthogonal Random features (FAVOR+) backbone mechanism.
Nvidia Releases ‘Imaginaire’ Library for Image and Video Synthesis
Imaginaire, a universal PyTorch library designed for various GAN-based tasks and methods.
Facebook’s Flexible ‘RAG’ Language Model Achieves SOTA Results on Open-Domain QA
Researchers introduced retrieval-augmented generation - a hybrid, end-to-end differentiable model that combines an information retrieval component with a seq2seq generator.
Facebook AI Wav2Vec 2.0: Automatic Speech Recognition From 10 Minute Sample
Facebook AI researchers have open-sourced the new wav2vec 2.0 algorithm for self-supervised language learning.
Google Approaches BERT-Level Performance Using 300x Fewer Parameters with Extension of Its New NLP model PRADO
The trimmed-down pQRNN extension to Google AI’s projection attention neural network PRADO compares to BERT on text classification tasks for on-device use.
Facebook Reality Labs’ Vision of the Future: ‘Tools that Help People Feel Connected’
VR and AR will converge to combine the real and virtual, as Facebook Reality Labs researchers, developers, and engineers aim to change how we see the world.
Tracking Recent Topics & Trends in 3D Photo Generation
Synced has identified a few significant technical advancements in the 3D photo field that we believe may be of interest to our readers.
Adobe’s DL-Based ‘HDMatt’ Handles Image Details Thinner Than Hair
UIUC, Adobe Research and University of Oregon propose HDMatt, a Deep Learning-based image matting Cross-Patch Context module for high-resolution image inputs.
UC Berkeley Reward-Free RL Beats SOTA Reward-Based RL
Augmented Temporal Contrast (ATC), a new unsupervised learning (UL) task for learning visual representations agnostic to rewards and without degrading the control policy.
After 15 Long Years, a NumPy Paper Finally Appears!
NumPy is the foundation upon which the scientific Python ecosystem is constructed.
Ex-Uber AI Chief Scientist Zoubin Ghahramani Joins Google Brain Leadership Team
Former Uber Chief Scientist and VP for AI Zoubin Ghahramani has joined Google Research as part of the Google Brain team leadership.
Argo AI Model Jointly Plots Vehicle Pose and Shape From LiDAR Data
Researchers have introduced a novel network architecture for jointly estimating the shape and pose of vehicles even from partial LiDAR observations.
OpenAI ‘GPT-f’ Delivers SOTA Performance in Automated Mathematical Theorem Proving
OpenAI researchers introduce GPT-f, an automated prover and proof assistant for the Metamath formalization language.
TinySpeech: Novel Attention Condensers Enable Deep Recognition Networks on Edge Devices
Novel attention condensers designed to enable the building of low-footprint, highly-efficient deep neural networks for on-device speech recognition on the edge.
New Multitask Benchmark Suggests Even the Best Language Models Don’t Have a Clue What They’re Doing
Researchers introduce a test covering topics such as elementary mathematics, designed to measure language models’ multitask accuracy.
Is OpenAI’s GPT-3 API Beta Pricing Too Rich for Researchers?
Although OpenAI hasn’t yet officially announced the GPT-3 pricing scheme, Branwen’s sneak peek has piqued the interest of the NLP community.
DeepMind Uses GNNs to Boost Google Maps ETA Accuracy by up to 50%
DeepMind unveiled a partnership with Google Maps that has leveraged advanced GNNs to improve ETA accuracy.
Nvidia Launches GeForce RTX 30 Series GPUs: ‘a Giant Step Into the Future’
Nvidia CEO Jensen Huang today unveiled the company’s new GeForce RTX 30 Series GPUs.
Elon Musk’s Neuralink Demos Brain-Computer Link in Live Pigs
Last Wednesday, Elon Musk caught the AI community’s attention with a tweet announcing an upcoming “Live webcast of working @Neuralink device…” On Friday, the billionaire tech entrepreneur delivered. With pigs.
Intel Lab Transforms Your Phone into a Robot for $50
Intel Labs researchers have proposed a novel method for building a robot called “OpenBot” on just a US$50 budget.
ECCV 2020 Best Paper Award Goes to Princeton Team
The 16th European Conference on Computer Vision (ECCV) kicked off on Sunday as a fully online conference. In the Conference Opening Session this morning, the ECCV organizing committee announced the conference’s paper submission stats and Best Paper selections.
Sepp Hochreiter on Parallels Between Attention Mechanisms and Modern Hopfield Networks
Researchers argue that “attention mechanism is the update rule of a modern Hopfield network with continuous states.”
Tesla Video Data Processing Supercomputer ‘Dojo’ – Building a 4D System Aiming at L5 Self-Driving
Elon Musk tweeted that Tesla is recruiting AI or chip talents for the company’s neural network training supercomputer project “Dojo.”
DeepMind & McGill Employ Operations Generalization to Divide & Conquer Complex RL Problems
DeepMind and McGill University researchers believe the problem could be solved through a strategic “divide-and-conquer” approach.
Love-Love: Stanford Researchers Generate Realistic ‘Fake’ Wimbledon
A Stanford University research team has responded with an AI-powered model capable of realistically simulating a Wimbledon final and more.