Preferred Networks’ ChainerRL Joins PyTorch Ecosystem as ‘PFRL’
Japanese AI startup Preferred Networks (PFN) is moving ChainerRL to the PyTorch ecosystem.
Category: Research
Technical review of the newest machine intelligence research.
ICLR 2021 Submission | ‘Lambda Networks’ Achieve SOTA Accuracy, Save Massive Memory
ICLR 2021 submission proposes LambdaNetworks, a transformer-specific method that reduces costs of modeling long-range interactions for CV and other applications.
Facebook AI Model Directly Translates 100 Languages Without Using English Data
Facebook AI open-sourced a multilingual machine translation (MMT) model that translates between any pair of 100 languages without relying on English data.
UK Researchers Say AI Needs More Animal Sense
The UK researchers identify just how much AI research might benefit from the field of animal cognition.
Google Open-Sources 3D System That Shows How Places Looked in the Past
Google AI recently launched the open-source browser-based toolset “rǝ,” which was created to enable the exploration of city transitions from 1800 to 2000 virtually in a three-dimensional view.
MIT, TU Wien & IST Austria Brain-Based AI Self-Drives With Just a Few Neurons
An international research team is suggesting AI might become even more efficient and reliable if it learns to think more like worms.
Facebook & CMU Open Catalyst Project Applies AI to Renewable Energy Storage
A new Facebook AI and CMU renewable energy storage project could enable labs to perform days of electrocatalyst screening and calculations in just seconds.
MIT Researcher Neil Thompson on Deep Learning’s Insatiable Compute Demands and Possible Solutions
“The Computational Limits of Deep Learning” first author Neil Thompson of MIT says DL’s economic and environmental footprints are growing worrying fast
NeurIPS 2020 Workshop | Indie GAN Interpolation Method Turns Selfies Into Cartoon Characters
Pinkney and Adler NeurIPS 2020 workshop paper enables realistic image generation in domains such as animation and ukiyo-e with creative control on the output.
ICLR 2021 Submission: Deeper VAEs Excel on Natural Image Benchmarks
ICLR 2021 submitted paper proposes efficient VAEs that outperform PixelCNN-based autoregressive models in log-likelihood on natural image benchmarks.
ByteDance High-Resolution AMT System Achieves SOTA in Piano Note and Pedal Transcription
ByteDance introduces a high-resolution piano transcription system trained by regressing the precise onset and offset times of piano notes and pedals.
PwC-Powered Code Tab Added to arXiv ML Papers
PwC and arXiv jointly announced their partnership yesterday, unveiling a convenient new Code tab on the abstract page of arXiv Machine Learning articles.
‘Farewell Convolutions’ – ML Community Applauds Anonymous ICLR 2021 Paper That Uses Transformers for Image Recognition at Scale
ICLR 2021 paper An Image Is Worth 16×16 Words: Transformers for Image Recognition at Scale suggests Transformers can outperform top CNNs on CV at scale.
Google, Stanford, & MIT Top NeurIPS 2020 Accepted Papers List
NeurIPS 2020 released its list of accepted papers this week with Google, Stanford, and MIT as the top affiliations.
Breakthrough Neuron-Mimicking Nanoscale Electronic Circuit Element for Neuromorphic AI
Researchers introduce an isolated nanoscale electronic circuit element that can perform nonmonotonic operations and transistorless all-analogue computations.
NVIDIA & Mass General Brigham Hospital Federated Learning Project Predicts COVID-19 Patient Oxygen Need Using 20 Days of Data From 20 Hospitals
NVIDIA, Mass General Brigham and 20 global hospitals launch federated learning initiative EXAM to build AI model for COVID-19 patient oxygen need prediction
Google AI Helps Sign Language ‘Take the Floor’ in Video Conferences
Google AI researchers developed a sign language detection model for video conferencing applications that can perform real-time identification of a person signing as an active speaker.
LPar – A Distributed Multi Agent Platform for Building Polyglot, Omni Channel and Industrial Grade Natural Language Interfaces
LPar, a distributed multi agent platform for large scale industrial deployment of polyglot, diverse and inter-operable agents.
Google AI ‘Looking to Listen’ Tech Enables Speech Enhancement on YouTube Stories in Seconds
Google AI has announced a new audiovisual speech enhancement feature in YouTube Stories (iOS) that enables creators to make better selfie videos by automatically enhancing their voices and reducing noise.
Google, Cambridge, DeepMind & Alan Turing Institute’s ‘Performer’ Transformer Slashes Compute Costs
A team from Google, University of Cambridge, DeepMind, and Alan Turing Institute have proposed a new type of Transformer dubbed Performer, based on a Fast Attention Via positive Orthogonal Random features (FAVOR+) backbone mechanism.
EvolGAN Boosts Image Quality for Small or Difficult Datasets
Novel model uses a quality estimator and evolutionary optimization to search the latent space of GANs trained on limited datasets.
Nvidia Releases ‘Imaginaire’ Library for Image and Video Synthesis
Imaginaire, a universal PyTorch library designed for various GAN-based tasks and methods.
Facebook’s Flexible ‘RAG’ Language Model Achieves SOTA Results on Open-Domain QA
Researchers introduced retrieval-augmented generation - a hybrid, end-to-end differentiable model that combines an information retrieval component with a seq2seq generator.
Google Introduces TensorFlow Recommenders, ‘Helping Users Find What They Love’
Google Brain recently introduced a new open-sourced TensorFlow package, TensorFlow Recommenders designed to simplify the process of building, evaluating, and serving sophisticated recommender models.
Facebook AI Wav2Vec 2.0: Automatic Speech Recognition From 10 Minute Sample
Facebook AI researchers have open-sourced the new wav2vec 2.0 algorithm for self-supervised language learning.
KDD 2020 Celebrates Recipients of the SIGKDD Best Paper Awards
Top Data Scientists Honored for Advanced Research and Applied Data Science in the Field of Knowledge Discovery in Data and Data Mining
Lightweight 3D Dense Face Alignment? New Chinese Model is ‘Fast, Accurate and Stable’
Chinese researchers propose a novel regression framework in pursuit of “fast, accurate and stable 3D dense face alignment simultaneously.”
Google Approaches BERT-Level Performance Using 300x Fewer Parameters with Extension of Its New NLP model PRADO
The trimmed-down pQRNN extension to Google AI’s projection attention neural network PRADO compares to BERT on text classification tasks for on-device use.
Facebook Reality Labs’ Vision of the Future: ‘Tools that Help People Feel Connected’
VR and AR will converge to combine the real and virtual, as Facebook Reality Labs researchers, developers, and engineers aim to change how we see the world.
Tracking Recent Topics & Trends in 3D Photo Generation
Synced has identified a few significant technical advancements in the 3D photo field that we believe may be of interest to our readers.
Microsoft Gets Exclusive License for OpenAI’s GPT-3 Language Model
Microsoft announced today that it has teamed up with OpenAI to exclusively license the AI research institute’s GPT-3 language model.
Adobe’s DL-Based ‘HDMatt’ Handles Image Details Thinner Than Hair
UIUC, Adobe Research and University of Oregon propose HDMatt, a Deep Learning-based image matting Cross-Patch Context module for high-resolution image inputs.
UC Berkeley Reward-Free RL Beats SOTA Reward-Based RL
Augmented Temporal Contrast (ATC), a new unsupervised learning (UL) task for learning visual representations agnostic to rewards and without degrading the control policy.
New Google & Oxford Model Time-Shifts People in Videos
A group of researchers from Google Research and the University of Oxford have introduced a novel technique that can “retiming” people’s movements in videos.
After 15 Long Years, a NumPy Paper Finally Appears!
NumPy is the foundation upon which the scientific Python ecosystem is constructed.
New DeepMind Approach ‘Bootstraps’ Self-Supervised Learning of Image Representations
From an augmented view of an image, the researchers trained the online network to predict the target network representation of the same image under a different augmented view.
Czech Tech Does the Monster Mash: Animating 3D Models in Seconds
Monster Mash, a novel AI-powered 3D modelling and animation tool, aims to make these arduous 3D animation processes a whole lot easier.
Facebook AI Enables Automatic Closed Captions for Facebook Live
Facebook AI researchers and engineers just made live video content more accessible by enabling automatic closed captions for Facebook Live and Workplace Live.
Human Feedback Improves OpenAI Model Summarizations
OpenAI sets out to advance methods for training large-scale language models on objectives that more closely capture human preferences.
Microsoft Democratizes DeepSpeed With Four New Technologies
Microsoft has released four additional DeepSpeed technologies to enable even faster training times, whether on supercomputers or a single GPU.