IPPI | Synced

by Synced 2020-03-06 1

AutoCompress: SOTA Automatic DNN Pruning for Ultra-High Compression Rates

Researchers proposed an automatic structured pruning framework, AutoCompress, which adopts the 2018 ADMM-based weight pruning algorithm and outperforms previous automatic model compression methods while maintaining high accuracy.

by Synced 2020-02-21 0

AI Machine Learning & Data Science Research

A look at The Case for Bayesian Deep Learning

Bayesian inference meanwhile leverages Bayes’ theorem to update the probability of a hypothesis as additional data becomes available. How can Bayesian inference benefit deep learning models?

by Synced 2019-11-07 1

AI Research

Google T5 Explores the Limits of Transfer Learning

Synced invited Samuel R. Bowman, an Assistant Professor at New York University who works on artificial neural network models for natural language understanding, to share his thoughts on the “Text-to-Text Transfer Transformer” (T5) framework.

by Synced 2019-10-31 4

AI Research

Google Introduces Huge Universal Language Translation Model: 103 Languages Trained on Over 25 Billion Examples

Synced invited Graham Neubig, an Assistant Professor from Carnegie Mellon University to share his thoughts on Google’s universal neural machine translation (NMT) system trained on over 25 billion examples that can handle 103 languages proposed.