Language model

by Synced 2020-05-08 0

AI2 & UW Researchers Propose ‘TL;DR’ Paper Summarization Task

A team from the Allen Institute for Artificial Intelligence and the University of Washington this week introduced TLDR generation, a new automatic summarization task for scientific papers.

by Synced 2019-11-21 0

AI Research

Voila! SOTA French Language Model ‘CamemBERT’ Debuts

Now, a team from Facebook AI Research, Inria, and Sorbonne Université have released CamemBERT, essentially a French version of Google AI’s game-changing pretrained language model BERT.

by Synced 2019-11-05 1

AI Research

OpenAI Releases 1.5 Billion Parameter GPT-2 Model

In a blog post today OpenAI today announced the final staged release of its 1.5 billion parameter language model GPT-2, along with all associated code and model weights.

by Synced 2019-09-27 0

AI Research

Google’s ALBERT Is a Leaner BERT; Achieves SOTA on 3 NLP Benchmarks

Google’s new “ALBERT” language model has achieved state-of-the-art results on three popular benchmark tests for natural language understanding (NLU): GLUE, RACE, and SQuAD 2.0.

by Synced 2019-02-24 0

AI AI Weekly

OpenAI or ClosedAI? That Is A Question.

Synced Global AI Weekly February 24th

by Synced 2019-02-20 0

AI Research

PyTorch Reimplementation of OpenAI GPT-2 Small Model Released

Github developer Hugging Face has updated its repository with a PyTorch reimplementation of the GPT-2 language model small version that OpenAI open-sourced last week, along with pretrained models and fine-tuning examples.