Voila! SOTA French Language Model ‘CamemBERT’ Debuts
Now, a team from Facebook AI Research, Inria, and Sorbonne Université have released CamemBERT, essentially a French version of Google AI’s game-changing pretrained language model BERT.
Tag: Language model
OpenAI Releases 1.5 Billion Parameter GPT-2 Model
In a blog post today OpenAI today announced the final staged release of its 1.5 billion parameter language model GPT-2, along with all associated code and model weights.
Google’s ALBERT Is a Leaner BERT; Achieves SOTA on 3 NLP Benchmarks
Google’s new “ALBERT” language model has achieved state-of-the-art results on three popular benchmark tests for natural language understanding (NLU): GLUE, RACE, and SQuAD 2.0.
OpenAI or ClosedAI? That Is A Question.
Synced Global AI Weekly February 24th
PyTorch Reimplementation of OpenAI GPT-2 Small Model Released
Github developer Hugging Face has updated its repository with a PyTorch reimplementation of the GPT-2 language model small version that OpenAI open-sourced last week, along with pretrained models and fine-tuning examples.