17 Billion Parameters! Microsoft DeepSpeed Breeds World’s Largest NLP Model
Deep learning models are getting larger and larger to meet the demand for better and better performance. Meanwhile, the timeContinue Reading
AI Technology & Industry Review
Deep learning models are getting larger and larger to meet the demand for better and better performance. Meanwhile, the timeContinue Reading
Now, DeepMind and University College London (UCL) have introduced a new deep network called MEMO which matches SOTA results on Facebook’s bAbI dataset for testing text understanding and reasoning, and is the first and only architecture capable of solving long sequence novel reasoning tasks.
One of a new breed of open-domain chatbots designed to engage in conversations across any topic, Meena’s free and natural conversational abilities are closing the gap on human performance.
Facebook AI researchers have further developed the BART model with the introduction of mBART.
A team of researchers from the Natural Language Processing Lab at the University of British Columbia in Canada have proposed AraNet, a deep learning toolkit designed for Arabic social media processing.
No matter whether we’re sharing our lives with beloved household pets or protecting wildlife in a remote location, wouldn’t it be wonderful if we could somehow lift the language barrier that has impeded interspecies communication for millennia?
A recent paper published by Microsoft researchers proposes a new vision-language pretrained model for image-text joint embedding, ImageBERT, which which achieves SOTA performance on both the MSCOCO and Flickr30k datasets.
A group of researchers from The Katholieke Universiteit Leuven and The Technical University of Berlin recently introduced a Dutch RoBERTa-based language model, RobBERT.
Researchers recently proposed a new machine learning method for worldbuilding based on content from LIGHT, a research environment open-sourced by Facebook comprising crowd-sourced game locations, characters, and objects, etc.
Google has now released a major V2 ALBERT update and open-sourced Chinese ALBERT models.