ProtTrans Delivers SOTA Pretrained Language Models for Proteins
Researchers launched the ProtTrans Project, which provides an outstanding model for protein pretraining.
Tag: NLP research
PLATO-2: The State-Of-The-Art Open-Domain Chatbot in Chinese and English
PLATO-2, a open-domain chatbot model, can talk about anything in Chinese and English and engage in deep conversations.
DeepMind Says Syntactic Biases ‘Helped BERT Do Better’
Researchers add syntactic biases to determine whether and where they can help BERT achieve better understanding.
OpenAI Unveils 175 Billion Parameter GPT-3 Language Model
OpenAI announced the upgraded GPT-3 with a whopping 175 billion parameters.
Google Introduces BLEURT – a BERT-Based NLG Evaluation Metric
Google Research team proposes the automatic metric BLEURT which is based on the highly successful Google language model BERT.
How AI Is Transforming Financial Reimbursement
Artificial intelligence (AI) technologies are now widely used in tasks such as reimbursement specifications, automated financial statement generation, and content extraction.
Facebook Says Its ‘Blender’ Chatbot Is the Most Humanlike Ever
This is the first chatbot to blend a diverse set of conversational skills — including empathy, knowledge, and personality — together in one system.
New Study Tracks NLP Development and Direction Through a ‘World Scope’
Researchers “posit that the universes of knowledge and experience available to NLP models can be defined by successively larger world scopes: from a single corpus to a fully embodied and social context.”
CMU, DeepMind & Google’s XTREME Benchmarks Multilingual Model Generalization Across 40 Languages
XTREME, a multi-task benchmark that evaluates cross-lingual generalization capabilities of multilingual representations across 40 languages and nine tasks.
BERTLang Helps Researchers Choose Between BERT Models
Researchers from Bocconi University have prepared an online overview of the commonalities and differences between language-specific BERT models and mBERT.
Up Close and Personal With BERT – Google’s Epoch-Making Language Model
A recent Google Brain paper looks into Google’s hugely successful transformer network — BERT — and how it represents linguistic information internally.
17 Billion Parameters! Microsoft DeepSpeed Breeds World’s Largest NLP Model
Deep learning models are getting larger and larger to meet the demand for better and better performance. Meanwhile, the timeContinue Reading
Meet Meena: A Truly Chatty Chatbot
One of a new breed of open-domain chatbots designed to engage in conversations across any topic, Meena’s free and natural conversational abilities are closing the gap on human performance.
Microsoft ImageBERT | Cross-modal Pretraining with Large-scale Image-Text Data
A recent paper published by Microsoft researchers proposes a new vision-language pretrained model for image-text joint embedding, ImageBERT, which which achieves SOTA performance on both the MSCOCO and Flickr30k datasets.
Google & UC Berkeley ‘Reformer’ Runs 64K Sequences on One GPU
A recent paper accepted by ICLR 2020 proposes a new transformer model called “Reformer” which achieves impressive performance even when running on only a single GPU.
Stanford, Kyoto & Georgia Tech Model ‘Neutralizes’ Biased Language
Pryzant and other Stanford researchers partnered with researchers from Kyoto University and Georgia Institute of Technology to develop a novel natural language model that can identify and neutralize biased framings, presuppositions, attitudes, etc. in text.
Google T5 Explores the Limits of Transfer Learning
Synced invited Samuel R. Bowman, an Assistant Professor at New York University who works on artificial neural network models for natural language understanding, to share his thoughts on the “Text-to-Text Transfer Transformer” (T5) framework.
Baidu’s ERNIE 2.0 Beats BERT and XLNet on NLP Benchmarks
Today, the research division of the Chinese search giant released their updated ERNIE 2.0, a pretrained language understanding model with significant improvements.
ACL 2019 Reports Record-High Paper Submissions; Begins Notifying Accepted Authors
The annual meeting of the Association for Computational Linguistics (ACL) is world-leading conference in the field of natural language processing, Yesterday, conference organizers sent out author notifications on accepted papers for the 57th ACL gathering, which will take place in Florence, Italy from July 28 to August 2.
Is Baidu the No. 1 Player on China’s National Team of Artificial Intelligence?
“The Internet is just an appetizer, whereas AI is the real entrée. The latter is not a part of the internet, not the second stage of the internet; it is technological revolution comparable to the industrial revolution.” – Robin Li, CEO of Baidu.