ACL 2020 Announces Best Paper & Test-Of-Time Awards
Organizers of the 58th Annual Meeting of the Association for Computational Linguistics (ACL) today announced their Best Paper Awards.
Category: Nature Language Tech
Answering Multi-Hop Open-Domain Questions With Graph-Based Recurrent Retrieval
Researchers from the University of Washington, Salesforce Research and Allen Institute for Artificial Intelligence have introduced a graph-based method that retrieves reasoning paths to boost multi-hop open-domain question answering.
From Texts to Kitties: OpenAI’s GPT Language Model Tackles Image Generation
Large transformer-based language models trained on pixel sequences can generate coherent images without the use of labels.
A Look at Recent Advances in Google Translate
In a recent Google AI team blog post, researchers report on recent efforts and progress in the field of language translation, especially with resource-poor languages.
DeepMind Introduces ‘EATS’ – An Adversarial, End-to-End Approach to TTS
DeepMind researchers have developed EATS, a generative model trained adversarially in an end-to-end manner that achieves performance comparable to SOTA models.
DeepMind Says Syntactic Biases ‘Helped BERT Do Better’
Researchers add syntactic biases to determine whether and where they can help BERT achieve better understanding.
Bengio-Backed Startup Korbit Introduces STEM Intelligent Tutoring System
Canadian education technology startup Korbit Technologies has introduced a personalized AI-powered learning experience that it says can help all students learn faster and better in a cost-effective way.
Google Introduces BLEURT – a BERT-Based NLG Evaluation Metric
Google Research team proposes the automatic metric BLEURT which is based on the highly successful Google language model BERT.
ACL 2020 Announces Its 779 Accepted Papers
Organizers of the 58th annual meeting of the Association for Computational Linguistics (ACL) on Sunday announced the list of accepted papers for the world-leading natural language processing (NLP) conference.
Facebook’s Highly Efficient New Real-Time Text-To-Speech System Runs on CPUs
To deliver human-level voices to its platform’s billions of users while maintaining strict compute efficiency, Facebook AI researchers have deployed a new neural TTS system that works on CPU servers.
AI2 & UW Researchers Propose ‘TL;DR’ Paper Summarization Task
A team from the Allen Institute for Artificial Intelligence and the University of Washington this week introduced TLDR generation, a new automatic summarization task for scientific papers.
Facebook Says Its ‘Blender’ Chatbot Is the Most Humanlike Ever
This is the first chatbot to blend a diverse set of conversational skills — including empathy, knowledge, and personality — together in one system.
AI21 Labs Asks: How Much Does It Cost to Train NLP Models?
How much is this going to cost? And what are the main factors affecting that price tag?
New Study Tracks NLP Development and Direction Through a ‘World Scope’
Researchers “posit that the universes of knowledge and experience available to NLP models can be defined by successively larger world scopes: from a single corpus to a fully embodied and social context.”
CMU, DeepMind & Google’s XTREME Benchmarks Multilingual Model Generalization Across 40 Languages
XTREME, a multi-task benchmark that evaluates cross-lingual generalization capabilities of multilingual representations across 40 languages and nine tasks.
Covid-Sanity Interface Elegantly and Efficiently Organizes Web COVID-19 Papers
Covid-Sanity, a web interface designed to navigate the flood of bioRxiv and medRxiv COVID-19 papers and make the research within more searchable and sortable.
BERTLang Helps Researchers Choose Between BERT Models
Researchers from Bocconi University have prepared an online overview of the commonalities and differences between language-specific BERT models and mBERT.
BERT-of-Theseus: Compressing BERT by Progressive Module Replacing
Researchers propose a novel model compression approach to effectively compress BERT by progressive module replacing.
Retrieving Reasoning Paths for Answering Complex Questions
In an attempt to equip the TF-IDF-based retriever with a state-of-the-art neural reading comprehension model, researchers introduced a new graph-based recurrent retrieval approach.
Self-Adversarial Learning with Comparative Discrimination for Text Generation
Researchers have proposed a novel self-adversarial learning (SAL) paradigm for improving GANs’ performance in text generation.
Up Close and Personal With BERT – Google’s Epoch-Making Language Model
A recent Google Brain paper looks into Google’s hugely successful transformer network — BERT — and how it represents linguistic information internally.
17 Billion Parameters! Microsoft DeepSpeed Breeds World’s Largest NLP Model
Deep learning models are getting larger and larger to meet the demand for better and better performance. Meanwhile, the timeContinue Reading
DeepMind & UCL Introduce New Model and Test Set for Inference
Now, DeepMind and University College London (UCL) have introduced a new deep network called MEMO which matches SOTA results on Facebook’s bAbI dataset for testing text understanding and reasoning, and is the first and only architecture capable of solving long sequence novel reasoning tasks.
Meet Meena: A Truly Chatty Chatbot
One of a new breed of open-domain chatbots designed to engage in conversations across any topic, Meena’s free and natural conversational abilities are closing the gap on human performance.
Facebook AI mBART: The Tower of Babel’s Silicon Solution
Facebook AI researchers have further developed the BART model with the introduction of mBART.
AraNet: New Deep Learning Toolkit for Arabic Social Media
A team of researchers from the Natural Language Processing Lab at the University of British Columbia in Canada have proposed AraNet, a deep learning toolkit designed for Arabic social media processing.
Say Woof? AI in Animal Language Translation
No matter whether we’re sharing our lives with beloved household pets or protecting wildlife in a remote location, wouldn’t it be wonderful if we could somehow lift the language barrier that has impeded interspecies communication for millennia?
Microsoft ImageBERT | Cross-modal Pretraining with Large-scale Image-Text Data
A recent paper published by Microsoft researchers proposes a new vision-language pretrained model for image-text joint embedding, ImageBERT, which which achieves SOTA performance on both the MSCOCO and Flickr30k datasets.
Hallo! Hallo! KU Leuven & TU Berlin Introduce ‘RobBERT,’ a SOTA Dutch BERT
A group of researchers from The Katholieke Universiteit Leuven and The Technical University of Berlin recently introduced a Dutch RoBERTa-based language model, RobBERT.
Facebook AI | Text-Based Generation of Interactive Worlds
Researchers recently proposed a new machine learning method for worldbuilding based on content from LIGHT, a research environment open-sourced by Facebook comprising crowd-sourced game locations, characters, and objects, etc.
Google Releases ALBERT V2 & Chinese-Language Models
Google has now released a major V2 ALBERT update and open-sourced Chinese ALBERT models.