AI Technology & Industry Review
A Microsoft research team provides concrete evidence showing that existing NLP models cannot robustly solve even the simplest of Math word problems, suggesting the hope that they might capably handle one-unknown arithmetic MWPs is untenable.
To track progress in natural language generation (NLG) models, 55 researchers from more than 40 prestigious institutions have proposed GEM (Generation, Evaluation, and Metrics), a “living benchmark” NLG evaluation environment.
Researchers from the University of Sheffield, Beihang University, and Open University’s Knowledge Media Institute have proposed a transfer learning approach that can automatically process historical texts at a semantic level to generate modern language summaries.
Researchers from Drexel University, Northeastern University and IT University Copenhagen explore how humans interact with AI in such contexts, with a focus on computer games.
Google Brain’s Switch Transformer language model packs a whopping 1.6 trillion parameters while effectively controlling computational cost. The model achieved a 4x pretraining speedup over a strongly tuned T5-XXL baseline.
A new model surpassed human baseline performance on the challenging natural language understanding benchmark.
OpenAI has trained a neural network called DALL·E that creates images from text captions for a wide range of concepts expressible in natural language.
Airbus has developed a new Smart Librarian (SL) FCOM QA system comprising a dialogue engine, retriever (search engine), and QA module.
In EMNLP 2020, a Montreal-based research team introduced a large medical text dataset designed to boost abbreviation disambiguation in the medical domain.
The Conference on Empirical Methods in Natural Language Processing (EMNLP 2020) kicked off on Monday as a virtual conference.
A new study proposes using human feedback and interaction logs to boost offline reinforcement learning (RL) in natural language processing (NLP).
Amazon Alexa AI paper asks whether NLU problems could be mapped to question-answering (QA) problems using transfer learning.
Amazon extracts an optimal subset of architectural parameters for BERT architecture by applying recent breakthroughs in algorithms for neural architecture search.
Google recently introduced mT5, a multilingual variant of its “Text-to-Text Transfer Transformer” (T5), pretrained on a new Common Crawl-based dataset covering 101 languages.
Facebook AI open-sourced a multilingual machine translation (MMT) model that translates between any pair of 100 languages without relying on English data.
NeurIPS 2020 released its list of accepted papers this week with Google, Stanford, and MIT as the top affiliations.
Google AI has announced a new audiovisual speech enhancement feature in YouTube Stories (iOS) that enables creators to make better selfie videos by automatically enhancing their voices and reducing noise.
A team from Google, University of Cambridge, DeepMind, and Alan Turing Institute have proposed a new type of Transformer dubbed Performer, based on a Fast Attention Via positive Orthogonal Random features (FAVOR+) backbone mechanism.
The trimmed-down pQRNN extension to Google AI’s projection attention neural network PRADO compares to BERT on text classification tasks for on-device use.
Microsoft announced today that it has teamed up with OpenAI to exclusively license the AI research institute’s GPT-3 language model.
Facebook AI researchers and engineers just made live video content more accessible by enabling automatic closed captions for Facebook Live and Workplace Live.
OpenAI sets out to advance methods for training large-scale language models on objectives that more closely capture human preferences.
OpenAI researchers introduce GPT-f, an automated prover and proof assistant for the Metamath formalization language.
Researchers introduce a test covering topics such as elementary mathematics, designed to measure language models’ multitask accuracy.
Although OpenAI hasn’t yet officially announced the GPT-3 pricing scheme, Branwen’s sneak peek has piqued the interest of the NLP community.
AMBERT (A Multigrained BERT) leverages both fine-grained and coarse-grained tokenizations to achieve SOTA performance on English and Chinese language tasks.
Qian Yan, a plan to jointly develop the world’s largest Chinese natural language processing database.
Researchers argue that “attention mechanism is the update rule of a modern Hopfield network with continuous states.”
Google Research released a paper tackling this issue with a new open-source analytic platform: the Language Interpretability Tool (LIT).
Researchers dive deep into the large language model to discover how it encodes the structured commonsense knowledge it leverages on downstream commonsense tasks.
OpenAI’s 175 billion parameter language model GPT-3 has gone viral once again.
BigBird is shown to dramatically improve performance across long-context NLP tasks, producing SOTA results in question answering and summarization.
Researchers proposed a new transformer architecture called “Performer” — based on what they call fast attention via orthogonal random features (FAVOR).
Genderify is an AI-powered tool designed to identify a person’s gender by analyzing their name, username or email address.
Researchers from ByteDance AILab and Shanghai Jiao Tong University have introduced Xiaomingbot, a multilingual and multimodal news reporter.
This paper carefully engineers artificial-language learning experiments to replicate sources of information infants learn from and under what conditions.
Microsoft announced it would spin off its chatbot business XiaoIce, with all associated technologies licensed to a newly formed independent company.
Researchers launched the ProtTrans Project, which provides an outstanding model for protein pretraining.
PLATO-2, a open-domain chatbot model, can talk about anything in Chinese and English and engage in deep conversations.
TaBERT-powered neural semantic parsers showed performance improvements on the challenging benchmark WikiTableQuestions and demonstrated competitive performance on the text-to-SQL dataset Spider.