Huawei’s TinyBERT Is 7X Smaller and 9X Faster Than BERT
Researchers from the Huazhong University of Science and Technology and Huawei Noah’s Ark Lab have introduced TinyBERT, a smaller and faster version of Google’s popular large-scale pre-trained language processing model BERT.