by Synced 2019-10-21 Number of comments0 AI Research Can Pretrained Language Models Replace Knowledge Bases? The recent rapid development of pretrained language models has produced significant performance improvements on downstream NLP tasks.