Artificial intelligence does a lot of things extremely well, but just how it does these things often remains unclear — shrouded by what’s come to be known as the “black box” problem. This is particularly true in NLP, where researchers can waste a lot of time trying to figure out what went wrong when their models don’t run as well as expected. Last week, Google Research released a paper tackling this issue with a new open-source analytic platform: the Language Interpretability Tool (LIT).
LIT is a toolkit and browser-based user interface (UI) for NLP model understanding. It has five major functions:
- Supports local explanation, including salience maps, attention, and rich visualizations of model prediction
- Supports aggregate analysis, including metrics, embedding spaces, and flexible slicing
- Allows switching seamlessly between the above to test local hypotheses and validate over a dataset
- Allows new data points to be added at any time and visualizes their effect immediately
- Allows visualizing comparisons between two models or two data points on the same interface
The LIT UI is written in TypeScript and communicates with a Python backend that hosts models, datasets, counterfactual generators, and other interpretation components. Considering the continuous advancement of NLP models, Google researchers designed the LIT with five principles:
- Flexible to support a wide range of NLP tasks, including classification, seq2seq, language modelling and structured prediction
- Extensible so that it can be reconfigured and extended for newly added workflows
- Modular with portable independent components to select from based on particular needs
- Framework agnostic, works with any model that can run from Python
- Easy to use with only a small amount of code required
The Google researchers point out that their LIT interactive evaluation tool is not suitable for training-time monitoring or large datasets.
The paper The Language Interpretability Tool: Extensible, Interactive Visualizations and Analysis for NLP Models is on arXiv. The tool has been open-sourced on Github.
Analyst: Reina Qi Wan | Editor: Michael Sarazen; Fangyu Cai
Synced Report | A Survey of China’s Artificial Intelligence Solutions in Response to the COVID-19 Pandemic — 87 Case Studies from 700+ AI Vendors
This report offers a look at how China has leveraged artificial intelligence technologies in the battle against COVID-19. It is also available on Amazon Kindle. Along with this report, we also introduced a database covering additional 1428 artificial intelligence solutions from 12 pandemic scenarios.
Click here to find more reports from us.