Yann LeCun Team Uses Dictionary Learning To Peek Into Transformers’ Black Boxes
A Yann LeCun team proposes dictionary learning to provide detailed visualizations of transformer representations and insights into semantic structures such as word-level disambiguation, sentence-level pattern formation, and long-range dependency captured by transformers.