by Synced 2020-08-22 2 Machine Learning & Data Science Nature Language Tech Popular Sepp Hochreiter on Parallels Between Attention Mechanisms and Modern Hopfield Networks Researchers argue that “attention mechanism is the update rule of a modern Hopfield network with continuous states.”