by Synced 2017-09-25 1 AI Research A Brief Overview of Attention Mechanism Attention is simply a vector, often the outputs of dense layer using softmax function.