Tag: attention model

AI Research

A Brief Overview of Attention Mechanism

Attention is simply a vector, often the outputs of dense layer using softmax function.