Tag: softmax

AI Technology

A Brief Overview of Attention Mechanism

Attention is simply a vector, often the outputs of dense layer using softmax function.

Advertisements