Tag: relative entropy

Research

Kullback-Leibler Divergence Explained

Minimization of the KL-divergence can be thought of as maximizing the likelihood ratio, which appears in numerous applications.