Tag: Blockwise Gradient Normalization

This paper proposes an adaptive learning rate algorithm, which utilizes stochastic curvature information of the loss function for automatically tuning the learning rates.