Microsoft India Proposes Varuna: Scalable, Low-Cost Training of Massive Deep Learning Models

A Microsoft Research India team presents Varuna, a system for training massive deep learning models on commodity networking that eliminates the need for specialized hyperclusters and alleviates the cost, scale, and resource utilization challenges of deep learning model training.