Tag: Microsoft AI Research

AI Machine Learning & Data Science Research

ZeRO-Offload: Training Multi-Billion Parameter Models on a Single GPU

Researchers from University of California, Merced and Microsoft have introduced ZeRO-Offload, a novel heterogeneous DL training technology that enables training of multi-billion parameter models on a single GPU without any model refactoring.

AI Industry Research

2020 AI Residency Guide

As global AI development and deployment continues, the demand for AI talents is growing faster than ever. A number of industry leaders and reputable institutions offer AI residency programs designed to help nurture promising AI talents.