Google & UC Berkeley ‘Reformer’ Runs 64K Sequences on One GPU
A recent paper accepted by ICLR 2020 proposes a new transformer model called “Reformer” which achieves impressive performance even when running on only a single GPU.
AI Technology & Industry Review