Open Sparse Autoencoders Everywhere: The Ambitious Vision of DeepMind’s Gemma Scope
In a new paper Gemma Scope: Open Sparse Autoencoders Everywhere All At Once on Gemma 2, a Google DeepMind research team introduces Gemma Scope, a comprehensive suite of JumpReLU SAEs.