What was announced

Google DeepMind introduced Gemma Scope 2, an expanded open suite for LLM interpretability research. The release covers the full Gemma 3 range, from 270M to 27B parameters, with a focus on studying behaviors that emerge at larger scales. On the source page, the article is dated December 19, 2025 and shows a modified timestamp of 2026-02-16.

Technical scope

Gemma Scope 2 combines sparse autoencoders (SAEs) and transcoders to map internal model representations to observed behavior. DeepMind says SAEs and transcoders were trained across every layer of the Gemma 3 family, and that the release includes skip-transcoders and cross-layer transcoders to better analyze multi-step internal computations. The post also highlights use of the Matryoshka training technique to improve concept extraction quality and address limitations found in earlier tooling.

The toolkit includes support for chat-tuned model analysis, including investigations of jailbreak behavior, refusal mechanisms, and chain-of-thought faithfulness. DeepMind also points researchers to a public interactive demo on Neuronpedia and a technical paper for deeper implementation details.

Why it matters

DeepMind characterizes Gemma Scope 2 as the largest open-source interpretability release by an AI lab to date. The company reports that producing the release required storing approximately 110 Petabytes of data and training more than 1 trillion total parameters. In practical terms, this expands shared infrastructure for AI safety and auditing work, especially for teams trying to debug large-model behavior rather than only benchmark outputs. As industry attention shifts toward agent reliability and robust safeguards, open interpretability tooling at this scale can help make failure analysis, reproducibility, and safety interventions more operational in real-world LLM deployment pipelines.

Source page: https://deepmind.google/blog/gemma-scope-2-helping-the-ai-safety-community-deepen-understanding-of-complex-language-model-behavior/

#gemma

Google DeepMind Releases Gemma Scope 2 Across Gemma 3 Models for Open Interpretability Research