Google pushes Gemma 4 agentic workflows onto edge devices

Google's AI Edge team said on April 2, 2026 that Gemma 4 is turning open models into a practical on-device agent stack. The new Gemma 4 family is available under the Apache 2.0 license and is designed for multi-step planning, autonomous action, offline code generation, audio-visual processing, and support for more than 140 languages. Google's positioning is clear: developers should be able to build agentic experiences locally on phones, desktops, browsers, IoT hardware, and robots rather than sending every task back to the cloud.

The announcement pairs the models with actual tooling. Google AI Edge Gallery now includes Agent Skills, which Google describes as one of the first applications to run multi-step autonomous workflows entirely on-device. Those skills can pull in outside knowledge, turn user inputs into summaries, flashcards or visualizations, and even chain Gemma 4 with other models for text-to-speech, image generation, or music synthesis. The emphasis is not just on an open model release, but on giving developers a working pattern for tool use and end-to-end agent behavior.

Google also used the launch to expand LiteRT-LM as the deployment layer. It highlighted constrained decoding for structured output, dynamic context handling up to the Gemma 4 128K window, and memory optimizations that can run Gemma 4 E2B in under 1.5GB on some devices. The company said LiteRT-LM can process 4,000 input tokens across two skills in under 3 seconds, and showed deployment paths from Android and iOS to Raspberry Pi 5 and Qualcomm Dragonwing IQ8. A new litert-lm CLI and Python bindings are meant to lower the cost of testing those workflows.

Why Gemma 4 matters

The bigger signal is that Google is pushing the agent stack closer to the device. That changes the tradeoff space around privacy, latency, cost, and offline availability. If open models with tool calling and structured output can run acceptably on consumer and edge hardware, developers get a new option between lightweight local AI and cloud-centered orchestration. Gemma 4 is therefore not just another open model family. It is Google's attempt to make on-device agentic AI a mainstream development target.