#edge-ai

The interesting part is not that the tiny model is smart. It is the memory layout: most parameters sit in flash, and only the needed rows are read per token.

NVIDIA’s SIGGRAPH update shifts physical AI from cloud demos toward edge deployment. The package includes the 4B Cosmos 3 Edge world model, a Synthetic Video Detector NIM microservice, and a DGX Station agent stack built around Nemotron 3 Ultra.

Earth-observation satellites may not need to downlink everything before analysis. A YAM-9 demonstration used Google DeepMind’s Gemma 3 and NASA JPL software to identify targets from natural-language queries while already in orbit.

Google released Gemma 4 QAT checkpoints for edge devices and consumer GPUs. The mobile format cuts Gemma 4 E2B to a 1GB memory footprint while adding Q4_0 and ecosystem-ready weights.

Liquid AI's new LFM2.5 8B-A1B MoE model delivers 253 tokens/s on M5 Max, runs under 6GB memory on mobile, and achieves 18,500 output tokens/s on H100—all while outperforming similarly-sized dense models on key benchmarks.

LocalLLaMA liked the promise of 1.58-bit models, but the thread quickly asked the hard question: are the comparisons fair against quantized Qwen peers, or just full-precision baselines?

Space data centers are still mostly future tense, but space inference is starting to look like a real business. Kepler’s in-orbit cluster already ties 40 Nvidia Orin processors across 10 satellites and has 18 customers, which is enough to move the idea out of pitch-deck territory.

Investor appetite for AI silicon may be reaching beyond data center giants. Reuters reports that South Korea's DeepX is preparing a domestic listing, could consider a U.S. listing later, and plans to pick IPO banks after its current funding round wraps in the first half of 2026.

A LocalLLaMA demo pointed to Parlor, which runs speech and vision understanding with Gemma 4 E2B and uses Kokoro for text-to-speech, all on-device. The README reports roughly 2.5-3.0 seconds end-to-end latency and about 83 tokens/sec decode speed on an Apple M3 Pro.

Reddit picked up Google’s Gemma 4 edge rollout, focusing on Agent Skills in Google AI Edge Gallery and the LiteRT-LM runtime. The main claims are sub-1.5GB memory, a 128K context window, and published benchmarks on Raspberry Pi 5 and Qualcomm NPUs.

Google said on April 2, 2026 that Gemma 4 is its most capable open model family so far, built from the same technology base as Gemini 3. Google says the family spans E2B, E4B, 26B MoE, and 31B Dense models, adds function-calling and structured JSON support, and offers up to 256K context with an Apache 2.0 license.

A strong r/LocalLLaMA reaction suggests PrismML’s Bonsai launch is landing as more than another compression headline. The discussion combines the company’s end-to-end 1-bit claims with early hands-on reports that the models feel materially more usable than earlier BitNet-style experiments.