#edge-ai

LocalLLaMA liked the promise of 1.58-bit models, but the thread quickly asked the hard question: are the comparisons fair against quantized Qwen peers, or just full-precision baselines?

Space data centers are still mostly future tense, but space inference is starting to look like a real business. Kepler’s in-orbit cluster already ties 40 Nvidia Orin processors across 10 satellites and has 18 customers, which is enough to move the idea out of pitch-deck territory.

Investor appetite for AI silicon may be reaching beyond data center giants. Reuters reports that South Korea's DeepX is preparing a domestic listing, could consider a U.S. listing later, and plans to pick IPO banks after its current funding round wraps in the first half of 2026.

A LocalLLaMA demo pointed to Parlor, which runs speech and vision understanding with Gemma 4 E2B and uses Kokoro for text-to-speech, all on-device. The README reports roughly 2.5-3.0 seconds end-to-end latency and about 83 tokens/sec decode speed on an Apple M3 Pro.

Reddit picked up Google’s Gemma 4 edge rollout, focusing on Agent Skills in Google AI Edge Gallery and the LiteRT-LM runtime. The main claims are sub-1.5GB memory, a 128K context window, and published benchmarks on Raspberry Pi 5 and Qualcomm NPUs.

Google said on April 2, 2026 that Gemma 4 is its most capable open model family so far, built from the same technology base as Gemini 3. Google says the family spans E2B, E4B, 26B MoE, and 31B Dense models, adds function-calling and structured JSON support, and offers up to 256K context with an Apache 2.0 license.

A strong r/LocalLLaMA reaction suggests PrismML’s Bonsai launch is landing as more than another compression headline. The discussion combines the company’s end-to-end 1-bit claims with early hands-on reports that the models feel materially more usable than earlier BitNet-style experiments.

A smaller release drew outsized attention on LocalLLaMA because LFM2.5-350M is not trying to be a general-purpose chatbot. Liquid AI is pitching it as a compact model for tool use, structured outputs, and data-heavy edge workflows.

A notable Hacker News launch this week came from Prism ML, which is positioning 1-Bit Bonsai as the first commercially viable family of 1-bit LLMs. The pitch is less about bigger models and more about intelligence density, device fit, and the economics of edge inference.

A well-received r/LocalLLaMA post spotlighted PrismML’s 1-bit Bonsai launch, which claims to shrink an 8.2B model to 1.15GB with an end-to-end 1-bit design. The pitch is not just compression, but practical on-device throughput and energy efficiency.

NVIDIA used GTC 2026 to describe how telecom operators are turning distributed network assets into AI grids. The pitch is that inference for low-latency, edge-heavy workloads should move closer to users, devices, and data.

A March 19, 2026 Hacker News post about Kitten TTS reached 512 points and 172 comments at crawl time. KittenML says its 15M, 40M, and 80M ONNX speech models target CPU inference with eight English voices and 24 kHz output.