A LocalLLaMA post highlighting Liquid AI’s browser inference demo reached 79 points and 11 comments because it packages several local-LLM trends into one concrete result: sparse models, ONNX deployment, WebGPU execution, and hardware-efficient inference on consumer devices. The headline claim from the Reddit post is what caught attention first. The poster says Liquid AI’s LFM2-24B-A2B runs at roughly 50 tokens per second in a browser on an M4 Max, while the smaller 8B A1B variant exceeds 100 tokens per second on the same machine.

The official model materials help explain why the demo drew interest. Liquid AI describes LFM2-MoE as a mixture-of-experts model with 24B total parameters but only about 2B active parameters per token. The ONNX export page says the model uses 64 experts with 4 activated per token, aiming to preserve some of the quality of a much larger dense model while keeping actual compute closer to the active path. The recommended Q4F16 variant is listed at about 13GB, while the FP16 version is about 44GB.

That combination matters because browser inference has usually been a showcase for much smaller models or much slower speeds. When a community post can pair a Hugging Face Space demo with downloadable ONNX artifacts, the conversation shifts from “interesting prototype” to “what else could realistically run this way?” The Reddit thread focused on exactly that transition: whether WebGPU plus sparse architectures can make browser-based local AI feel less like a novelty and more like a real deployment target.

The practical implication is not that every 24B model is suddenly easy to run in a tab. It is that the frontier for local inference keeps moving outward when architecture design, export format, and runtime all line up. For developers building private assistants, interactive demos, or lightweight on-device tooling, the most important part of this post is not the benchmark bragging. It is the evidence that model packaging and inference engineering are becoming just as important as raw parameter count in determining what feels usable on everyday hardware.

Original sources: Hugging Face Space, LiquidAI ONNX model card

#liquid-ai

Why LocalLLaMA is paying attention to Liquid AI’s browser inference demo