LLM Hacker News 2h ago 1 min read
The interesting part is not that the tiny model is smart. It is the memory layout: most parameters sit in flash, and only the needed rows are read per token.
The interesting part is not that the tiny model is smart. It is the memory layout: most parameters sit in flash, and only the needed rows are read per token.