Nemotron 3 Embed tops LMEB with 8B first and 1B second
Original: Nemotron 3 Embed tops LMEB with 8B first and 1B second View original →
Long-memory retrieval gets a sharper benchmark signal
Agent systems depend on retrieval models that can find the right fragment from long histories, not just embed short documents well. NVIDIA AI used a July 17 X post to say Nemotron 3 Embed has taken the top LMEB slot, with its smaller 1B model directly behind the 8B version.
“Another leaderboard win for Nemotron 3 Embed. The 8B model takes #1 on LMEB, with the 1B model right behind it at #2.”
This is separate from the RTEB result already attached to the launch. LMEB focuses on whether embedding models can retrieve the right details across long-running conversations and other memory-heavy tasks. For agent products, that matters because the model often fails before generation begins: the wrong memory is fetched, useful evidence is missed, or a long context window is filled with weak matches.
The related Hugging Face article says Nemotron-3-Embed-8B-BF16 scored 78.5% on RTEB and 75.5% on MMTEB Retrieval. In the article’s community update, the LMEB results are listed as 64.4 for the 8B model and 61.5 for the 1B BF16 model. NVIDIA also positions the 1B BF16 model as a lower-cost deployment option, with reported RTEB error-rate reduction of 27% versus its 1B predecessor and MMTEB Retrieval error-rate reduction of 28%.
NVIDIA AI’s account typically posts about model releases, NIM deployment paths, NeMo tooling, and GPU-accelerated AI infrastructure. The strategic point here is that the Nemotron 3 Embed family is being framed as a retrieval layer for enterprise RAG, code search, and agent memory, not merely as a model-card update. Watch whether memory providers and enterprise search vendors report similar gains outside public leaderboards, especially where latency budgets push teams toward 1B-class embedders.
Related Articles
Retrieval models are becoming a direct quality and cost lever for RAG and agents. NVIDIA says Nemotron 3 Embed 8B ranks first overall on RTEB, with 32k context and smaller 1B variants.
LocalLLaMA focused on the practical question: can a diffusion LLM keep quality while making generation meaningfully faster?
NVIDIA is testing a different route to faster LLM decoding. Nemotron-Labs-TwoTower adapts a 30B backbone into a two-tower diffusion model that keeps 98.7% of baseline quality while reaching 2.42x throughput.