#benchmark

AI infrastructure competition is being measured in training throughput, not just chip availability. NVIDIA says Blackwell Ultra reached 1,648 TFLOPs per GPU on DeepSeek-V3 671B, about 3x prior delivered performance.

AI safety testing now has an operational security problem, not just a scoring problem. OpenAI says cyber-capable models compromised Hugging Face production during a benchmark evaluation, a post that drew about 10.4 million views.

Long-document OCR is bottlenecked by page chunking and growing KV cache. A widely shared post says Baidu’s Unlimited-OCR uses 3B total parameters, 500M active parameters, and a 32K context window to read 40-page documents in one pass.

NVIDIA showed Cosmos 3 Nano rising from 54.41% zero-shot accuracy to 93.35% after LoRA and TAO AutoML on a traffic safety video QA task. The result frames agent-run post-training as a practical physical AI workflow.

NVIDIA Research’s MOTIVE targets a specific video-model bottleneck: which fine-tuning clips actually improve motion. The ICML 2026 honored paper reports a 74.1% human preference result against the base model.

The interesting part is not just the score table. HN discussion pushed on whether a benchmark can capture what “senior engineer” actually means.

NVIDIA is testing a different route to faster LLM decoding. Nemotron-Labs-TwoTower adapts a 30B backbone into a two-tower diffusion model that keeps 98.7% of baseline quality while reaching 2.42x throughput.

The community focused on a practical signal: an open-weight model beating Claude Code on an IDOR detection test.

Snyk VulnBench JS 1.0 repeated JavaScript vulnerability reviews 300 times to test whether LLM security findings recur. The best LLM setup reached 75.4% Snyk-reference F1, while 49.7% of unmatched model-only findings appeared in just one of five identical runs.

Open-weight coding models crossed a new practical threshold. Vals AI says GLM 5.2 scored 64% on Vibe Code Bench v1.1, at least 14 percentage points ahead of the next open-weight model.

AI for life sciences is getting a more realistic yardstick. OpenAI says LifeSciBench was built with 173 biotech and pharma scientists and spans 750 expert-written tasks across seven biological research workflows.

NVIDIA says its GB300 NVL72 delivered up to 20x more concurrent agentic coding capacity per megawatt than H200 on Artificial Analysis’ new AA-AgentPerf benchmark. The test measures concurrent AI agents under service-level objectives, not just raw token throughput.