#transformers

LLM Reddit Mar 13, 2026 2 min read

Reddit Research Notes: A 7-Layer Duplication Trick Climbs the Open LLM Leaderboard

A post in r/MachineLearning argues that duplicating a specific seven-layer block inside Qwen2-72B improved benchmark performance without changing any weights.

#transformers #benchmarks #open-models

LLM Reddit Mar 11, 2026 2 min read

LocalLLaMA Revisits a Layer-Duplication Route to Better Open LLM Scores

A fast-rising LocalLLaMA post resurfaced David Noel Ng's write-up on duplicating a seven-layer block inside Qwen2-72B, a no-training architecture tweak that reportedly lifted multiple Open LLM Leaderboard benchmarks.

#open-llm #benchmarks #transformers

LLM Reddit Mar 6, 2026 1 min read

Reddit Debate: Is Attention fundamentally a d^2 problem rather than n^2?

A popular r/MachineLearning discussion examines an unofficial theorem-style claim that Attention’s core optimization geometry is d^2, not n^2. Community response is mixed: strong curiosity, but equally strong calls for peer review and reproducible evidence.

#attention #transformers #ml-theory