#transformers

LLM Reddit 3h ago 2 min read

Reddit Research Notes: A 7-Layer Duplication Trick Climbs the Open LLM Leaderboard

A post in r/MachineLearning argues that duplicating a specific seven-layer block inside Qwen2-72B improved benchmark performance without changing any weights.

#transformers #benchmarks #open-models

LLM Reddit 2d ago 2 min read

LocalLLaMA Revisits a Layer-Duplication Route to Better Open LLM Scores

A fast-rising LocalLLaMA post resurfaced David Noel Ng's write-up on duplicating a seven-layer block inside Qwen2-72B, a no-training architecture tweak that reportedly lifted multiple Open LLM Leaderboard benchmarks.

#open-llm #benchmarks #transformers

LLM Reddit Mar 6, 2026 1 min read

Reddit Debate: Is Attention fundamentally a d^2 problem rather than n^2?

A popular r/MachineLearning discussion examines an unofficial theorem-style claim that Attention’s core optimization geometry is d^2, not n^2. Community response is mixed: strong curiosity, but equally strong calls for peer review and reproducible evidence.

#attention #transformers #ml-theory

LLM Reddit Mar 1, 2026 2 min read

Reddit ML Spotlight: AdderBoard Pushes Tiny Transformer Addition Challenge Below 100 Parameters

A r/MachineLearning post surfaced AdderBoard, where community submissions report 100% 10-digit addition with extremely small transformer designs, including hand-coded models under 100 parameters.

#transformers #tiny-models #benchmark

LLM Reddit Mar 1, 2026 2 min read

Reddit ML Spotlight: AdderBoard Pushes Tiny Transformer Addition Challenge Below 100 Parameters

A r/MachineLearning post surfaced AdderBoard, where community submissions report 100% 10-digit addition with extremely small transformer designs, including hand-coded models under 100 parameters.

#transformers #tiny-models #benchmark