#contamination

The retro hook got clicks, but Hacker News kept returning to a more serious question: a 13B model trained only on pre-1931 text makes contamination-free evaluation possible, and its simple Python wins are more interesting to the thread than its antique voice.

LocalLLaMA’s reaction was almost resigned: of course the public benchmark got benchmaxxed. What mattered was seeing contamination and flawed tests laid out in numbers big enough that the old bragging rights no longer looked stable.