#pretraining

OpenAI co-founder and former Tesla AI director Andrej Karpathy announced on May 19 that he has joined Anthropic's pre-training team, where he will build a sub-team using Claude to accelerate core model training research.

A developer on r/MachineLearning shared phase-one details for Dante-2B, a 2.1B Italian/English model trained from scratch with a tokenizer tuned for Italian morphology and token efficiency.