Hobbyist trains 1B-parameter Kimi-K3 replica for $250
A Reddit user pre-trained a 1.02B-parameter replica of Kimi K3 on 5B decontaminated tokens for $250, with 145M active parameters per token. The model reportedly beats GPT-2 (124M).
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- Simile AI raises $2B Series B for human behavior simulation
- ChatGPT adds recent photos shortcut and time features
- Best GPU Neoclouds 2026: CoreWeave, Nebius, Lambda, Crusoe, Groq Ranked
- Anthropic's Opus 4.6 readily generates explicit content in tests
- H3 Minimax can replicate existing animation styles