LittleLearner finds LLM capability ceiling with K–5-only training
The project trained 0.6B/1.3B/5B models from scratch on an 88B-token corpus filtered to the U.S. K–5 curriculum, with matched unfiltered controls. Scaling, SFT+GRPO post-training, and in-context learning amplified in-scope skills, but none meaningfully improved out-of-scope performance — the pretraining filter sets the effective capability ceiling.
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- Z.ai CEO Jie Tang: GLM 5.3 gains come from RL, not parameter count
- New tool adds 14 skills to Claude Code and Cursor for Markdown diagrams
- Tool turns Claude into a team of AI employees on your Mac
- GOP panics over Big Tech ties as Trump shifts on AI regulation
- Ethan Mollick: Claude's skill creator beats ChatGPT for reusable skills