Aurora-80K: tiny language model with 80K parameters
Aurora-80K is a small language model with exactly 80,000 parameters, using a factorized 4,096-token vocabulary. Benchmarks: Wikitext-2 BPB 3.2902, BLiMP 52.31%, Arc-Easy 26.05%.
1 source
Daily brief
Get tomorrow's AI brief in your inbox
More stories today
- LangSmith adds Preview Builds to test agent changes before production
- Exa plugin gives ChatGPT Work and Codex access to 100B+ websites
- Ramp launches its own AI model router, called Router
- Apple’s AirPods Should Avoid Meta’s Mistakes
- Docker's Tushar Jain on AI-native runtime for agent autonomy