AnalysisAI ModelsJuly 22, 2026
Tokenizer Expansion: Upgrading a Model's Tokenizer in Place

The method doubles vocabulary from 65K to 128K and upgrades a pre-trained model's tokenizer in place without retraining from scratch. It specifically upgrades Liquid's LFM2.5-8B-A1B model to fix languages the original tokenizer split too finely.