LaunchDevelopersOctober 9, 2026

ttok 1.0 ships with GPT-5/GPT-6 tokenizer default

Read original source →simonwillison.net

Simon Willison's token-counting CLI now defaults to the GPT-5/GPT-6 tokenizer instead of GPT-4. A cited experiment found all seven GPT models (5.5, 5.6 Sol/Terra/Luna, 6 Astra/Sol/Luna) report 44,794 tokens and match on all 31 fixtures.

1 source

More stories today

Open the live feed