Back to AIBriefs
How-ToDevelopers

Tool simulates LLM token speeds from 5 to 800/s

Tool simulates LLM token speeds from 5 to 800/sSimon Willison's Weblog

A simple HTML app by Mike Veerman simulates LLM token output speeds from 5 to 800 tokens per second. It helps developers visualize advertised token rates like '30 tokens/second' in real time.

·
27 days ago
Tool simulates LLM token speeds from 5 to 800/s — AIBriefs