AnalysisAI ModelsNovember 9, 2026

Qwen3.5-0.8B run in pure Assembly hits 6.51 tokens/sec

Read original source →reddit.com

On an AMD EPYC 7B12, the hand-written Assembly implementation generated 6.51 tokens/sec on a single CPU thread versus 4.34 for the Transformers reference. All 32 generated tokens matched between both runs.

1 source

More stories today

Open the live feed