AnalysisAI ModelsJune 30, 2026

Qwen 3.6 27B hits ~100 TPS on RTX 3090 with speculative decoding

Benchmark achieves ~100 tokens per second on a single RTX 3090 using speculative decoding. Tests compare 5 inference engines including llama.cpp forks and Lucebox.

1 source