AnalysisAI ModelsJune 30, 2026
Qwen 3.6 27B hits ~100 TPS on RTX 3090 with speculative decoding
Benchmark achieves ~100 tokens per second on a single RTX 3090 using speculative decoding. Tests compare 5 inference engines including llama.cpp forks and Lucebox.