AnalysisAI ModelsJuly 29, 2026

Kimi K3 runs at ~4t/s on home lab with 768GB DDR5 and 2x5090

A Reddit user reports running Kimi K3 on a home setup with 768GB DDR5 and 2x5090 GPUs, achieving approximately 4 tokens per second using a custom llama.cpp fork and GGUF quantized weights.

1 source

Daily brief

Get tomorrow's AI brief in your inbox

More stories today

Open the live feed