How-ToDevelopersAugust 3, 2026

WASTE inference engine enables running Kimi K3 model from NVMe

WASTE is a dependency-free C inference engine that runs the 2.78-trillion-parameter Kimi K3 model by streaming activated weights from disk. It maintains the model trunk in RAM while using remaining memory as a cache for experts.

1 source

Daily brief

Get tomorrow's AI brief in your inbox

More stories today

Open the live feed