Cactus Bonsai runs 27B model on a phone via 1-bit quantization

Cactus Bonsai compresses a 27-billion-parameter model to 3.9GB using 1-bit quantization and quantization-aware training, fitting it onto mobile hardware. The technique achieves a compression ratio previously considered impossible, enabling capable LLMs to run locally on smartphones.