1-bit quantization lets Cactus Bonsai run 27B model on a phone

Cactus Bonsai compresses a 27-billion-parameter model to just 3.9GB using 1-bit quantization and quantization-aware training, enabling it to run on a smartphone. At standard 32-bit precision, the same model would require over 50GB of memory, making on-device inference infeasible.