Bonsai 27B 1-bit LLM runs on a phone

Bonsai-27B is the first 27B-parameter model that can run on a mobile phone, using 1-bit (binary) and ternary quantization. A ternary variant (Ternary-Bonsai-27B) is also available. The model is open-source and supported in llama.cpp.