Kimi k3 model released with 2.8 trillion parameters

The Kimi k3 model features a 2.8 trillion parameter architecture, significantly increasing hardware requirements for local execution. Community discussions suggest that extreme quantization, such as iQ2_XXS or IQ1.8, will be necessary to run the model on consumer hardware.